-- Logs begin at Tue 2022-07-05 12:06:00 UTC, end at Tue 2022-07-05 13:19:02 UTC. -- Jul 05 12:40:21.030709 dv-cinder-797608-48-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 05 12:40:21.040387 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 05 12:40:21.042434 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 5 12:40:21 2022] *** Jul 05 12:40:21.042434 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 05 12:40:21.042434 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 05 12:40:21.042434 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: nodename: dv-cinder-797608-48-iscsi Jul 05 12:40:21.042434 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: machine: x86_64 Jul 05 12:40:21.042434 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: clock source: unix Jul 05 12:40:21.042434 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: pcre jit disabled Jul 05 12:40:21.042434 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: detected number of CPU cores: 4 Jul 05 12:40:21.042434 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: current working directory: / Jul 05 12:40:21.042434 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: detected binary path: /usr/bin/uwsgi-core Jul 05 12:40:21.043084 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: your processes number limit is 47680 Jul 05 12:40:21.043084 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: your memory page size is 4096 bytes Jul 05 12:40:21.043084 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: detected max file descriptor number: 2048 Jul 05 12:40:21.043084 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: lock engine: pthread robust mutexes Jul 05 12:40:21.043084 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: thunder lock: enabled Jul 05 12:40:21.043084 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 05 12:40:21.043084 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 05 12:40:21.086305 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: Python main interpreter initialized at 0x55ac2f10e9c0 Jul 05 12:40:21.086305 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: python threads support enabled Jul 05 12:40:21.086305 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: your server socket listen backlog is limited to 100 connections Jul 05 12:40:21.086305 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: your mercy for graceful operations on workers is 90 seconds Jul 05 12:40:21.086641 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: mapped 403077 bytes (393 KB) for 2 cores Jul 05 12:40:21.086716 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: *** Operational MODE: preforking *** Jul 05 12:40:21.086996 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: *** uWSGI is running in multiple interpreter mode *** Jul 05 12:40:21.086996 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: spawned uWSGI master process (pid: 80362) Jul 05 12:40:21.087198 dv-cinder-797608-48-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 05 12:40:21.089400 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: spawned uWSGI worker 1 (pid: 80374, cores: 1) Jul 05 12:40:21.089400 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: spawned uWSGI worker 2 (pid: 80375, cores: 1) Jul 05 12:40:21.089400 dv-cinder-797608-48-iscsi devstack@keystone.service[80362]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 05 12:40:26.567807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 12:40:26.567807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: from cryptography.utils import int_from_bytes Jul 05 12:40:26.568560 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 12:40:26.568560 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: from cryptography.utils import int_from_bytes Jul 05 12:40:26.569093 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 12:40:26.569093 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: from cryptography.utils import int_from_bytes Jul 05 12:40:26.569209 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 12:40:26.569209 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: from cryptography.utils import int_from_bytes Jul 05 12:40:26.619241 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 12:40:26.619438 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 12:40:26.619664 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] command line args: [] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 12:40:26.619959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 12:40:26.620164 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ================================================================================ {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 12:40:26.620450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] admin_token = **** {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.620734 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] config_dir = [] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.620927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.621113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] config_source = [] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.621289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 12:40:26.621376 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] debug = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.621491 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.621754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 12:40:26.621754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] command line args: [] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 12:40:26.621875 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.622005 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 12:40:26.622089 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.622150 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ================================================================================ {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 12:40:26.622284 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.622396 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] admin_token = **** {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.622533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.622637 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] config_dir = [] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.622767 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] list_limit = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.622878 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.622986 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] log_config_append = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.623082 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] config_source = [] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.623181 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.623282 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] debug = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.623378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] log_dir = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.623478 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.623615 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] log_file = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.623718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.623842 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.623920 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.624042 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.624126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.624199 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.624315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.624395 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.624524 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] list_limit = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.624632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.624721 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] log_config_append = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.624799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.624918 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.625000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] log_dir = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.625069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.625143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] log_file = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.625280 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.625404 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.625481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.625598 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.625679 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.625806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.625883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.626071 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.626206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.626297 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.626375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.626504 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.626577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.626653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.626824 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.626903 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.627112 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.627321 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.627412 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.627509 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] publish_errors = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.627594 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.627747 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.627831 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.627982 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.628058 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.628174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.628255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.628395 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.628541 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.628701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.628878 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] standard_threads = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.629045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.629132 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.629231 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] publish_errors = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.629346 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.629466 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.629551 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.629687 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] use_journal = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.629763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.629863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] use_json = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.629946 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.630028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] use_stderr = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.630105 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.630202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] use_syslog = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.630336 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.630433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.630574 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] standard_threads = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.630690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.630808 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.630931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.631054 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.631201 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.631283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.631433 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] use_journal = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.631507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.631582 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] use_json = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.631681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.631763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] use_stderr = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.631896 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] use_syslog = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.631980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.632130 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 12:40:26.632207 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.632378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.632455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.632670 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.632765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.632922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.632998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.633163 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.633245 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.633398 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.633482 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.633644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.633720 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.633881 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.633959 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.634119 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.634203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.634367 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.634443 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.634607 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.634684 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.634853 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.634936 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.635091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.635174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.635338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.635421 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.635575 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.635652 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.635826 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.635902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.636076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.636190 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.636316 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.636452 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.637083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.637179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.637254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.637330 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.637477 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.637558 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.637629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.637698 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.637768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.637842 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.637921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.637996 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.638129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.638213 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.638363 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.638445 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.638596 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.638686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.638832 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.638908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.639071 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.639148 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.639309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.639386 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.639560 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.639635 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.639791 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.639899 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.640028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.640133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.640260 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.640373 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.640491 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.640644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.640761 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.640860 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.640972 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.641100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.641209 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.641289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.641429 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.641508 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.641680 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.641762 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.641914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.642034 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.642156 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.642233 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.642386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.642463 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.642618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.642703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.642853 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.642927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.643093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.643172 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.643326 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.643409 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.643568 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.643654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.643809 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.643887 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.644043 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.644120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.644282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.644370 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.644521 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.644618 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.644797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.644874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.645033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.645129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.645278 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.645358 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.645514 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.645591 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.645748 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.645838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.645988 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.646066 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.646230 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.646307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.646462 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.646547 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.646703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.646781 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.646941 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.647023 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.647182 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.647268 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.647419 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.647499 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.647675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.647752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.647914 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.647998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.648174 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.648258 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.648411 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.648488 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.648672 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.648832 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.648908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.648977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.649149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.649227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.649388 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.649474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.649632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.649710 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.649870 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.649946 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.650106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.650195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.650331 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.650404 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.650567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.650646 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.650802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.650880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.651040 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.651118 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.651286 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.651372 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.651525 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.651606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.651797 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.651874 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.652038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.652114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.652274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.652350 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.652512 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.652615 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.652774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.652854 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.653014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.653091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.653246 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.653325 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.653477 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.653556 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.653713 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.653790 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.653943 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.654028 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.654186 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.654263 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.654422 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.654498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.654655 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.654734 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.654889 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.654967 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.655122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.655199 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.655359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.655444 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.655592 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.655669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.655836 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.655914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] auth.external = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.656066 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.656144 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.656316 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.656392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.656558 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.656648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.656845 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.656925 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] auth.password = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.657079 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] auth.token = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.657155 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.657322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.657410 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.657562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.657639 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] auth.external = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.657794 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.657872 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.658031 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.658115 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.658281 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.658360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.658531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.658616 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] auth.password = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.658762 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] auth.token = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.658836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.658998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] credential.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.659076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.659234 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.659312 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.659485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.659564 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.659720 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.659807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.659957 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.660035 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.660203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.660289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.660433 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.660511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.660694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] credential.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.660776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.660946 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.661025 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.661189 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.661266 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.661440 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.661519 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.661680 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.661760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.661934 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.662021 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.662172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.662259 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.662432 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.662509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.662691 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.662849 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.662925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.662995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] federation.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.663163 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.663242 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.663413 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.663511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.663663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.664237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.664413 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.664492 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.664689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.664786 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.664927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.665006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.665182 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.665261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] federation.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.665421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.665509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.665670 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.665748 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.665907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.665991 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.666142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.666228 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.666379 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.666458 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.666617 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.666695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.666862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.666948 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.667099 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.667177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.667339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.667418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.667587 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.667673 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.667818 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.667903 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.668058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.668137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.668308 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.668397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.668559 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.668649 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.668824 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.668939 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.669056 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.669167 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.669289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.669370 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.669527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.669605 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.669770 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.669858 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.670018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.670095 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.670272 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.670349 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.670508 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.670596 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.670743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.670833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.670978 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.671063 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.671225 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.671312 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.671461 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.671538 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.671702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.671780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.671934 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.672021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.672171 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.672250 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.672414 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.672492 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.672684 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.672769 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.672935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.673014 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.673167 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.673244 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.673409 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.673490 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.673644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.673723 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.673883 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.673962 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.674126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.674206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.674369 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.674447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.674599 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.674682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.674839 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.674917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.675068 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.675145 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.675307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.675386 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.675550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.675643 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.675795 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.675890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.676034 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.676114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.676265 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.676345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.676506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.676600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.676762 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.676841 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.677001 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.677081 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.677235 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.677314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.677476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.677554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.677716 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.677796 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.677951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.678035 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.678187 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.678265 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.678423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.678503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.678656 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.678735 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.678886 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.678965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.679137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.679217 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.679408 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.680013 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.680173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.680253 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.680413 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.680496 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.680676 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.680771 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.680912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.680990 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.681145 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.681226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.681384 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.681463 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.681618 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.681697 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.681857 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.681937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.682089 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.682168 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.682337 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.682416 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.682585 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.682665 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.682825 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.682903 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.683067 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.683147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.683307 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.683388 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.683535 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.683612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.683770 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.683848 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.684009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.684087 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.684247 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.684325 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.684485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.684563 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.684756 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.684837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.685007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.685084 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.685244 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.685323 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.685488 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.685568 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.685728 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.685805 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.685970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.686048 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.686210 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.686296 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.686445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.686523 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.686684 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.686762 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.686908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.686982 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.687161 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.687240 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.687410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.687497 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.687642 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.687719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.687877 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.687960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.688117 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.688203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] resource.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.688358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.688438 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.688632 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.688716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.688865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.688955 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.689108 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.689185 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.689345 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.689424 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.689584 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.689671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.689828 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] resource.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.689907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.690065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.690143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.690305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.690392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.690542 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] role.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.690620 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.690790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] role.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.690876 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.691021 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.691111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.691266 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.691344 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.691517 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.691595 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.691755 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.691840 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.691998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.692077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.692236 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] role.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.692314 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.692481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.692567 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] role.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.692739 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.692818 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.692991 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.693068 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.693225 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.693315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.693474 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.693553 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.693722 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.693801 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.693970 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.694057 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.694216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.694296 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.694466 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.694612 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.694720 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.694853 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.694969 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.695134 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.695214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.695391 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.695470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.695644 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.695724 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.695895 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.695974 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.696132 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.696326 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.696407 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.696566 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.696689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.696843 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.696923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.697097 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.697178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.697340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.697417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.697575 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.697654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.697816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.697897 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.698075 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.698154 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.698329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.698406 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.698569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.698649 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.698803 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.698879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.699034 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.699116 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.699267 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.699346 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] token.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.699505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.699582 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.699754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.699833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.699991 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.700072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.700231 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.700308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.700470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.700548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.700726 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.700808 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.700966 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] token.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.701046 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.701207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.701285 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.701453 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.701532 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.701687 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.701765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.701924 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.702041 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.702161 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.702242 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.702411 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.702489 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.702656 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.702734 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.702886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.702964 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.703129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.703208 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.703366 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.703444 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.703608 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.703687 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] database.connection = **** {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.703844 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.703933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.704107 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.704186 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.704359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.704446 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.704610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.704692 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.704846 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.704923 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.705085 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.705177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.705324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.705408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] database.connection = **** {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.705562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.705650 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.705809 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.705888 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.706047 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.706201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.706278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.706349 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.706516 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.706595 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.706764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.706845 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.707000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.707079 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.707239 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.707317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.707470 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.707549 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.707714 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.707791 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.707949 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.708026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.708107 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 12:40:26.708181 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.708422 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.708693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.708943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.709178 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.709421 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.709659 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 12:40:26.709832 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 12:40:26.739545 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:26.739777 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:26.740002 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:26.740216 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:26.740454 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:26.740715 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:26.749058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:26.749766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:26.777265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:26.777501 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:26.777858 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:26.778095 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:26.920438 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:26.920893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:26.969287 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:26.969524 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:26.969901 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:26.970141 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.034536 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.034764 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.034851 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.034995 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.035079 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.035217 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.035317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.035438 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.035522 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.035657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.035741 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.035886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.061048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.061250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.061359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.061461 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.061580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.061689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.061794 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.061892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.061991 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.062099 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.062209 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.062308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.062407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.062505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.073677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.073822 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.086976 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.087165 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.087251 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.087399 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.087484 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.087625 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.087708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.087842 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.087924 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.088057 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.088140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.088271 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.088353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.088481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 12:40:27.106550 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.106764 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 12:40:27.106877 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.107088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 12:40:27.107169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.107292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 12:40:27.107419 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.107563 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.107652 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 12:40:27.107829 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.107909 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.108090 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.108169 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.108345 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.108423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.108616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.119256 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.119452 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.119536 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.119728 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.119809 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.119996 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.120086 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.120283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.128330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.128553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.131646 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.131870 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.131953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.132152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.132233 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.132477 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.132574 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.132765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.132848 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.133050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.133131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.133307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.133405 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.133572 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.133654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.133884 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.133972 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.134108 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.134188 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.134373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.134451 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.134634 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.161313 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.161680 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.162922 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.163203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.163283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.163552 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.169089 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.169370 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.169450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.169646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.169768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.170037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.177131 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.177332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.177415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.177614 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.181905 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.182142 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.182225 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.182426 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.182508 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.182705 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.182799 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.182979 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.183060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.183251 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.183339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.183518 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.183600 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.183781 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.183861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.184042 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.202425 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.202650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.202747 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.202926 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.207287 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.207478 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.211577 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.211669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.211880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.211970 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.217058 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.217160 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.220681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.220765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.224561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.224671 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.224880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.224963 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.225173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.225254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.225463 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.225555 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.225746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.225829 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.226023 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.226111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.245623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.245717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.245902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.245984 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.246166 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.246249 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.246427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.246508 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.254329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.254418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.256029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.256110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.256303 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.256384 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.260023 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.260187 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.260299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.260479 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.260606 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.260788 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.260881 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.261075 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.261201 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.261356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.274468 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.274687 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.274771 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.274970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.275052 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.275254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.275336 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.275548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.275630 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.275837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.277108 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.277398 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.277493 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.277701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.295728 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.296097 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.299008 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.299401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.302367 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.302739 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.304098 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.305069 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.306325 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.306604 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.306730 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.306891 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.307011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.307296 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.314200 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.314662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.315804 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.316275 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.319062 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.319352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.319536 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.319741 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.319823 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.320056 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.320244 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.320528 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.329215 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.329499 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.329702 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.329797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.329988 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.330268 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.337696 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.337973 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.338250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.338331 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 12:40:27.338524 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.338605 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.338793 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.338873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.339064 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.339179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.339333 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.339454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.339711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.339800 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.339981 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.340060 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.340248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.340327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.340521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.340690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.340817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.340898 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.341079 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.341158 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.341343 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.341424 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.341606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.341873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 12:40:27.380354 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ac2f10e9c0 pid: 80375 (default app) Jul 05 12:40:27.381001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ac2f10e9c0 pid: 80374 (default app) Jul 05 12:40:27.383782 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f7996-f725-4c10-8c9d-11cd245a325a None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:27.384078 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f7996-f725-4c10-8c9d-11cd245a325a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:27.384355 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f7996-f725-4c10-8c9d-11cd245a325a None None] PATH_INFO: `/v3` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:27.388601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Tue Jul 5 12:40:27 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:35.634959 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8c406-bcca-4c7f-8089-88dab29d92ed None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:35.635516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8c406-bcca-4c7f-8089-88dab29d92ed None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:35.635516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8c406-bcca-4c7f-8089-88dab29d92ed None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:35.639840 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:40:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:35.645031 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb098b49-b2c7-4661-83d1-25ee40230857 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:35.645473 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb098b49-b2c7-4661-83d1-25ee40230857 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:35.645597 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb098b49-b2c7-4661-83d1-25ee40230857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:35.714608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: INFO dbcounter [None req-cb098b49-b2c7-4661-83d1-25ee40230857 None None] Registered counter for database keystone Jul 05 12:40:35.735807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG oslo_db.sqlalchemy.engines [None req-cb098b49-b2c7-4661-83d1-25ee40230857 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80375) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 12:40:35.741975 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writer thread running {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 12:40:35.917835 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG passlib.handlers.bcrypt [None req-cb098b49-b2c7-4661-83d1-25ee40230857 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80375) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 05 12:40:35.918176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG passlib.handlers.bcrypt [None req-cb098b49-b2c7-4661-83d1-25ee40230857 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80375) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 05 12:40:35.972264 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-cb098b49-b2c7-4661-83d1-25ee40230857 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:35.974205 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-cb098b49-b2c7-4661-83d1-25ee40230857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:36.095001 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 05 12:40:36.283837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8c406-bcca-4c7f-8089-88dab29d92ed None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:36.333994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: INFO dbcounter [None req-e4d8c406-bcca-4c7f-8089-88dab29d92ed None None] Registered counter for database keystone Jul 05 12:40:36.353805 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG oslo_db.sqlalchemy.engines [None req-e4d8c406-bcca-4c7f-8089-88dab29d92ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 12:40:36.359922 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writer thread running {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 12:40:36.476803 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8c406-bcca-4c7f-8089-88dab29d92ed None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:36.481170 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bdf949-3f8c-4bf4-b3d7-22d3724e77ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:36.481832 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdf949-3f8c-4bf4-b3d7-22d3724e77ea admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:36.482119 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdf949-3f8c-4bf4-b3d7-22d3724e77ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:36.482397 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdf949-3f8c-4bf4-b3d7-22d3724e77ea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:36.490679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bdf949-3f8c-4bf4-b3d7-22d3724e77ea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:36.541957 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: WARNING keystone.common.rbac_enforcer.enforcer [None req-37bdf949-3f8c-4bf4-b3d7-22d3724e77ea admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 05 12:40:36.542241 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bdf949-3f8c-4bf4-b3d7-22d3724e77ea admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:36.551718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Tue Jul 5 12:40:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 12:40:36.557694 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb098b49-b2c7-4661-83d1-25ee40230857 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:36.572578 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb098b49-b2c7-4661-83d1-25ee40230857 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:36.577128 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb1686-94af-469e-87d7-978e436c482c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:36.578267 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb1686-94af-469e-87d7-978e436c482c admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:36.578557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb1686-94af-469e-87d7-978e436c482c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:36.578837 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb1686-94af-469e-87d7-978e436c482c admin admin] PATH_INFO: `/v3/projects/b34caad9134a4665ac2d8976c95be2ac` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:36.580341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb1686-94af-469e-87d7-978e436c482c admin admin] RBAC: Authorizing `identity:get_project(project_id=b34caad9134a4665ac2d8976c95be2ac)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:36.634432 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a3eb1686-94af-469e-87d7-978e436c482c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 05 12:40:36.634773 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb1686-94af-469e-87d7-978e436c482c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:36.639562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Tue Jul 5 12:40:36 2022] GET /identity/v3/projects/b34caad9134a4665ac2d8976c95be2ac => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:38.709005 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e437d-e5f5-4741-b28b-fc75d75bb2c4 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:38.709553 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e437d-e5f5-4741-b28b-fc75d75bb2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:38.709553 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e437d-e5f5-4741-b28b-fc75d75bb2c4 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:38.713699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:40:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:38.718955 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750b706-e7c5-4dc0-aa75-e872dd4b46ab None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:38.719332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750b706-e7c5-4dc0-aa75-e872dd4b46ab None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:38.719500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750b706-e7c5-4dc0-aa75-e872dd4b46ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:38.738718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-1750b706-e7c5-4dc0-aa75-e872dd4b46ab None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:38.740254 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1750b706-e7c5-4dc0-aa75-e872dd4b46ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:38.748685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 05 12:40:38.770266 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e437d-e5f5-4741-b28b-fc75d75bb2c4 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:38.782316 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e437d-e5f5-4741-b28b-fc75d75bb2c4 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:38.786504 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a2a37-d87b-467f-8496-65ff508e93f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:38.787128 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a2a37-d87b-467f-8496-65ff508e93f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:38.787412 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a2a37-d87b-467f-8496-65ff508e93f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:38.787691 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a2a37-d87b-467f-8496-65ff508e93f3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:38.795930 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a2a37-d87b-467f-8496-65ff508e93f3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:38.797735 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a2a37-d87b-467f-8496-65ff508e93f3 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:38.806959 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Tue Jul 5 12:40:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 12:40:38.812115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750b706-e7c5-4dc0-aa75-e872dd4b46ab None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:38.821206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750b706-e7c5-4dc0-aa75-e872dd4b46ab None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:38.825556 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7ca90-2189-47ba-9517-e9da38b8062b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:38.826412 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7ca90-2189-47ba-9517-e9da38b8062b admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:38.826703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7ca90-2189-47ba-9517-e9da38b8062b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:38.826980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7ca90-2189-47ba-9517-e9da38b8062b admin admin] PATH_INFO: `/v3/users/1dacaea933b24b6082a79a2c673ec9f1` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:38.828366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7ca90-2189-47ba-9517-e9da38b8062b admin admin] RBAC: Authorizing `identity:get_user(user_id=1dacaea933b24b6082a79a2c673ec9f1)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:38.830247 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7ca90-2189-47ba-9517-e9da38b8062b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:38.831805 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Tue Jul 5 12:40:38 2022] GET /identity/v3/users/1dacaea933b24b6082a79a2c673ec9f1 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:40.904347 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235a8ac-eeaf-4025-bdfc-b7422e8c6e1e None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:40.904988 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235a8ac-eeaf-4025-bdfc-b7422e8c6e1e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:40.904988 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235a8ac-eeaf-4025-bdfc-b7422e8c6e1e None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:40.906323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:40.911536 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7b54d-7ae0-4a82-8725-9d3be0b00387 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:40.911956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7b54d-7ae0-4a82-8725-9d3be0b00387 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:40.912102 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7b54d-7ae0-4a82-8725-9d3be0b00387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:40.919192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496c4bb-d876-4e61-bb2a-69cb2da2e8b0 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:40.919478 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496c4bb-d876-4e61-bb2a-69cb2da2e8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:40.919758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496c4bb-d876-4e61-bb2a-69cb2da2e8b0 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:40.921090 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:40:40.925823 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65d011-da92-4887-91b0-80a6e4ae5a8c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:40.926109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65d011-da92-4887-91b0-80a6e4ae5a8c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:40.926386 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65d011-da92-4887-91b0-80a6e4ae5a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:40.928513 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-08a7b54d-7ae0-4a82-8725-9d3be0b00387 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:40.929745 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-08a7b54d-7ae0-4a82-8725-9d3be0b00387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:40.966082 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG passlib.handlers.bcrypt [None req-ff65d011-da92-4887-91b0-80a6e4ae5a8c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80374) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 05 12:40:40.966509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG passlib.handlers.bcrypt [None req-ff65d011-da92-4887-91b0-80a6e4ae5a8c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80374) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 05 12:40:41.010840 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:40:41.012424 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ff65d011-da92-4887-91b0-80a6e4ae5a8c None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:41.014071 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ff65d011-da92-4887-91b0-80a6e4ae5a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:41.034691 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7b54d-7ae0-4a82-8725-9d3be0b00387 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:41.058174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:41.118708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:40:41.138890 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7b54d-7ae0-4a82-8725-9d3be0b00387 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:41.141056 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65d011-da92-4887-91b0-80a6e4ae5a8c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:41.176679 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f08d8-e52a-4dc2-9ee4-5b5e1af20f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:41.177467 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f08d8-e52a-4dc2-9ee4-5b5e1af20f4f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:41.177758 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f08d8-e52a-4dc2-9ee4-5b5e1af20f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:41.178039 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f08d8-e52a-4dc2-9ee4-5b5e1af20f4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:41.191997 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f08d8-e52a-4dc2-9ee4-5b5e1af20f4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:40:41.204565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-849f08d8-e52a-4dc2-9ee4-5b5e1af20f4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:40:41.204565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:41.204565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:41.204565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:41.204565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:41.204565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:41.204565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:41.204565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:41.204565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:41.204565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:41.204565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:41.204565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:41.204565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:40:41.204565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:40:41.204565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:40:41.204565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:40:41.206454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:40:41.206454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:40:41.206454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:40:41.206454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:40:41.206454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:41.206454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:41.206454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:41.206454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:41.206454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:41.206454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:41.206454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:41.206454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:41.206454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:41.206454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:41.206454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:41.206454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:41.208414 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:41.208414 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:41.208414 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:41.208414 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:41.208414 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:40:41.208414 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:40:41.208414 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:40:41.208414 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:40:41.208414 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:40:41.208414 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:40:41.208414 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:40:41.208414 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:40:41.208414 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 7/14] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:40:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:40:41.213548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f08d8-e52a-4dc2-9ee4-5b5e1af20f4f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:41.252283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65d011-da92-4887-91b0-80a6e4ae5a8c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:41.254571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:41.289533 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0914095-5eaf-44c9-80c4-680c014d17e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:41.290426 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0914095-5eaf-44c9-80c4-680c014d17e0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:41.290712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0914095-5eaf-44c9-80c4-680c014d17e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:41.290986 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0914095-5eaf-44c9-80c4-680c014d17e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:41.296499 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:41.314407 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f08d8-e52a-4dc2-9ee4-5b5e1af20f4f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:41.347834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d560d6-67ec-41fa-b42f-216cec81733e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:41.348497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d560d6-67ec-41fa-b42f-216cec81733e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:41.349060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d560d6-67ec-41fa-b42f-216cec81733e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:41.349334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d560d6-67ec-41fa-b42f-216cec81733e None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:41.350087 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d560d6-67ec-41fa-b42f-216cec81733e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:41.350390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d560d6-67ec-41fa-b42f-216cec81733e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:41.351908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d560d6-67ec-41fa-b42f-216cec81733e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:41.357737 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0914095-5eaf-44c9-80c4-680c014d17e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:41.359250 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0914095-5eaf-44c9-80c4-680c014d17e0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:41.363430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 8/15] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:40:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:41.369413 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d560d6-67ec-41fa-b42f-216cec81733e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:41.457063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:40:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 12:40:41.462675 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0914095-5eaf-44c9-80c4-680c014d17e0 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:41.465660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:41.467970 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d560d6-67ec-41fa-b42f-216cec81733e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:41.501544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a7282-0416-4711-846c-914b3b1483f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:41.502423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a7282-0416-4711-846c-914b3b1483f2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:41.502705 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a7282-0416-4711-846c-914b3b1483f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:41.502979 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a7282-0416-4711-846c-914b3b1483f2 None admin] PATH_INFO: `/v3/users/1dacaea933b24b6082a79a2c673ec9f1` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:41.504243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a7282-0416-4711-846c-914b3b1483f2 None admin] RBAC: Authorizing `identity:get_user(user_id=1dacaea933b24b6082a79a2c673ec9f1)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:41.505777 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a7282-0416-4711-846c-914b3b1483f2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:41.508300 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 9/17] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:40:41 2022] GET /identity/v3/users/1dacaea933b24b6082a79a2c673ec9f1 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:41.513422 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a7282-0416-4711-846c-914b3b1483f2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:41.529018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:41.564965 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0914095-5eaf-44c9-80c4-680c014d17e0 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:41.597284 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cad23f-9d7f-4974-b1f9-5d3dec7c6e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:41.598072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cad23f-9d7f-4974-b1f9-5d3dec7c6e4f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:41.598358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cad23f-9d7f-4974-b1f9-5d3dec7c6e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:41.598884 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cad23f-9d7f-4974-b1f9-5d3dec7c6e4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:41.613466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a7282-0416-4711-846c-914b3b1483f2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:41.619283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cad23f-9d7f-4974-b1f9-5d3dec7c6e4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:41.620819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cad23f-9d7f-4974-b1f9-5d3dec7c6e4f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:41.641203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-c1cad23f-9d7f-4974-b1f9-5d3dec7c6e4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:40:41.641203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:41.641203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:41.641203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:41.641203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:41.641203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:41.641203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:41.641203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:41.641203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:41.641203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:41.641203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:41.641203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:41.641203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:40:41.641203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:40:41.641203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:40:41.642010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:40:41.642010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:41.642010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:41.642010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:41.642010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:41.642010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:41.642010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:41.642010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:41.642010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:41.642010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:41.642010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:41.642010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:41.642010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:41.642010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:41.642010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:41.642010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:41.642010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:41.647727 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:40:41.647727 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:40:41.647727 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:40:41.647727 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:40:41.647727 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 9/18] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:40:41.647996 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd1831-8830-4402-a110-8db07f3749c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:41.648200 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd1831-8830-4402-a110-8db07f3749c0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:41.648280 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cad23f-9d7f-4974-b1f9-5d3dec7c6e4f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:41.648450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd1831-8830-4402-a110-8db07f3749c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:41.648717 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd1831-8830-4402-a110-8db07f3749c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:41.649906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd1831-8830-4402-a110-8db07f3749c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:41.651364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd1831-8830-4402-a110-8db07f3749c0 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:41.653024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 10/19] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:41.658566 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd1831-8830-4402-a110-8db07f3749c0 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:41.706057 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:41.738235 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:41.750254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cad23f-9d7f-4974-b1f9-5d3dec7c6e4f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:41.756864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd1831-8830-4402-a110-8db07f3749c0 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:41.783393 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c15470-f820-454b-abbf-9220f59efac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:41.784057 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c15470-f820-454b-abbf-9220f59efac3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:41.784349 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c15470-f820-454b-abbf-9220f59efac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:41.784656 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c15470-f820-454b-abbf-9220f59efac3 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:41.785444 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c15470-f820-454b-abbf-9220f59efac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:41.785755 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c15470-f820-454b-abbf-9220f59efac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:41.787152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c15470-f820-454b-abbf-9220f59efac3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:41.790775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98902c-3bae-4043-8ad1-cfa00d902e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:41.791438 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98902c-3bae-4043-8ad1-cfa00d902e81 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:41.791719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98902c-3bae-4043-8ad1-cfa00d902e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:41.791994 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98902c-3bae-4043-8ad1-cfa00d902e81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:41.792858 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98902c-3bae-4043-8ad1-cfa00d902e81 None admin] RBAC: Adding query filter params (role.id=868c7a356c674ded875dd079f5a9f5e0, scope.domain.id=default, user.id=1dacaea933b24b6082a79a2c673ec9f1) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:41.793172 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98902c-3bae-4043-8ad1-cfa00d902e81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:41.794615 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98902c-3bae-4043-8ad1-cfa00d902e81 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:41.801444 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 11/20] 10.222.0.36 () {56 vars in 1322 bytes} [Tue Jul 5 12:40:41 2022] GET /identity/v3/role_assignments?user.id=1dacaea933b24b6082a79a2c673ec9f1&scope.domain.id=default&role.id=868c7a356c674ded875dd079f5a9f5e0 => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:41.805610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 10/21] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:44.082853 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee423a-94f8-42b1-bd5a-3f0b38220be2 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:44.083383 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee423a-94f8-42b1-bd5a-3f0b38220be2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:44.083383 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee423a-94f8-42b1-bd5a-3f0b38220be2 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:44.084819 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 12/22] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:44.099172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886707f8-1516-4952-86fe-47a063dd2253 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:44.099621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886707f8-1516-4952-86fe-47a063dd2253 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:44.099798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886707f8-1516-4952-86fe-47a063dd2253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:44.125573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-886707f8-1516-4952-86fe-47a063dd2253 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:44.126797 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-886707f8-1516-4952-86fe-47a063dd2253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:44.209424 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 11/23] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:40:44.244266 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee423a-94f8-42b1-bd5a-3f0b38220be2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:44.367570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72139782-f9ba-4c3c-baaf-f528ed05d026 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:44.367889 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72139782-f9ba-4c3c-baaf-f528ed05d026 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:44.368068 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72139782-f9ba-4c3c-baaf-f528ed05d026 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:44.369721 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 12/24] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:40:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:44.374627 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed0789-7db8-45f8-9a92-29237786d194 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:44.375134 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed0789-7db8-45f8-9a92-29237786d194 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:44.375602 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed0789-7db8-45f8-9a92-29237786d194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:44.379790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee423a-94f8-42b1-bd5a-3f0b38220be2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:44.409597 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-75ed0789-7db8-45f8-9a92-29237786d194 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:44.411122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-75ed0789-7db8-45f8-9a92-29237786d194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:44.434222 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49570462-29bd-452b-af3a-f9687fb52320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:44.435161 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49570462-29bd-452b-af3a-f9687fb52320 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:44.435446 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49570462-29bd-452b-af3a-f9687fb52320 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:44.435725 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49570462-29bd-452b-af3a-f9687fb52320 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:44.453676 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49570462-29bd-452b-af3a-f9687fb52320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:40:44.462234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-49570462-29bd-452b-af3a-f9687fb52320 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:40:44.462234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:44.462234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:44.462234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:44.462234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:44.462234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:44.462234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:44.462234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:44.462234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:44.462234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:44.462234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:44.462234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:44.462234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:40:44.462234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:40:44.462234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:40:44.462234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:40:44.463073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:40:44.463073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:40:44.463073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:40:44.463073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:40:44.463073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:44.463073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:44.463073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:44.463073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:44.463073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:44.463073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:44.463073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:44.463073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:44.463073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:44.463073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:44.463073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:44.463073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:44.463810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:44.463810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:44.463810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:44.463810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:44.463810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:40:44.463810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:40:44.463810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:40:44.463810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:40:44.463810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:40:44.463810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:40:44.463810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:40:44.463810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:40:44.463810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 13/25] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:40:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:44.465114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43c29a-ae01-474f-8c92-4cfeaa48f068 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:44.465403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43c29a-ae01-474f-8c92-4cfeaa48f068 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:44.465685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43c29a-ae01-474f-8c92-4cfeaa48f068 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:44.472061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 14/26] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:44.473044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c127716-53a1-4be5-9692-3a7b9d887984 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:44.473339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c127716-53a1-4be5-9692-3a7b9d887984 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:44.473624 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c127716-53a1-4be5-9692-3a7b9d887984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:44.488941 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:44.492096 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-4c127716-53a1-4be5-9692-3a7b9d887984 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:44.496608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4c127716-53a1-4be5-9692-3a7b9d887984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:44.518832 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:44.564048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 13/27] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:40:44.565327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed0789-7db8-45f8-9a92-29237786d194 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:44.597421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 15/28] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:40:44.619954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c127716-53a1-4be5-9692-3a7b9d887984 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:44.733899 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed0789-7db8-45f8-9a92-29237786d194 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:44.778126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b771d-5deb-4a66-a7ec-9b32ca5b7776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:44.778831 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b771d-5deb-4a66-a7ec-9b32ca5b7776 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:44.779198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b771d-5deb-4a66-a7ec-9b32ca5b7776 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:44.779538 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b771d-5deb-4a66-a7ec-9b32ca5b7776 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:44.780301 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b771d-5deb-4a66-a7ec-9b32ca5b7776 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:44.780634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b771d-5deb-4a66-a7ec-9b32ca5b7776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:44.782157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b771d-5deb-4a66-a7ec-9b32ca5b7776 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:44.792500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c127716-53a1-4be5-9692-3a7b9d887984 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:44.795369 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 14/29] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:40:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:44.796180 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b771d-5deb-4a66-a7ec-9b32ca5b7776 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:44.830406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422aa7f3-3603-4a4f-8f99-f8d538107af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:44.831530 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422aa7f3-3603-4a4f-8f99-f8d538107af2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:44.832074 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422aa7f3-3603-4a4f-8f99-f8d538107af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:44.832672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422aa7f3-3603-4a4f-8f99-f8d538107af2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:44.842382 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:44.856451 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422aa7f3-3603-4a4f-8f99-f8d538107af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:44.858467 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422aa7f3-3603-4a4f-8f99-f8d538107af2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:44.864803 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:44.904033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-422aa7f3-3603-4a4f-8f99-f8d538107af2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:40:44.904033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:44.904033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:44.904033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:44.904033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:44.904033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:44.904033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:44.904033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:44.904033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:44.904033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:44.904033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:44.904033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:44.904033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:40:44.904033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:40:44.904033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:40:44.904912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:40:44.904912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:44.904912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:44.904912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:44.904912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:44.904912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:44.904912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:44.904912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:44.904912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:44.904912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:44.904912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:44.904912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:44.904912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:44.904912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:44.904912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:44.904912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:44.904912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:44.905715 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:40:44.905715 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:40:44.905715 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:40:44.905715 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:40:44.910301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 16/30] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:40:44.912540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422aa7f3-3603-4a4f-8f99-f8d538107af2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:44.978735 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b771d-5deb-4a66-a7ec-9b32ca5b7776 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:45.023753 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97606ae5-ebd9-46f8-9918-fd283f4c4757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:45.024420 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97606ae5-ebd9-46f8-9918-fd283f4c4757 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:45.024739 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97606ae5-ebd9-46f8-9918-fd283f4c4757 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:45.025021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97606ae5-ebd9-46f8-9918-fd283f4c4757 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:45.025416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422aa7f3-3603-4a4f-8f99-f8d538107af2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:45.025773 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97606ae5-ebd9-46f8-9918-fd283f4c4757 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:45.027438 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97606ae5-ebd9-46f8-9918-fd283f4c4757 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:45.067329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e689711-0717-47b3-8642-cb45577dc076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:45.068316 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e689711-0717-47b3-8642-cb45577dc076 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:45.068641 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e689711-0717-47b3-8642-cb45577dc076 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:45.068982 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e689711-0717-47b3-8642-cb45577dc076 None admin] PATH_INFO: `/v3/users/1dacaea933b24b6082a79a2c673ec9f1` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:45.070359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e689711-0717-47b3-8642-cb45577dc076 None admin] RBAC: Authorizing `identity:get_user(user_id=1dacaea933b24b6082a79a2c673ec9f1)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:45.078492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e689711-0717-47b3-8642-cb45577dc076 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:45.078492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 17/31] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:40:44 2022] GET /identity/v3/users/1dacaea933b24b6082a79a2c673ec9f1 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:45.078492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e689711-0717-47b3-8642-cb45577dc076 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:45.134342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:45.183990 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e689711-0717-47b3-8642-cb45577dc076 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:45.227816 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca227f-4bdd-4632-b3f5-a9e031c6ef2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:45.228499 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca227f-4bdd-4632-b3f5-a9e031c6ef2d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:45.228817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca227f-4bdd-4632-b3f5-a9e031c6ef2d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:45.229102 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca227f-4bdd-4632-b3f5-a9e031c6ef2d None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:45.229852 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca227f-4bdd-4632-b3f5-a9e031c6ef2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:45.230174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca227f-4bdd-4632-b3f5-a9e031c6ef2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:45.231818 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca227f-4bdd-4632-b3f5-a9e031c6ef2d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:45.247346 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 15/32] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Jul 5 12:40:44 2022] POST /identity/v3/roles => generated 225 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:40:45.249710 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a55bc-fa36-43eb-8fd2-cd49353a169a None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:45.250215 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a55bc-fa36-43eb-8fd2-cd49353a169a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:45.250701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a55bc-fa36-43eb-8fd2-cd49353a169a None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:45.256963 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 16/33] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:40:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:45.258782 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a55bc-fa36-43eb-8fd2-cd49353a169a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:45.260330 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 18/34] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:45.262210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5005a-a719-4167-957d-be63a5dfb129 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:45.262510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5005a-a719-4167-957d-be63a5dfb129 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:45.262797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5005a-a719-4167-957d-be63a5dfb129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:45.287569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-dfd5005a-a719-4167-957d-be63a5dfb129 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:45.289151 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-dfd5005a-a719-4167-957d-be63a5dfb129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:45.375510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 19/35] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:40:45.376214 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5005a-a719-4167-957d-be63a5dfb129 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:45.385835 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:45.395299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a55bc-fa36-43eb-8fd2-cd49353a169a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:45.441120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:45.445414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466da7b-afa3-4bef-a4ef-72709632dae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:45.446397 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466da7b-afa3-4bef-a4ef-72709632dae9 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:45.446849 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466da7b-afa3-4bef-a4ef-72709632dae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:45.447268 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466da7b-afa3-4bef-a4ef-72709632dae9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:45.449081 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466da7b-afa3-4bef-a4ef-72709632dae9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:45.450829 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466da7b-afa3-4bef-a4ef-72709632dae9 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:45.452710 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 17/36] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:45.456074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466da7b-afa3-4bef-a4ef-72709632dae9 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:45.495992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5005a-a719-4167-957d-be63a5dfb129 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:45.541336 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdeb9ff-a818-4387-8f6d-973e6a6d349a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:45.542021 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdeb9ff-a818-4387-8f6d-973e6a6d349a None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:45.542310 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdeb9ff-a818-4387-8f6d-973e6a6d349a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:45.542592 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdeb9ff-a818-4387-8f6d-973e6a6d349a None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:45.543316 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdeb9ff-a818-4387-8f6d-973e6a6d349a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:45.544847 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdeb9ff-a818-4387-8f6d-973e6a6d349a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:45.576154 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466da7b-afa3-4bef-a4ef-72709632dae9 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:45.632569 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5071075-d541-42e7-bf97-366c139abbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:45.633976 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5071075-d541-42e7-bf97-366c139abbcc None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:45.634561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5071075-d541-42e7-bf97-366c139abbcc None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:45.635062 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5071075-d541-42e7-bf97-366c139abbcc None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:45.636011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5071075-d541-42e7-bf97-366c139abbcc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:45.637616 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5071075-d541-42e7-bf97-366c139abbcc None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:45.708765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Jul 5 12:40:45 2022] POST /identity/v3/roles => generated 219 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:40:45.710740 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5071075-d541-42e7-bf97-366c139abbcc None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:45.767206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:45.853321 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 20/38] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jul 5 12:40:45 2022] POST /identity/v3/projects => generated 301 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:40:45.854919 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cdd3a-fd42-478d-8823-bb331fea129c None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:45.855145 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5071075-d541-42e7-bf97-366c139abbcc None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:45.855247 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cdd3a-fd42-478d-8823-bb331fea129c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:45.855479 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cdd3a-fd42-478d-8823-bb331fea129c None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:45.856890 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 21/39] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:45.858162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2a693-3d42-474b-a6a8-81944184726d None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:45.858446 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2a693-3d42-474b-a6a8-81944184726d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:45.858725 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2a693-3d42-474b-a6a8-81944184726d None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:45.860113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 22/40] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:45.871533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10229dea-3857-4b4c-90cb-12dc59e1b139 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:45.871533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10229dea-3857-4b4c-90cb-12dc59e1b139 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:45.871533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10229dea-3857-4b4c-90cb-12dc59e1b139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:45.890212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-10229dea-3857-4b4c-90cb-12dc59e1b139 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:45.891826 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-10229dea-3857-4b4c-90cb-12dc59e1b139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:45.906211 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede1aad-27db-4abf-9905-43e89b7f2ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:45.907121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede1aad-27db-4abf-9905-43e89b7f2ac9 None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:45.907409 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede1aad-27db-4abf-9905-43e89b7f2ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:45.907691 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede1aad-27db-4abf-9905-43e89b7f2ac9 None admin] PATH_INFO: `/v3/domains/default/users/1dacaea933b24b6082a79a2c673ec9f1/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:45.910176 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede1aad-27db-4abf-9905-43e89b7f2ac9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1dacaea933b24b6082a79a2c673ec9f1, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:45.911679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede1aad-27db-4abf-9905-43e89b7f2ac9 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:45.975585 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 23/41] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:40:45.977065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f934cb3-2b81-412b-83a2-428ed11c7187 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:45.977373 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f934cb3-2b81-412b-83a2-428ed11c7187 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:45.977661 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f934cb3-2b81-412b-83a2-428ed11c7187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:45.996457 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-2f934cb3-2b81-412b-83a2-428ed11c7187 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:45.997804 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2f934cb3-2b81-412b-83a2-428ed11c7187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:46.009683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 19/42] 10.222.0.36 () {58 vars in 1361 bytes} [Tue Jul 5 12:40:45 2022] PUT /identity/v3/domains/default/users/1dacaea933b24b6082a79a2c673ec9f1/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:40:46.013737 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede1aad-27db-4abf-9905-43e89b7f2ac9 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:46.026303 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:46.095965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 24/43] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:40:46.123216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f934cb3-2b81-412b-83a2-428ed11c7187 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:46.142367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:46.160044 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede1aad-27db-4abf-9905-43e89b7f2ac9 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:46.202303 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e79caa-fd7c-4578-8ae8-cd5047acf40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:46.203539 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e79caa-fd7c-4578-8ae8-cd5047acf40e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:46.203838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e79caa-fd7c-4578-8ae8-cd5047acf40e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:46.204681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e79caa-fd7c-4578-8ae8-cd5047acf40e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:46.206050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e79caa-fd7c-4578-8ae8-cd5047acf40e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:46.207670 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e79caa-fd7c-4578-8ae8-cd5047acf40e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:46.209508 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 20/44] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:46.215265 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e79caa-fd7c-4578-8ae8-cd5047acf40e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:46.240034 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f934cb3-2b81-412b-83a2-428ed11c7187 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:46.276164 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a4410-1931-4fc2-95d6-e69cf3be1152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:46.276865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a4410-1931-4fc2-95d6-e69cf3be1152 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:46.277150 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a4410-1931-4fc2-95d6-e69cf3be1152 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:46.277425 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a4410-1931-4fc2-95d6-e69cf3be1152 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:46.278170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a4410-1931-4fc2-95d6-e69cf3be1152 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:46.279697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a4410-1931-4fc2-95d6-e69cf3be1152 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:46.317796 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e79caa-fd7c-4578-8ae8-cd5047acf40e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:46.346709 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 25/45] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Jul 5 12:40:46 2022] POST /identity/v3/roles => generated 223 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:40:46.354382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759229e-ea60-4d38-8553-5d7b4f7f3a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:46.355068 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759229e-ea60-4d38-8553-5d7b4f7f3a40 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:46.355355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759229e-ea60-4d38-8553-5d7b4f7f3a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:46.355635 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759229e-ea60-4d38-8553-5d7b4f7f3a40 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:46.356372 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759229e-ea60-4d38-8553-5d7b4f7f3a40 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:46.357954 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759229e-ea60-4d38-8553-5d7b4f7f3a40 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:46.428034 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 21/46] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jul 5 12:40:46 2022] POST /identity/v3/projects => generated 312 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:40:48.048864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a82cac-5407-4640-96d4-7a050f858778 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:48.049378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a82cac-5407-4640-96d4-7a050f858778 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:48.049481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a82cac-5407-4640-96d4-7a050f858778 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:48.050805 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 26/47] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:48.056113 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dcdef-0bbc-44e9-8489-e855599d2600 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:48.056508 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dcdef-0bbc-44e9-8489-e855599d2600 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:48.056711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dcdef-0bbc-44e9-8489-e855599d2600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:48.068401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:48.074119 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-907dcdef-0bbc-44e9-8489-e855599d2600 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:48.075629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-907dcdef-0bbc-44e9-8489-e855599d2600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:48.141670 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 22/48] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:40:48.165247 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a82cac-5407-4640-96d4-7a050f858778 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:48.183512 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:48.266251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a82cac-5407-4640-96d4-7a050f858778 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:48.298625 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13c9d9-7f9f-4c8f-a4ac-d0b02e915c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:48.299470 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13c9d9-7f9f-4c8f-a4ac-d0b02e915c90 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:48.299700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13c9d9-7f9f-4c8f-a4ac-d0b02e915c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:48.299977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13c9d9-7f9f-4c8f-a4ac-d0b02e915c90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:48.309924 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13c9d9-7f9f-4c8f-a4ac-d0b02e915c90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:40:48.317433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-6a13c9d9-7f9f-4c8f-a4ac-d0b02e915c90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:40:48.317433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:48.317433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:48.317433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:48.317433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:48.317433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:48.317433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:48.317433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:48.317433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:48.317433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:48.317433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:48.317433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:48.317433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:40:48.317433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:40:48.317433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:40:48.317433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:40:48.318416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:40:48.318416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:40:48.318416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:40:48.318416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:40:48.318416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:48.318416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:48.318416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:48.318416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:48.318416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:48.318416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:48.318416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:48.318416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:48.318416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:48.318416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:48.318416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:48.318416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:48.319339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:48.319339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:48.319339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:48.319339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:48.319339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:40:48.319339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:40:48.319339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:40:48.319339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:40:48.319339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:40:48.319339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:40:48.319339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:40:48.319339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:40:48.319339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 27/49] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:40:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:48.326596 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dcdef-0bbc-44e9-8489-e855599d2600 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:48.424469 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dcdef-0bbc-44e9-8489-e855599d2600 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:48.456316 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f574d-48c8-4434-81df-e8597eee4449 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:48.456632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f574d-48c8-4434-81df-e8597eee4449 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:48.456919 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f574d-48c8-4434-81df-e8597eee4449 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:48.457719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c8ddf-c7bf-4f10-a279-46c1329394d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:48.458304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 28/50] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:48.458392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c8ddf-c7bf-4f10-a279-46c1329394d4 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:48.458658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c8ddf-c7bf-4f10-a279-46c1329394d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:48.458939 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c8ddf-c7bf-4f10-a279-46c1329394d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:48.459691 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c8ddf-c7bf-4f10-a279-46c1329394d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:48.459998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c8ddf-c7bf-4f10-a279-46c1329394d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:48.461483 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c8ddf-c7bf-4f10-a279-46c1329394d4 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:48.463089 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6623dd4-c403-4cea-8757-5d442a41d4c1 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:48.463444 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6623dd4-c403-4cea-8757-5d442a41d4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:48.463790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6623dd4-c403-4cea-8757-5d442a41d4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:48.463924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:48.470869 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 23/51] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:40:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:48.477223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c8ddf-c7bf-4f10-a279-46c1329394d4 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:48.481019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-d6623dd4-c403-4cea-8757-5d442a41d4c1 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:48.482230 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d6623dd4-c403-4cea-8757-5d442a41d4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:48.547626 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 29/52] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:40:48.570835 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6623dd4-c403-4cea-8757-5d442a41d4c1 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:48.578152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c8ddf-c7bf-4f10-a279-46c1329394d4 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:48.578637 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:48.611450 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5860f7-3796-486f-8abe-32c85cfa8492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:48.612436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5860f7-3796-486f-8abe-32c85cfa8492 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:48.612757 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5860f7-3796-486f-8abe-32c85cfa8492 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:48.613045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5860f7-3796-486f-8abe-32c85cfa8492 None admin] PATH_INFO: `/v3/users/1dacaea933b24b6082a79a2c673ec9f1` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:48.614326 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5860f7-3796-486f-8abe-32c85cfa8492 None admin] RBAC: Authorizing `identity:get_user(user_id=1dacaea933b24b6082a79a2c673ec9f1)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:48.615783 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5860f7-3796-486f-8abe-32c85cfa8492 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:48.617516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 24/53] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:40:48 2022] GET /identity/v3/users/1dacaea933b24b6082a79a2c673ec9f1 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:48.622908 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5860f7-3796-486f-8abe-32c85cfa8492 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:48.671293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6623dd4-c403-4cea-8757-5d442a41d4c1 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:48.706991 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f3302-b1d7-4d78-8d70-d3c446070cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:48.707807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f3302-b1d7-4d78-8d70-d3c446070cdd None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:48.708089 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f3302-b1d7-4d78-8d70-d3c446070cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:48.708364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f3302-b1d7-4d78-8d70-d3c446070cdd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:48.709763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f3302-b1d7-4d78-8d70-d3c446070cdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:48.711852 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f3302-b1d7-4d78-8d70-d3c446070cdd None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:48.713768 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 30/54] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:48.719338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f3302-b1d7-4d78-8d70-d3c446070cdd None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:48.796393 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:48.799469 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:48.823939 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f3302-b1d7-4d78-8d70-d3c446070cdd None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:48.830757 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5860f7-3796-486f-8abe-32c85cfa8492 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:48.859009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97a4f5-0361-4eb5-93e3-7b621cce6908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:48.859708 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97a4f5-0361-4eb5-93e3-7b621cce6908 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:48.859995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97a4f5-0361-4eb5-93e3-7b621cce6908 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:48.860276 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97a4f5-0361-4eb5-93e3-7b621cce6908 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:48.861028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97a4f5-0361-4eb5-93e3-7b621cce6908 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:48.862504 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97a4f5-0361-4eb5-93e3-7b621cce6908 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:48.865094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7be69-7cbf-4b5b-95b4-f5576d2d5a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:48.865893 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7be69-7cbf-4b5b-95b4-f5576d2d5a14 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:48.866191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7be69-7cbf-4b5b-95b4-f5576d2d5a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:48.867244 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7be69-7cbf-4b5b-95b4-f5576d2d5a14 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:48.868211 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7be69-7cbf-4b5b-95b4-f5576d2d5a14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:48.869700 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7be69-7cbf-4b5b-95b4-f5576d2d5a14 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:48.871338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 25/55] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:48.877150 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7be69-7cbf-4b5b-95b4-f5576d2d5a14 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:48.953823 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 31/56] 10.222.0.36 () {60 vars in 1140 bytes} [Tue Jul 5 12:40:48 2022] POST /identity/v3/projects => generated 298 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:40:48.978843 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7be69-7cbf-4b5b-95b4-f5576d2d5a14 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:49.015348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a1824-7425-4577-ae8d-436d5bf6b107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:49.016025 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a1824-7425-4577-ae8d-436d5bf6b107 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:49.016318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a1824-7425-4577-ae8d-436d5bf6b107 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:49.016639 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a1824-7425-4577-ae8d-436d5bf6b107 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:49.017512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a1824-7425-4577-ae8d-436d5bf6b107 None admin] RBAC: Adding query filter params (role.id=868c7a356c674ded875dd079f5a9f5e0, scope.domain.id=default, user.id=1dacaea933b24b6082a79a2c673ec9f1) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:49.017836 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a1824-7425-4577-ae8d-436d5bf6b107 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:49.019347 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a1824-7425-4577-ae8d-436d5bf6b107 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:49.021892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:49.029779 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 26/57] 10.222.0.36 () {56 vars in 1322 bytes} [Tue Jul 5 12:40:48 2022] GET /identity/v3/role_assignments?user.id=1dacaea933b24b6082a79a2c673ec9f1&scope.domain.id=default&role.id=868c7a356c674ded875dd079f5a9f5e0 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:50.983468 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb122af0-ead3-4410-9671-2b093904fd90 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:50.983985 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb122af0-ead3-4410-9671-2b093904fd90 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:50.984068 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb122af0-ead3-4410-9671-2b093904fd90 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:50.985432 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 32/58] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:50.990390 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d1ce7-c482-42c1-ba38-cfb2ee6d80dc None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:50.990772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d1ce7-c482-42c1-ba38-cfb2ee6d80dc None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:50.990960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d1ce7-c482-42c1-ba38-cfb2ee6d80dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:51.008247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-822d1ce7-c482-42c1-ba38-cfb2ee6d80dc None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:51.009476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-822d1ce7-c482-42c1-ba38-cfb2ee6d80dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:51.076466 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 27/59] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:40:51.100341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb122af0-ead3-4410-9671-2b093904fd90 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:51.199098 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb122af0-ead3-4410-9671-2b093904fd90 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:51.223280 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:51.231669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ffac0-3c65-40ec-a5d0-508b7c87abb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:51.241828 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ffac0-3c65-40ec-a5d0-508b7c87abb9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:51.241828 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ffac0-3c65-40ec-a5d0-508b7c87abb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:51.241828 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ffac0-3c65-40ec-a5d0-508b7c87abb9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:51.241828 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ffac0-3c65-40ec-a5d0-508b7c87abb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:51.241828 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ffac0-3c65-40ec-a5d0-508b7c87abb9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:51.241828 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 33/60] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:51.243316 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d1ce7-c482-42c1-ba38-cfb2ee6d80dc None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:51.338679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d1ce7-c482-42c1-ba38-cfb2ee6d80dc None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:51.364182 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:51.372060 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982852f-8cd2-44a3-bd72-b149a65c2cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:51.372756 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982852f-8cd2-44a3-bd72-b149a65c2cd3 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:51.373044 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982852f-8cd2-44a3-bd72-b149a65c2cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:51.373354 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982852f-8cd2-44a3-bd72-b149a65c2cd3 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:51.374203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982852f-8cd2-44a3-bd72-b149a65c2cd3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:51.375661 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982852f-8cd2-44a3-bd72-b149a65c2cd3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:51.471292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 28/61] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jul 5 12:40:51 2022] POST /identity/v3/users => generated 275 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:40:54.617739 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a467830-1de5-445a-8224-d55829bdaa2e None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:54.618629 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a467830-1de5-445a-8224-d55829bdaa2e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:54.619084 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a467830-1de5-445a-8224-d55829bdaa2e None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:54.620933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 34/62] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:40:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:54.626037 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40f39-74b7-4282-a30c-fe01adc620fc None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:54.626830 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40f39-74b7-4282-a30c-fe01adc620fc None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:54.627260 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40f39-74b7-4282-a30c-fe01adc620fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:54.653595 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ddc40f39-74b7-4282-a30c-fe01adc620fc None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:54.655082 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ddc40f39-74b7-4282-a30c-fe01adc620fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:54.750889 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 29/63] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:40:54.792726 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a467830-1de5-445a-8224-d55829bdaa2e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:54.816189 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13d4bd-c50b-465a-8e96-9994c6a3bde3 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:54.816563 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13d4bd-c50b-465a-8e96-9994c6a3bde3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:54.816946 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13d4bd-c50b-465a-8e96-9994c6a3bde3 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:54.819886 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 30/64] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:40:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:54.826005 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc439f-cfc5-4d9e-8671-b8a1483e3c25 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:54.826294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc439f-cfc5-4d9e-8671-b8a1483e3c25 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:54.826579 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc439f-cfc5-4d9e-8671-b8a1483e3c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:54.851389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c9cc439f-cfc5-4d9e-8671-b8a1483e3c25 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:54.852627 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c9cc439f-cfc5-4d9e-8671-b8a1483e3c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:54.971008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 31/65] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:40:54.972259 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a467830-1de5-445a-8224-d55829bdaa2e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:54.996856 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc439f-cfc5-4d9e-8671-b8a1483e3c25 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:55.022524 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e9fa1-77fb-4a8d-b85c-a2a106190eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:55.023334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e9fa1-77fb-4a8d-b85c-a2a106190eda None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:55.023622 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e9fa1-77fb-4a8d-b85c-a2a106190eda None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:55.023900 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e9fa1-77fb-4a8d-b85c-a2a106190eda None admin] PATH_INFO: `/v3/roles/member` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:55.034451 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e9fa1-77fb-4a8d-b85c-a2a106190eda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:40:55.042697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-777e9fa1-77fb-4a8d-b85c-a2a106190eda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:40:55.042697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:55.042697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:55.042697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:55.042697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:55.042697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:55.042697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:55.042697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:55.042697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:55.042697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:55.042697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:55.042697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:55.042697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:40:55.042697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:40:55.042697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:40:55.042697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:40:55.043562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:40:55.043562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:40:55.043562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:40:55.043562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:40:55.043562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:55.043562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:55.043562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:55.043562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:55.043562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:55.043562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:55.043562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:55.043562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:55.043562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:55.043562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:55.043562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:55.043562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:55.044834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:55.044834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:55.044834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:55.044834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:55.044834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:40:55.044834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:40:55.044834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:40:55.044834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:40:55.044834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:40:55.044834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:40:55.044834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:40:55.044834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:40:55.044834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 35/66] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:40:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:55.045721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf818f-532a-407e-b1b0-326f95406b68 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:55.045721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf818f-532a-407e-b1b0-326f95406b68 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:55.045721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf818f-532a-407e-b1b0-326f95406b68 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:55.047166 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 36/67] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:55.050462 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba13168-484b-4649-ad75-c3bd00dcc919 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:55.050462 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba13168-484b-4649-ad75-c3bd00dcc919 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:55.050462 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba13168-484b-4649-ad75-c3bd00dcc919 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:55.051274 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 37/68] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:40:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:55.053335 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba13168-484b-4649-ad75-c3bd00dcc919 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:55.060083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:55.123718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:55.127889 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc439f-cfc5-4d9e-8671-b8a1483e3c25 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:55.165856 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a01ba-109f-4725-9615-980ef8fca9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:55.166656 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a01ba-109f-4725-9615-980ef8fca9cb None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:55.166947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a01ba-109f-4725-9615-980ef8fca9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:55.167230 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a01ba-109f-4725-9615-980ef8fca9cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:55.172569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba13168-484b-4649-ad75-c3bd00dcc919 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:55.179369 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a01ba-109f-4725-9615-980ef8fca9cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:40:55.188318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-ae2a01ba-109f-4725-9615-980ef8fca9cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:40:55.188318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:55.188318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:55.188318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:55.188318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:55.188318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:55.188318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:55.188318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:55.188318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:55.188318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:55.188318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:55.188318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:55.188318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:40:55.188318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:40:55.188318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:40:55.188318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:40:55.189237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:40:55.189237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:40:55.189237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:40:55.189237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:40:55.189237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:55.189237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:55.189237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:55.189237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:55.189237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:55.189237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:55.189237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:55.189237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:55.189237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:55.189237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:55.189237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:55.189237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:55.190055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:55.190055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:55.190055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:55.190055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:55.190055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:40:55.190055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:40:55.190055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:40:55.190055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:40:55.190055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:40:55.190055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:40:55.190055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:40:55.190055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:40:55.190055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 32/69] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:40:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:40:55.191317 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e964c-75e8-4b3a-9eb4-fe60f1d449fa None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:55.191317 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e964c-75e8-4b3a-9eb4-fe60f1d449fa None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:55.191317 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e964c-75e8-4b3a-9eb4-fe60f1d449fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:55.211324 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ca6e964c-75e8-4b3a-9eb4-fe60f1d449fa None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:55.212703 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ca6e964c-75e8-4b3a-9eb4-fe60f1d449fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:55.213558 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc9696-adc2-4323-bebc-d48523a8be43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:55.214241 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc9696-adc2-4323-bebc-d48523a8be43 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:55.214613 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc9696-adc2-4323-bebc-d48523a8be43 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:55.214808 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc9696-adc2-4323-bebc-d48523a8be43 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:55.215558 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc9696-adc2-4323-bebc-d48523a8be43 None admin] RBAC: Adding query filter params (name=member) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:55.216410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc9696-adc2-4323-bebc-d48523a8be43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:55.217279 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc9696-adc2-4323-bebc-d48523a8be43 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:55.231010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 38/70] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:40:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:55.231010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670f40a-523e-46c6-bb9c-7c4187d0b68f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:55.231010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670f40a-523e-46c6-bb9c-7c4187d0b68f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:55.231010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670f40a-523e-46c6-bb9c-7c4187d0b68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:55.246679 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-1670f40a-523e-46c6-bb9c-7c4187d0b68f None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:55.247909 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1670f40a-523e-46c6-bb9c-7c4187d0b68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:55.285130 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 33/71] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:40:55.285994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e964c-75e8-4b3a-9eb4-fe60f1d449fa None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:55.320106 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:55.320516 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 39/72] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:40:55.325497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670f40a-523e-46c6-bb9c-7c4187d0b68f None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:55.373438 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:55.387727 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e964c-75e8-4b3a-9eb4-fe60f1d449fa None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:55.421553 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d058184-fc5b-4ee7-b9ab-c87cb2265005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:55.422235 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d058184-fc5b-4ee7-b9ab-c87cb2265005 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:55.422522 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d058184-fc5b-4ee7-b9ab-c87cb2265005 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:55.422803 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d058184-fc5b-4ee7-b9ab-c87cb2265005 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:55.423574 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d058184-fc5b-4ee7-b9ab-c87cb2265005 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:55.423883 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d058184-fc5b-4ee7-b9ab-c87cb2265005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:55.425339 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d058184-fc5b-4ee7-b9ab-c87cb2265005 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:55.428324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670f40a-523e-46c6-bb9c-7c4187d0b68f None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:55.435318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 34/73] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:40:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:55.436630 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4e5cf-f5b0-4335-adf6-710db3bbf162 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:55.436931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4e5cf-f5b0-4335-adf6-710db3bbf162 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:55.437223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4e5cf-f5b0-4335-adf6-710db3bbf162 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:55.438457 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 35/74] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:55.439164 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4e5cf-f5b0-4335-adf6-710db3bbf162 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:55.467362 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd7c50-107f-419b-bbd1-3a543770be3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:55.468239 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd7c50-107f-419b-bbd1-3a543770be3d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:55.468521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd7c50-107f-419b-bbd1-3a543770be3d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:55.468825 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd7c50-107f-419b-bbd1-3a543770be3d None admin] PATH_INFO: `/v3/users/52ebb4f8be97463abd2bc87a56c1e3ca` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:55.482792 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd7c50-107f-419b-bbd1-3a543770be3d None admin] RBAC: Authorizing `identity:get_user(user_id=52ebb4f8be97463abd2bc87a56c1e3ca)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:55.484190 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd7c50-107f-419b-bbd1-3a543770be3d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:55.485868 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 40/75] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:40:55 2022] GET /identity/v3/users/52ebb4f8be97463abd2bc87a56c1e3ca => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:55.486637 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd7c50-107f-419b-bbd1-3a543770be3d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:55.534828 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:55.541398 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4e5cf-f5b0-4335-adf6-710db3bbf162 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:55.575371 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4bdaa-13bd-4cd0-8dac-1acf56dc0e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:55.576174 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4bdaa-13bd-4cd0-8dac-1acf56dc0e9f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:55.576467 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4bdaa-13bd-4cd0-8dac-1acf56dc0e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:55.576787 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4bdaa-13bd-4cd0-8dac-1acf56dc0e9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:55.577969 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4bdaa-13bd-4cd0-8dac-1acf56dc0e9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:55.579464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4bdaa-13bd-4cd0-8dac-1acf56dc0e9f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:55.581127 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 36/76] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:55.581900 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4bdaa-13bd-4cd0-8dac-1acf56dc0e9f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:55.588211 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd7c50-107f-419b-bbd1-3a543770be3d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:55.590587 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:55.622462 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b220e-5cdd-4dfe-899e-440279d8eb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:55.623276 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b220e-5cdd-4dfe-899e-440279d8eb67 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:55.623973 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b220e-5cdd-4dfe-899e-440279d8eb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:55.624260 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b220e-5cdd-4dfe-899e-440279d8eb67 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:55.635347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b220e-5cdd-4dfe-899e-440279d8eb67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:40:55.643387 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-a23b220e-5cdd-4dfe-899e-440279d8eb67 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:40:55.643387 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:55.643387 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:55.643387 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:55.643387 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:55.643387 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:55.643387 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:55.643387 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:55.643387 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:55.643387 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:55.643387 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:55.643387 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:55.643387 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:40:55.643387 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:40:55.643387 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:40:55.643387 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:40:55.644301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:40:55.644301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:40:55.644301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:40:55.644301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:40:55.644301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:55.644301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:55.644301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:55.644301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:55.644301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:55.644301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:55.644301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:55.644301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:55.644301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:55.644301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:55.644301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:55.644301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:55.645309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:55.645309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:55.645309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:55.645309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:55.645309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:40:55.645309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:40:55.645309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:40:55.645309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:40:55.645309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:40:55.645309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:40:55.645309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:40:55.645309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:40:55.645309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 41/77] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jul 5 12:40:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:55.645924 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85469ae7-be16-4ca2-8630-0b390b0ba79a None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:55.646114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85469ae7-be16-4ca2-8630-0b390b0ba79a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:55.646382 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85469ae7-be16-4ca2-8630-0b390b0ba79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:55.664110 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-85469ae7-be16-4ca2-8630-0b390b0ba79a None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:55.665383 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-85469ae7-be16-4ca2-8630-0b390b0ba79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:55.686047 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4bdaa-13bd-4cd0-8dac-1acf56dc0e9f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:55.719693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66393e-584f-4530-9af8-484018bb09d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:55.720612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66393e-584f-4530-9af8-484018bb09d5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:55.720928 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66393e-584f-4530-9af8-484018bb09d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:55.721205 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66393e-584f-4530-9af8-484018bb09d5 None admin] PATH_INFO: `/v3/users/1dacaea933b24b6082a79a2c673ec9f1` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:55.722417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66393e-584f-4530-9af8-484018bb09d5 None admin] RBAC: Authorizing `identity:get_user(user_id=1dacaea933b24b6082a79a2c673ec9f1)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:55.723883 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66393e-584f-4530-9af8-484018bb09d5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:55.726039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 37/78] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:40:55 2022] GET /identity/v3/users/1dacaea933b24b6082a79a2c673ec9f1 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:55.726657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66393e-584f-4530-9af8-484018bb09d5 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:55.735775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 42/79] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:40:55.736407 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85469ae7-be16-4ca2-8630-0b390b0ba79a None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:55.764298 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:55.828401 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:55.831934 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66393e-584f-4530-9af8-484018bb09d5 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:55.835021 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85469ae7-be16-4ca2-8630-0b390b0ba79a None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:55.865548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc907f-5b9f-4ecc-92a7-5648071a3383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:55.866234 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc907f-5b9f-4ecc-92a7-5648071a3383 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:55.866524 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc907f-5b9f-4ecc-92a7-5648071a3383 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:55.866807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc907f-5b9f-4ecc-92a7-5648071a3383 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:55.868858 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeab110-38fc-4084-b347-fcda7bfc7a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:55.869537 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeab110-38fc-4084-b347-fcda7bfc7a57 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:55.869825 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeab110-38fc-4084-b347-fcda7bfc7a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:55.870105 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeab110-38fc-4084-b347-fcda7bfc7a57 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:55.870826 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeab110-38fc-4084-b347-fcda7bfc7a57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:55.872274 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeab110-38fc-4084-b347-fcda7bfc7a57 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:55.933740 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc907f-5b9f-4ecc-92a7-5648071a3383 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:55.934168 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 43/80] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jul 5 12:40:55 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:40:55.935019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeab110-38fc-4084-b347-fcda7bfc7a57 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:55.935349 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc907f-5b9f-4ecc-92a7-5648071a3383 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:55.977819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:56.048297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeab110-38fc-4084-b347-fcda7bfc7a57 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:56.070313 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 38/81] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:40:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:40:56.071220 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc907f-5b9f-4ecc-92a7-5648071a3383 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:56.089766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a7523-4b73-4543-8519-05592bbe0efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:56.090460 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a7523-4b73-4543-8519-05592bbe0efd None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:56.091450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a7523-4b73-4543-8519-05592bbe0efd None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:56.091450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a7523-4b73-4543-8519-05592bbe0efd None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:56.091788 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a7523-4b73-4543-8519-05592bbe0efd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:56.092102 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a7523-4b73-4543-8519-05592bbe0efd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:56.093562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a7523-4b73-4543-8519-05592bbe0efd None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:56.104756 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 44/82] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:40:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:56.106043 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a7523-4b73-4543-8519-05592bbe0efd None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:56.123604 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:56.182377 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc907f-5b9f-4ecc-92a7-5648071a3383 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:56.223207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:56.225067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a7523-4b73-4543-8519-05592bbe0efd None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:56.229274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba70c8-526b-48c2-a653-f0c940686195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:56.229933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba70c8-526b-48c2-a653-f0c940686195 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:56.230222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba70c8-526b-48c2-a653-f0c940686195 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:56.230503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba70c8-526b-48c2-a653-f0c940686195 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:56.276058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15d330-fbdc-49a7-adf2-766c932847ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:56.277158 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15d330-fbdc-49a7-adf2-766c932847ae None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:56.277590 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15d330-fbdc-49a7-adf2-766c932847ae None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:56.278009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15d330-fbdc-49a7-adf2-766c932847ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:56.291452 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15d330-fbdc-49a7-adf2-766c932847ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:40:56.299802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-1b15d330-fbdc-49a7-adf2-766c932847ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:40:56.299802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:56.299802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:56.299802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:56.299802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:56.299802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:56.299802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:56.299802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:56.299802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:56.299802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:56.299802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:56.299802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:56.299802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:40:56.299802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:40:56.299802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:40:56.299802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:40:56.300695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:40:56.300695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:40:56.300695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:40:56.300695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:40:56.300695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:56.300695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:56.300695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:56.300695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:56.300695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:56.300695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:56.300695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:56.300695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:56.300695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:56.300695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:56.300695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:56.300695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:56.301456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:56.301456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:56.301456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:56.301456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:56.301456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:40:56.301456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:40:56.301456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:40:56.301456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:40:56.301456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:40:56.301456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:40:56.301456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:40:56.301456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:40:56.303630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 45/83] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:40:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:56.304665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15d330-fbdc-49a7-adf2-766c932847ae None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:56.316050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba70c8-526b-48c2-a653-f0c940686195 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:56.317579 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba70c8-526b-48c2-a653-f0c940686195 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:56.380959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:56.413451 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15d330-fbdc-49a7-adf2-766c932847ae None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:56.421895 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 39/84] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:40:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:40:56.427221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba70c8-526b-48c2-a653-f0c940686195 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:56.450823 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df74af5-dc07-477d-ae4a-a0b5990f1f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:56.452285 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df74af5-dc07-477d-ae4a-a0b5990f1f32 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:56.452965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df74af5-dc07-477d-ae4a-a0b5990f1f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:56.453636 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df74af5-dc07-477d-ae4a-a0b5990f1f32 None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:56.455100 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df74af5-dc07-477d-ae4a-a0b5990f1f32 None admin] RBAC: Authorizing `identity:get_project(project_id=3643e64d3f194dc5bef838b26b6bb808)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:56.456749 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df74af5-dc07-477d-ae4a-a0b5990f1f32 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:56.459150 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 46/85] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:40:56 2022] GET /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:56.460622 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df74af5-dc07-477d-ae4a-a0b5990f1f32 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:56.463026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:56.541974 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba70c8-526b-48c2-a653-f0c940686195 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:56.568874 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df74af5-dc07-477d-ae4a-a0b5990f1f32 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:56.582416 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb25c6d-35c5-4341-8358-bbabf9568ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:56.583718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb25c6d-35c5-4341-8358-bbabf9568ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:56.584520 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb25c6d-35c5-4341-8358-bbabf9568ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:56.585663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb25c6d-35c5-4341-8358-bbabf9568ba8 None admin] PATH_INFO: `/v3/users/52ebb4f8be97463abd2bc87a56c1e3ca` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:56.587451 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb25c6d-35c5-4341-8358-bbabf9568ba8 None admin] RBAC: Authorizing `identity:get_user(user_id=52ebb4f8be97463abd2bc87a56c1e3ca)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:56.589457 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb25c6d-35c5-4341-8358-bbabf9568ba8 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:56.591808 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 40/86] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:40:56 2022] GET /identity/v3/users/52ebb4f8be97463abd2bc87a56c1e3ca => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:56.593302 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb25c6d-35c5-4341-8358-bbabf9568ba8 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:56.614892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25e432-871c-4879-9697-82d533eba22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:56.615647 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25e432-871c-4879-9697-82d533eba22a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:56.615941 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25e432-871c-4879-9697-82d533eba22a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:56.616269 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25e432-871c-4879-9697-82d533eba22a None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:56.617139 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25e432-871c-4879-9697-82d533eba22a None admin] RBAC: Adding query filter params (name=member) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:56.617454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25e432-871c-4879-9697-82d533eba22a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:56.619492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25e432-871c-4879-9697-82d533eba22a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:56.631535 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 47/87] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:40:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:56.637031 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25e432-871c-4879-9697-82d533eba22a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:56.638824 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:56.719060 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:56.723318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb25c6d-35c5-4341-8358-bbabf9568ba8 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:56.770945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90777f4a-7f0d-4731-acc4-8633f98d3e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:56.771840 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90777f4a-7f0d-4731-acc4-8633f98d3e24 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:56.772125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90777f4a-7f0d-4731-acc4-8633f98d3e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:56.772471 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90777f4a-7f0d-4731-acc4-8633f98d3e24 None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:56.775411 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90777f4a-7f0d-4731-acc4-8633f98d3e24 None admin] RBAC: Authorizing `identity:get_project(project_id=3643e64d3f194dc5bef838b26b6bb808)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:56.776907 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90777f4a-7f0d-4731-acc4-8633f98d3e24 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:56.778901 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 41/88] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:40:56 2022] GET /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:56.780634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90777f4a-7f0d-4731-acc4-8633f98d3e24 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:56.784861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25e432-871c-4879-9697-82d533eba22a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:56.835384 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f8d29-da41-4fcd-b23f-5bbc9c0cbce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:56.836863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f8d29-da41-4fcd-b23f-5bbc9c0cbce0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:56.837378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f8d29-da41-4fcd-b23f-5bbc9c0cbce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:56.838193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f8d29-da41-4fcd-b23f-5bbc9c0cbce0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:56.839650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f8d29-da41-4fcd-b23f-5bbc9c0cbce0 None admin] RBAC: Adding query filter params (role.id=66d9c5a190d544b3b3588bbdadf2cf39, scope.project.id=3643e64d3f194dc5bef838b26b6bb808, user.id=52ebb4f8be97463abd2bc87a56c1e3ca) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:56.840348 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f8d29-da41-4fcd-b23f-5bbc9c0cbce0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:56.842801 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f8d29-da41-4fcd-b23f-5bbc9c0cbce0 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:56.851721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 48/89] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:40:56 2022] GET /identity/v3/role_assignments?user.id=52ebb4f8be97463abd2bc87a56c1e3ca&scope.project.id=3643e64d3f194dc5bef838b26b6bb808&role.id=66d9c5a190d544b3b3588bbdadf2cf39 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:56.853161 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f8d29-da41-4fcd-b23f-5bbc9c0cbce0 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:56.954847 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:56.980042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90777f4a-7f0d-4731-acc4-8633f98d3e24 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:57.029913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f8d29-da41-4fcd-b23f-5bbc9c0cbce0 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:57.056042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11aa5d-bf1a-462c-9a0c-46bd922bbeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:57.057283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11aa5d-bf1a-462c-9a0c-46bd922bbeb4 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:57.057780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11aa5d-bf1a-462c-9a0c-46bd922bbeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:57.058257 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11aa5d-bf1a-462c-9a0c-46bd922bbeb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:57.077935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240328d8-ae21-4f08-b5ed-4373cc4652f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:57.078879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240328d8-ae21-4f08-b5ed-4373cc4652f6 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:57.079114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240328d8-ae21-4f08-b5ed-4373cc4652f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:57.079388 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240328d8-ae21-4f08-b5ed-4373cc4652f6 None admin] PATH_INFO: `/v3/users/52ebb4f8be97463abd2bc87a56c1e3ca` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:57.080623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240328d8-ae21-4f08-b5ed-4373cc4652f6 None admin] RBAC: Authorizing `identity:get_user(user_id=52ebb4f8be97463abd2bc87a56c1e3ca)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:57.082127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240328d8-ae21-4f08-b5ed-4373cc4652f6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:57.083757 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 49/90] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:40:56 2022] GET /identity/v3/users/52ebb4f8be97463abd2bc87a56c1e3ca => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:57.084532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240328d8-ae21-4f08-b5ed-4373cc4652f6 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:57.105625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:57.143340 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11aa5d-bf1a-462c-9a0c-46bd922bbeb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:57.145630 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11aa5d-bf1a-462c-9a0c-46bd922bbeb4 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:57.219502 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240328d8-ae21-4f08-b5ed-4373cc4652f6 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:57.274972 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646ed9f-608c-4c80-90d9-daeebe9dd2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:57.275654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646ed9f-608c-4c80-90d9-daeebe9dd2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:57.275943 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646ed9f-608c-4c80-90d9-daeebe9dd2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:57.276229 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646ed9f-608c-4c80-90d9-daeebe9dd2f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:57.277097 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646ed9f-608c-4c80-90d9-daeebe9dd2f8 None admin] RBAC: Adding query filter params (role.id=868c7a356c674ded875dd079f5a9f5e0, scope.project.id=3643e64d3f194dc5bef838b26b6bb808, user.id=1dacaea933b24b6082a79a2c673ec9f1) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:57.277413 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646ed9f-608c-4c80-90d9-daeebe9dd2f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:57.278882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646ed9f-608c-4c80-90d9-daeebe9dd2f8 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:57.289592 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:57.294145 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 50/91] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:40:57 2022] GET /identity/v3/role_assignments?user.id=1dacaea933b24b6082a79a2c673ec9f1&scope.project.id=3643e64d3f194dc5bef838b26b6bb808&role.id=868c7a356c674ded875dd079f5a9f5e0 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:57.294773 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646ed9f-608c-4c80-90d9-daeebe9dd2f8 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:57.360614 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 42/92] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:40:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:40:57.369987 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11aa5d-bf1a-462c-9a0c-46bd922bbeb4 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:57.503255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:57.541523 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11aa5d-bf1a-462c-9a0c-46bd922bbeb4 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:57.562548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646ed9f-608c-4c80-90d9-daeebe9dd2f8 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:57.583525 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162209a-23fa-4e39-8bb4-d73bf0ff3e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:57.584741 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162209a-23fa-4e39-8bb4-d73bf0ff3e7c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:57.585257 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162209a-23fa-4e39-8bb4-d73bf0ff3e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:57.585731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162209a-23fa-4e39-8bb4-d73bf0ff3e7c None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:57.587152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162209a-23fa-4e39-8bb4-d73bf0ff3e7c None admin] RBAC: Authorizing `identity:get_project(project_id=3643e64d3f194dc5bef838b26b6bb808)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:57.588865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162209a-23fa-4e39-8bb4-d73bf0ff3e7c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:57.591363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 43/93] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:40:57 2022] GET /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:57.597116 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162209a-23fa-4e39-8bb4-d73bf0ff3e7c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:57.650553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d97dd-feff-434e-a432-f56acefef5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:57.651085 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d97dd-feff-434e-a432-f56acefef5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:57.651325 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d97dd-feff-434e-a432-f56acefef5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:57.651479 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d97dd-feff-434e-a432-f56acefef5c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:57.727363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162209a-23fa-4e39-8bb4-d73bf0ff3e7c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:57.768382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb9660-03f5-4d11-b8e8-c6ace291817d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:57.769494 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb9660-03f5-4d11-b8e8-c6ace291817d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:57.770373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb9660-03f5-4d11-b8e8-c6ace291817d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:57.770837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb9660-03f5-4d11-b8e8-c6ace291817d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:57.771856 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb9660-03f5-4d11-b8e8-c6ace291817d None admin] RBAC: Adding query filter params (role.id=5ea7d4a868fb49b8992c3adb30476789, scope.project.id=3643e64d3f194dc5bef838b26b6bb808, user.id=52ebb4f8be97463abd2bc87a56c1e3ca) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:57.772919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb9660-03f5-4d11-b8e8-c6ace291817d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:57.774859 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb9660-03f5-4d11-b8e8-c6ace291817d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:57.778628 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:57.782812 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 44/94] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:40:57 2022] GET /identity/v3/role_assignments?user.id=52ebb4f8be97463abd2bc87a56c1e3ca&scope.project.id=3643e64d3f194dc5bef838b26b6bb808&role.id=5ea7d4a868fb49b8992c3adb30476789 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:57.805720 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:57.809988 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d97dd-feff-434e-a432-f56acefef5c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:57.811782 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d97dd-feff-434e-a432-f56acefef5c5 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:57.922643 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 51/95] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:40:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:40:57.930240 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb9660-03f5-4d11-b8e8-c6ace291817d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:58.102119 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb9660-03f5-4d11-b8e8-c6ace291817d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:58.155806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3273afb-48b8-49c4-b1c0-8690378ef5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:58.156713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3273afb-48b8-49c4-b1c0-8690378ef5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:58.157004 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3273afb-48b8-49c4-b1c0-8690378ef5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:58.157282 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3273afb-48b8-49c4-b1c0-8690378ef5f0 None admin] PATH_INFO: `/v3/projects/fb659514b3c54a58bb9176391e18d2eb` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:58.158499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3273afb-48b8-49c4-b1c0-8690378ef5f0 None admin] RBAC: Authorizing `identity:get_project(project_id=fb659514b3c54a58bb9176391e18d2eb)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:58.159969 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3273afb-48b8-49c4-b1c0-8690378ef5f0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:58.161712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 45/96] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:40:57 2022] GET /identity/v3/projects/fb659514b3c54a58bb9176391e18d2eb => generated 312 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:58.170390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d97dd-feff-434e-a432-f56acefef5c5 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:58.294749 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:58.298906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d97dd-feff-434e-a432-f56acefef5c5 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:58.333790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c8a58-0718-448f-a78a-15c6b6127773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:58.335027 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c8a58-0718-448f-a78a-15c6b6127773 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:58.335675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c8a58-0718-448f-a78a-15c6b6127773 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:58.336470 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c8a58-0718-448f-a78a-15c6b6127773 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:58.337352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c8a58-0718-448f-a78a-15c6b6127773 None admin] RBAC: Adding query filter params (role.id=66d9c5a190d544b3b3588bbdadf2cf39, scope.project.id=fb659514b3c54a58bb9176391e18d2eb, user.id=52ebb4f8be97463abd2bc87a56c1e3ca) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:58.337672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c8a58-0718-448f-a78a-15c6b6127773 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:58.339155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c8a58-0718-448f-a78a-15c6b6127773 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:58.345641 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 52/97] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:40:58 2022] GET /identity/v3/role_assignments?user.id=52ebb4f8be97463abd2bc87a56c1e3ca&scope.project.id=fb659514b3c54a58bb9176391e18d2eb&role.id=66d9c5a190d544b3b3588bbdadf2cf39 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:58.348042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085175e-a613-4879-b790-e3020da431eb None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:58.348342 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085175e-a613-4879-b790-e3020da431eb None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:58.351102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085175e-a613-4879-b790-e3020da431eb None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:58.351102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 46/98] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:40:58.356684 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af46988-f955-4795-b7f3-26e72c3a7d15 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:58.357284 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af46988-f955-4795-b7f3-26e72c3a7d15 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:58.357743 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af46988-f955-4795-b7f3-26e72c3a7d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:58.380240 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-9af46988-f955-4795-b7f3-26e72c3a7d15 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:58.381958 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9af46988-f955-4795-b7f3-26e72c3a7d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:58.471446 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 53/99] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:40:58.512183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085175e-a613-4879-b790-e3020da431eb None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:58.606548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579d298-6dd4-432c-8658-2a718f1b1152 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:58.606788 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579d298-6dd4-432c-8658-2a718f1b1152 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:58.607046 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579d298-6dd4-432c-8658-2a718f1b1152 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:58.608647 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 54/100] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:40:58.618352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40396b06-a4a7-48be-b2fa-6e08f3536227 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:58.618645 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40396b06-a4a7-48be-b2fa-6e08f3536227 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:58.618939 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40396b06-a4a7-48be-b2fa-6e08f3536227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:58.629139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:58.657833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-40396b06-a4a7-48be-b2fa-6e08f3536227 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:40:58.658845 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-40396b06-a4a7-48be-b2fa-6e08f3536227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:40:58.669042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085175e-a613-4879-b790-e3020da431eb None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:58.709473 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89128783-42fa-4c66-98b7-21da7d9ae62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:58.711260 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89128783-42fa-4c66-98b7-21da7d9ae62f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:58.711755 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89128783-42fa-4c66-98b7-21da7d9ae62f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:58.712276 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89128783-42fa-4c66-98b7-21da7d9ae62f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:58.717902 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89128783-42fa-4c66-98b7-21da7d9ae62f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:58.721032 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89128783-42fa-4c66-98b7-21da7d9ae62f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:58.726113 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 47/101] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:40:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:58.729544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89128783-42fa-4c66-98b7-21da7d9ae62f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:58.775358 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 55/102] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:40:58.827954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40396b06-a4a7-48be-b2fa-6e08f3536227 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:58.880278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:58.948364 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89128783-42fa-4c66-98b7-21da7d9ae62f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:59.030463 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c92c0-b2d2-4d81-b0f3-42706685eeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:59.031152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c92c0-b2d2-4d81-b0f3-42706685eeae None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:59.031442 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c92c0-b2d2-4d81-b0f3-42706685eeae None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:59.031725 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c92c0-b2d2-4d81-b0f3-42706685eeae None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:59.032478 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c92c0-b2d2-4d81-b0f3-42706685eeae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:59.033980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c92c0-b2d2-4d81-b0f3-42706685eeae None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:59.046203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:59.057279 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40396b06-a4a7-48be-b2fa-6e08f3536227 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:59.105291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a95dd-ca83-4168-a8d2-f2adc054acf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:59.106533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a95dd-ca83-4168-a8d2-f2adc054acf0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:59.107050 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a95dd-ca83-4168-a8d2-f2adc054acf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:59.107570 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a95dd-ca83-4168-a8d2-f2adc054acf0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:59.128472 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a95dd-ca83-4168-a8d2-f2adc054acf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:40:59.136861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-805a95dd-ca83-4168-a8d2-f2adc054acf0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:40:59.136861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:40:59.136861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:40:59.136861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:40:59.136861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:40:59.136861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:40:59.136861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:40:59.136861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:40:59.136861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:40:59.136861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:40:59.136861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:40:59.136861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:40:59.136861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:40:59.136861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:40:59.136861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:40:59.136861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:40:59.137681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:40:59.137681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:40:59.137681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:40:59.137681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:40:59.137681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:40:59.137681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:40:59.137681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:40:59.137681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:40:59.137681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:40:59.137681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:40:59.137681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:40:59.137681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:40:59.137681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:40:59.137681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:40:59.137681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:40:59.137681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:40:59.138423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:40:59.138423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:40:59.138423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:40:59.138423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:40:59.138423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:40:59.138423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:40:59.138423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:40:59.138423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:40:59.138423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:40:59.138423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:40:59.138423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:40:59.138423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:40:59.153874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 48/103] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jul 5 12:40:58 2022] POST /identity/v3/projects => generated 302 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:40:59.155112 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 56/104] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:40:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:40:59.160873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c92c0-b2d2-4d81-b0f3-42706685eeae None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:59.285617 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c92c0-b2d2-4d81-b0f3-42706685eeae None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:59.329695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73427c6-5e05-49fc-b2a9-b7ccb1d8787f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:59.330775 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73427c6-5e05-49fc-b2a9-b7ccb1d8787f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:59.331256 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73427c6-5e05-49fc-b2a9-b7ccb1d8787f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:59.331750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73427c6-5e05-49fc-b2a9-b7ccb1d8787f None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:59.332740 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73427c6-5e05-49fc-b2a9-b7ccb1d8787f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:40:59.333262 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73427c6-5e05-49fc-b2a9-b7ccb1d8787f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:59.335386 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73427c6-5e05-49fc-b2a9-b7ccb1d8787f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:59.348197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 49/105] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:40:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:40:59.354255 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a95dd-ca83-4168-a8d2-f2adc054acf0 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:59.504998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:59.527316 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a95dd-ca83-4168-a8d2-f2adc054acf0 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:59.570207 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424352c-ebd1-4ae4-b28d-847ebe8b8b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:59.571863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424352c-ebd1-4ae4-b28d-847ebe8b8b9a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:59.572156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424352c-ebd1-4ae4-b28d-847ebe8b8b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:59.572447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424352c-ebd1-4ae4-b28d-847ebe8b8b9a None admin] PATH_INFO: `/v3/users/1194063dba364142993c89675145e4ac` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:59.591776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424352c-ebd1-4ae4-b28d-847ebe8b8b9a None admin] RBAC: Authorizing `identity:get_user(user_id=1194063dba364142993c89675145e4ac)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:59.593361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424352c-ebd1-4ae4-b28d-847ebe8b8b9a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:59.595103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 57/106] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:40:59 2022] GET /identity/v3/users/1194063dba364142993c89675145e4ac => generated 289 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:40:59.601154 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73427c6-5e05-49fc-b2a9-b7ccb1d8787f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:40:59.684079 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:40:59.756033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73427c6-5e05-49fc-b2a9-b7ccb1d8787f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:40:59.800483 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9a05a-4ee7-4530-adf5-6db2a1b75b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:40:59.801227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9a05a-4ee7-4530-adf5-6db2a1b75b31 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:40:59.801520 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9a05a-4ee7-4530-adf5-6db2a1b75b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:40:59.801801 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9a05a-4ee7-4530-adf5-6db2a1b75b31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:40:59.903950 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9a05a-4ee7-4530-adf5-6db2a1b75b31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:40:59.905476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9a05a-4ee7-4530-adf5-6db2a1b75b31 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:40:59.969323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:00.036355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 50/107] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:40:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:00.042840 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424352c-ebd1-4ae4-b28d-847ebe8b8b9a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:00.119589 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3a6b1-bbfb-4b1a-8ace-afc4a717fc65 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:00.119919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3a6b1-bbfb-4b1a-8ace-afc4a717fc65 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:00.120168 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3a6b1-bbfb-4b1a-8ace-afc4a717fc65 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:00.121593 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 51/108] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:41:00.126833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2816bf-a6e7-4995-afc5-14f8d9fc3f27 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:00.127370 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2816bf-a6e7-4995-afc5-14f8d9fc3f27 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:00.127988 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2816bf-a6e7-4995-afc5-14f8d9fc3f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:00.145530 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-0e2816bf-a6e7-4995-afc5-14f8d9fc3f27 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:00.147097 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0e2816bf-a6e7-4995-afc5-14f8d9fc3f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:00.237786 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424352c-ebd1-4ae4-b28d-847ebe8b8b9a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:00.267374 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 52/109] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:41:00.297540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d0449-0b39-452b-9a1e-5c0133b8203d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:00.298407 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d0449-0b39-452b-9a1e-5c0133b8203d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:00.298698 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d0449-0b39-452b-9a1e-5c0133b8203d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:00.298987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d0449-0b39-452b-9a1e-5c0133b8203d None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:00.304550 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2816bf-a6e7-4995-afc5-14f8d9fc3f27 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:00.308269 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d0449-0b39-452b-9a1e-5c0133b8203d None admin] RBAC: Authorizing `identity:get_project(project_id=3643e64d3f194dc5bef838b26b6bb808)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:00.314088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d0449-0b39-452b-9a1e-5c0133b8203d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:00.318184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 58/110] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:00 2022] GET /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:00.322909 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d0449-0b39-452b-9a1e-5c0133b8203d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:00.346014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:00.495306 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:00.505419 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d0449-0b39-452b-9a1e-5c0133b8203d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:00.542437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61617eff-1b52-4c2c-a26f-bca3746f344c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:00.543463 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61617eff-1b52-4c2c-a26f-bca3746f344c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:00.543943 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61617eff-1b52-4c2c-a26f-bca3746f344c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:00.544415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61617eff-1b52-4c2c-a26f-bca3746f344c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:00.545599 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61617eff-1b52-4c2c-a26f-bca3746f344c None admin] RBAC: Adding query filter params (role.id=fcf1354e3e794c0297def593c19f0a76, scope.project.id=3643e64d3f194dc5bef838b26b6bb808, user.id=1194063dba364142993c89675145e4ac) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:00.546125 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61617eff-1b52-4c2c-a26f-bca3746f344c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:00.547842 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61617eff-1b52-4c2c-a26f-bca3746f344c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:00.555028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 59/111] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:41:00 2022] GET /identity/v3/role_assignments?user.id=1194063dba364142993c89675145e4ac&scope.project.id=3643e64d3f194dc5bef838b26b6bb808&role.id=fcf1354e3e794c0297def593c19f0a76 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:00.560625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2816bf-a6e7-4995-afc5-14f8d9fc3f27 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:00.621883 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec219450-1b60-4bd0-9796-f2b08e93f8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:00.622704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec219450-1b60-4bd0-9796-f2b08e93f8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:00.622995 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec219450-1b60-4bd0-9796-f2b08e93f8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:00.623274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec219450-1b60-4bd0-9796-f2b08e93f8d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:00.645629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec219450-1b60-4bd0-9796-f2b08e93f8d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:00.654102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-ec219450-1b60-4bd0-9796-f2b08e93f8d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:00.654102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:00.654102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:00.654102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:00.654102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:00.654102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:00.654102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:00.654102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:00.654102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:00.654102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:00.654102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:00.654102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:00.654102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:00.654102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:00.654102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:00.654102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:00.654953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:00.654953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:00.654953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:00.654953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:00.654953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:00.654953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:00.654953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:00.654953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:00.654953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:00.654953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:00.654953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:00.654953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:00.654953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:00.654953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:00.654953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:00.654953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:00.655712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:00.655712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:00.655712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:00.655712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:00.655712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:00.655712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:00.655712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:00.655712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:00.655712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:00.655712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:00.655712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:00.655712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:00.655712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 53/112] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:00.662668 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61617eff-1b52-4c2c-a26f-bca3746f344c None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:00.726319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a933f96-1824-46ab-8caa-15948035807d None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:00.726638 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a933f96-1824-46ab-8caa-15948035807d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:00.726900 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a933f96-1824-46ab-8caa-15948035807d None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:00.728446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 54/113] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:00.746145 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab347e2d-cc20-4c13-8f89-0745421d6376 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:00.746461 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab347e2d-cc20-4c13-8f89-0745421d6376 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:00.746719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab347e2d-cc20-4c13-8f89-0745421d6376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:00.783199 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:00.802217 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ab347e2d-cc20-4c13-8f89-0745421d6376 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:00.804468 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ab347e2d-cc20-4c13-8f89-0745421d6376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:00.824203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61617eff-1b52-4c2c-a26f-bca3746f344c None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:00.863824 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d901976-65aa-4c70-a6d2-34c7dc0ec3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:00.864945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d901976-65aa-4c70-a6d2-34c7dc0ec3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:00.865427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d901976-65aa-4c70-a6d2-34c7dc0ec3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:00.865895 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d901976-65aa-4c70-a6d2-34c7dc0ec3e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:00.867388 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d901976-65aa-4c70-a6d2-34c7dc0ec3e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:00.867940 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d901976-65aa-4c70-a6d2-34c7dc0ec3e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:00.869546 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d901976-65aa-4c70-a6d2-34c7dc0ec3e4 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:00.879286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 60/114] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:00.885741 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d901976-65aa-4c70-a6d2-34c7dc0ec3e4 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:00.964563 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 55/115] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:41:00.970214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a27c86-9b0b-4064-9500-ac4b7fa8ebe7 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:00.970520 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a27c86-9b0b-4064-9500-ac4b7fa8ebe7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:00.970839 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a27c86-9b0b-4064-9500-ac4b7fa8ebe7 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:00.972143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 56/116] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:00.978082 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9795e-3d6c-46d3-8b7e-c0836272b04d None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:00.978377 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9795e-3d6c-46d3-8b7e-c0836272b04d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:00.978670 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9795e-3d6c-46d3-8b7e-c0836272b04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:00.993842 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d901976-65aa-4c70-a6d2-34c7dc0ec3e4 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:01.009718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-3bc9795e-3d6c-46d3-8b7e-c0836272b04d None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:01.010951 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3bc9795e-3d6c-46d3-8b7e-c0836272b04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:01.032724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fea87-2de4-4f20-a12e-d24460d1812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:01.033932 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fea87-2de4-4f20-a12e-d24460d1812f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:01.034412 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fea87-2de4-4f20-a12e-d24460d1812f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:01.034995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fea87-2de4-4f20-a12e-d24460d1812f None admin] PATH_INFO: `/v3/users/52ebb4f8be97463abd2bc87a56c1e3ca` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:01.036424 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fea87-2de4-4f20-a12e-d24460d1812f None admin] RBAC: Authorizing `identity:get_user(user_id=52ebb4f8be97463abd2bc87a56c1e3ca)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:01.038655 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fea87-2de4-4f20-a12e-d24460d1812f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:01.040492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 61/117] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:00 2022] GET /identity/v3/users/52ebb4f8be97463abd2bc87a56c1e3ca => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:01.041480 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fea87-2de4-4f20-a12e-d24460d1812f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:01.048864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:01.084968 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:01.090987 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 57/118] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 05 12:41:01.091824 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9795e-3d6c-46d3-8b7e-c0836272b04d None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:01.160717 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fea87-2de4-4f20-a12e-d24460d1812f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:01.198110 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd609cb1-47d7-4efd-adb0-d9d30b33f238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:01.199306 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd609cb1-47d7-4efd-adb0-d9d30b33f238 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:01.199835 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd609cb1-47d7-4efd-adb0-d9d30b33f238 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:01.200310 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd609cb1-47d7-4efd-adb0-d9d30b33f238 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:01.211574 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd609cb1-47d7-4efd-adb0-d9d30b33f238 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:01.219664 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-fd609cb1-47d7-4efd-adb0-d9d30b33f238 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:41:01.219664 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:01.219664 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:01.219664 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:01.219664 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:01.219664 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:01.219664 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:01.219664 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:01.219664 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:01.219664 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:01.219664 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:01.219664 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:01.219664 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:01.219664 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:01.219664 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:01.219664 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:01.220510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:01.220510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:01.220510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:01.220510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:01.220510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:01.220510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:01.220510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:01.220510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:01.220510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:01.220510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:01.220510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:01.220510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:01.220510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:01.220510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:01.220510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:01.220510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:01.221287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:01.221287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:01.221287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:01.221287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:01.221287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:01.221287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:01.221287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:01.221287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:01.221287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:01.221287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:01.221287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:41:01.221287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:01.223589 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 62/119] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:41:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:01.224959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd609cb1-47d7-4efd-adb0-d9d30b33f238 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:01.249086 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9795e-3d6c-46d3-8b7e-c0836272b04d None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:01.287602 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4b401-ed39-45f7-9acd-3f2326af13e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:01.289048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4b401-ed39-45f7-9acd-3f2326af13e0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:01.289332 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4b401-ed39-45f7-9acd-3f2326af13e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:01.289617 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4b401-ed39-45f7-9acd-3f2326af13e0 None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:01.290953 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:01.291166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4b401-ed39-45f7-9acd-3f2326af13e0 None admin] RBAC: Authorizing `identity:get_project(project_id=3643e64d3f194dc5bef838b26b6bb808)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:01.293554 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4b401-ed39-45f7-9acd-3f2326af13e0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:01.295449 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 58/120] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:01 2022] GET /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:01.296066 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4b401-ed39-45f7-9acd-3f2326af13e0 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:01.338295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd609cb1-47d7-4efd-adb0-d9d30b33f238 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:01.370704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:01.374548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820b5d0-1643-4483-8c1a-c8267416055e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:01.375825 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820b5d0-1643-4483-8c1a-c8267416055e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:01.376339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820b5d0-1643-4483-8c1a-c8267416055e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:01.376852 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820b5d0-1643-4483-8c1a-c8267416055e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:01.388600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820b5d0-1643-4483-8c1a-c8267416055e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:01.396714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-1820b5d0-1643-4483-8c1a-c8267416055e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:01.396714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:01.396714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:01.396714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:01.396714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:01.396714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:01.396714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:01.396714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:01.396714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:01.396714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:01.396714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:01.396714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:01.396714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:01.396714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:01.396714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:01.396714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:01.397616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:01.397616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:01.397616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:01.397616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:01.397616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:01.397616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:01.397616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:01.397616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:01.397616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:01.397616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:01.397616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:01.397616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:01.397616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:01.397616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:01.397616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:01.397616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:01.398385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:01.398385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:01.398385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:01.398385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:01.398385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:01.398385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:01.398385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:01.398385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:01.398385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:01.398385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:01.398385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:01.398385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:01.401004 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 63/121] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:01.402108 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820b5d0-1643-4483-8c1a-c8267416055e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:01.412031 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4b401-ed39-45f7-9acd-3f2326af13e0 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:01.471312 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30111354-4582-47af-8c0f-44fffe56617a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:01.472003 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30111354-4582-47af-8c0f-44fffe56617a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:01.472300 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30111354-4582-47af-8c0f-44fffe56617a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:01.472830 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30111354-4582-47af-8c0f-44fffe56617a None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:01.473535 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30111354-4582-47af-8c0f-44fffe56617a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:01.473850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30111354-4582-47af-8c0f-44fffe56617a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:01.481244 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30111354-4582-47af-8c0f-44fffe56617a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:01.484637 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 59/122] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:01.485417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30111354-4582-47af-8c0f-44fffe56617a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:01.514217 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820b5d0-1643-4483-8c1a-c8267416055e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:01.537740 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:01.550003 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34078981-74fb-4a1f-9a8c-28f587d33644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:01.551159 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34078981-74fb-4a1f-9a8c-28f587d33644 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:01.551604 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34078981-74fb-4a1f-9a8c-28f587d33644 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:01.552114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34078981-74fb-4a1f-9a8c-28f587d33644 None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808/users/52ebb4f8be97463abd2bc87a56c1e3ca/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:01.554912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34078981-74fb-4a1f-9a8c-28f587d33644 None admin] RBAC: Authorizing `identity:create_grant(project_id=3643e64d3f194dc5bef838b26b6bb808, user_id=52ebb4f8be97463abd2bc87a56c1e3ca, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:01.556687 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34078981-74fb-4a1f-9a8c-28f587d33644 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:01.595790 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30111354-4582-47af-8c0f-44fffe56617a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:01.608987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 64/123] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:41:01 2022] PUT /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808/users/52ebb4f8be97463abd2bc87a56c1e3ca/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:41:01.610302 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd192353-f788-469b-9dd1-8186a6526ec2 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:01.610592 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd192353-f788-469b-9dd1-8186a6526ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:01.610921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd192353-f788-469b-9dd1-8186a6526ec2 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:01.612178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 65/124] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:01.619795 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd192353-f788-469b-9dd1-8186a6526ec2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:01.639606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:01.648119 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee916a68-b466-4a58-a7d7-b859ef3a9e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:01.649626 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee916a68-b466-4a58-a7d7-b859ef3a9e11 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:01.650145 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee916a68-b466-4a58-a7d7-b859ef3a9e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:01.650703 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee916a68-b466-4a58-a7d7-b859ef3a9e11 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:01.651963 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee916a68-b466-4a58-a7d7-b859ef3a9e11 None admin] RBAC: Adding query filter params (name=member) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:01.652454 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee916a68-b466-4a58-a7d7-b859ef3a9e11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:01.654779 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee916a68-b466-4a58-a7d7-b859ef3a9e11 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:01.666920 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 60/125] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:01.669012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd47d2-6142-456c-814c-34655e914d3d None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:01.673950 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd47d2-6142-456c-814c-34655e914d3d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:01.674925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd47d2-6142-456c-814c-34655e914d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:01.695653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-03fd47d2-6142-456c-814c-34655e914d3d None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:01.697411 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-03fd47d2-6142-456c-814c-34655e914d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:01.783956 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 61/126] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:01.785175 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd47d2-6142-456c-814c-34655e914d3d None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:01.873964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd192353-f788-469b-9dd1-8186a6526ec2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:01.906698 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd47d2-6142-456c-814c-34655e914d3d None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:01.931405 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:01.941296 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642af5c-b1cc-4e6c-919f-54456836922a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:01.942204 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642af5c-b1cc-4e6c-919f-54456836922a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:01.942494 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642af5c-b1cc-4e6c-919f-54456836922a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:01.942786 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642af5c-b1cc-4e6c-919f-54456836922a None admin] PATH_INFO: `/v3/users/1dacaea933b24b6082a79a2c673ec9f1` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:01.948007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a8644-7b45-4d00-b2df-21b86b566b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:01.948128 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642af5c-b1cc-4e6c-919f-54456836922a None admin] RBAC: Authorizing `identity:get_user(user_id=1dacaea933b24b6082a79a2c673ec9f1)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:01.948202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a8644-7b45-4d00-b2df-21b86b566b82 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:01.948202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a8644-7b45-4d00-b2df-21b86b566b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:01.948202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a8644-7b45-4d00-b2df-21b86b566b82 None admin] PATH_INFO: `/v3/users/52ebb4f8be97463abd2bc87a56c1e3ca` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:01.948380 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642af5c-b1cc-4e6c-919f-54456836922a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:01.948447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a8644-7b45-4d00-b2df-21b86b566b82 None admin] RBAC: Authorizing `identity:get_user(user_id=52ebb4f8be97463abd2bc87a56c1e3ca)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:01.948993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a8644-7b45-4d00-b2df-21b86b566b82 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:01.950560 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 66/127] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:01 2022] GET /identity/v3/users/1dacaea933b24b6082a79a2c673ec9f1 => generated 247 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:01.950958 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 62/128] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:01 2022] GET /identity/v3/users/52ebb4f8be97463abd2bc87a56c1e3ca => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:01.951485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642af5c-b1cc-4e6c-919f-54456836922a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:01.956183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a8644-7b45-4d00-b2df-21b86b566b82 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:02.059703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:02.160119 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642af5c-b1cc-4e6c-919f-54456836922a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:02.166439 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a8644-7b45-4d00-b2df-21b86b566b82 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:02.206287 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70da915-8cbd-49b7-bcc1-c3bd4bc11026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:02.207501 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70da915-8cbd-49b7-bcc1-c3bd4bc11026 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:02.208143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70da915-8cbd-49b7-bcc1-c3bd4bc11026 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:02.209811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70da915-8cbd-49b7-bcc1-c3bd4bc11026 None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:02.212006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70da915-8cbd-49b7-bcc1-c3bd4bc11026 None admin] RBAC: Authorizing `identity:get_project(project_id=3643e64d3f194dc5bef838b26b6bb808)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:02.216473 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70da915-8cbd-49b7-bcc1-c3bd4bc11026 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:02.219743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 63/129] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:01 2022] GET /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:02.220761 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70da915-8cbd-49b7-bcc1-c3bd4bc11026 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:02.246876 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c1e85-594d-43f5-99f6-004637cca8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:02.247699 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c1e85-594d-43f5-99f6-004637cca8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:02.248038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c1e85-594d-43f5-99f6-004637cca8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:02.248326 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c1e85-594d-43f5-99f6-004637cca8a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:02.264975 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c1e85-594d-43f5-99f6-004637cca8a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:02.275345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-dc5c1e85-594d-43f5-99f6-004637cca8a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:02.275345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:02.275345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:02.275345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:02.275345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:02.275345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:02.275345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:02.275345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:02.275345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:02.275345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:02.275345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:02.275345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:02.275345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:02.275345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:02.275345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:02.275345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:02.276193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:02.276193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:02.276193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:02.276193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:02.276193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:02.276193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:02.276193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:02.276193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:02.276193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:02.276193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:02.276193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:02.276193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:02.276193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:02.276193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:02.276193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:02.276193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:02.277322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:02.277322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:02.277322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:02.277322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:02.277322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:02.277322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:02.277322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:02.277322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:02.277322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:02.277322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:02.277322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:02.277322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:02.279873 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 67/130] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jul 5 12:41:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:02.281292 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c1e85-594d-43f5-99f6-004637cca8a5 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:02.332877 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:02.376416 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70da915-8cbd-49b7-bcc1-c3bd4bc11026 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:02.411773 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c1e85-594d-43f5-99f6-004637cca8a5 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:02.417786 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d0819-2758-4786-bcd7-731f3cbd5cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:02.419446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d0819-2758-4786-bcd7-731f3cbd5cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:02.419965 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d0819-2758-4786-bcd7-731f3cbd5cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:02.421005 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d0819-2758-4786-bcd7-731f3cbd5cd5 None admin] PATH_INFO: `/v3/projects/fb659514b3c54a58bb9176391e18d2eb` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:02.422555 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:02.424241 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d0819-2758-4786-bcd7-731f3cbd5cd5 None admin] RBAC: Authorizing `identity:get_project(project_id=fb659514b3c54a58bb9176391e18d2eb)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:02.426573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d0819-2758-4786-bcd7-731f3cbd5cd5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:02.430390 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 64/131] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:02 2022] GET /identity/v3/projects/fb659514b3c54a58bb9176391e18d2eb => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:02.435080 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d0819-2758-4786-bcd7-731f3cbd5cd5 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:02.455353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8c44e-11df-4e9d-adfd-3a69eaef9b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:02.456983 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8c44e-11df-4e9d-adfd-3a69eaef9b35 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:02.457483 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8c44e-11df-4e9d-adfd-3a69eaef9b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:02.457964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8c44e-11df-4e9d-adfd-3a69eaef9b35 None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808/users/1dacaea933b24b6082a79a2c673ec9f1/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:02.463354 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8c44e-11df-4e9d-adfd-3a69eaef9b35 None admin] RBAC: Authorizing `identity:create_grant(project_id=3643e64d3f194dc5bef838b26b6bb808, user_id=1dacaea933b24b6082a79a2c673ec9f1, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:02.466438 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8c44e-11df-4e9d-adfd-3a69eaef9b35 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:02.542737 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d0819-2758-4786-bcd7-731f3cbd5cd5 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:02.560375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 68/132] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:41:02 2022] PUT /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808/users/1dacaea933b24b6082a79a2c673ec9f1/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:41:02.562104 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56e743-c0d2-4c7d-acbf-394faab98ede None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:02.562601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56e743-c0d2-4c7d-acbf-394faab98ede None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:02.563124 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56e743-c0d2-4c7d-acbf-394faab98ede None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:02.564729 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 69/133] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:02.566218 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56e743-c0d2-4c7d-acbf-394faab98ede None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:02.587704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:02.602555 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab1cc6-df0a-41cb-9659-4958a8cf221d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:02.603214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab1cc6-df0a-41cb-9659-4958a8cf221d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:02.603544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab1cc6-df0a-41cb-9659-4958a8cf221d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:02.603806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab1cc6-df0a-41cb-9659-4958a8cf221d None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:02.604718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab1cc6-df0a-41cb-9659-4958a8cf221d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:02.605055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab1cc6-df0a-41cb-9659-4958a8cf221d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:02.606463 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab1cc6-df0a-41cb-9659-4958a8cf221d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:02.627433 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 65/134] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:41:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:02.628656 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2218ada-0dc9-492a-9e2e-6d67e44fd469 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:02.629007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2218ada-0dc9-492a-9e2e-6d67e44fd469 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:02.629290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2218ada-0dc9-492a-9e2e-6d67e44fd469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:02.657518 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f2218ada-0dc9-492a-9e2e-6d67e44fd469 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:02.658890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f2218ada-0dc9-492a-9e2e-6d67e44fd469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:02.728785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56e743-c0d2-4c7d-acbf-394faab98ede None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:02.807623 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 66/135] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:02.809078 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8343e00-dcf1-43a8-b1a2-ecd5dd9989c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:02.810323 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8343e00-dcf1-43a8-b1a2-ecd5dd9989c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:02.810611 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8343e00-dcf1-43a8-b1a2-ecd5dd9989c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:02.812241 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2218ada-0dc9-492a-9e2e-6d67e44fd469 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:02.813092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8343e00-dcf1-43a8-b1a2-ecd5dd9989c3 None admin] PATH_INFO: `/v3/projects/fb659514b3c54a58bb9176391e18d2eb/users/52ebb4f8be97463abd2bc87a56c1e3ca/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:02.821306 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8343e00-dcf1-43a8-b1a2-ecd5dd9989c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb659514b3c54a58bb9176391e18d2eb, user_id=52ebb4f8be97463abd2bc87a56c1e3ca, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:02.823941 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8343e00-dcf1-43a8-b1a2-ecd5dd9989c3 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:02.896834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 70/136] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:41:02 2022] PUT /identity/v3/projects/fb659514b3c54a58bb9176391e18d2eb/users/52ebb4f8be97463abd2bc87a56c1e3ca/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:41:02.902085 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8343e00-dcf1-43a8-b1a2-ecd5dd9989c3 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:02.975893 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2218ada-0dc9-492a-9e2e-6d67e44fd469 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:02.995485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:03.015217 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:03.031880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1e80a-b722-443c-8792-71f3239cfc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:03.033024 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1e80a-b722-443c-8792-71f3239cfc39 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:03.033785 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1e80a-b722-443c-8792-71f3239cfc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:03.034164 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1e80a-b722-443c-8792-71f3239cfc39 None admin] PATH_INFO: `/v3/users/52ebb4f8be97463abd2bc87a56c1e3ca` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:03.035576 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1e80a-b722-443c-8792-71f3239cfc39 None admin] RBAC: Authorizing `identity:get_user(user_id=52ebb4f8be97463abd2bc87a56c1e3ca)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:03.037354 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1e80a-b722-443c-8792-71f3239cfc39 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:03.040406 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 67/137] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:02 2022] GET /identity/v3/users/52ebb4f8be97463abd2bc87a56c1e3ca => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:03.046251 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1e80a-b722-443c-8792-71f3239cfc39 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:03.140897 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8343e00-dcf1-43a8-b1a2-ecd5dd9989c3 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:03.178019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb3b5a-a04a-49ed-a36e-32c87aa8146a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:03.178873 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb3b5a-a04a-49ed-a36e-32c87aa8146a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:03.179162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb3b5a-a04a-49ed-a36e-32c87aa8146a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:03.179441 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb3b5a-a04a-49ed-a36e-32c87aa8146a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:03.180687 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb3b5a-a04a-49ed-a36e-32c87aa8146a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:03.182173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb3b5a-a04a-49ed-a36e-32c87aa8146a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:03.183982 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 71/138] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:03.185286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512e629-4b52-4615-86f1-bf5468861283 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:03.185580 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512e629-4b52-4615-86f1-bf5468861283 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:03.185864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512e629-4b52-4615-86f1-bf5468861283 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:03.187259 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 72/139] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:03.191887 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512e629-4b52-4615-86f1-bf5468861283 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:03.236403 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1e80a-b722-443c-8792-71f3239cfc39 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:03.287272 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2e2a9-5fbe-4983-8d2d-7e06de48da3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:03.288690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2e2a9-5fbe-4983-8d2d-7e06de48da3b None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:03.289081 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2e2a9-5fbe-4983-8d2d-7e06de48da3b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:03.289461 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2e2a9-5fbe-4983-8d2d-7e06de48da3b None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:03.290780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2e2a9-5fbe-4983-8d2d-7e06de48da3b None admin] RBAC: Authorizing `identity:get_project(project_id=3643e64d3f194dc5bef838b26b6bb808)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:03.293131 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2e2a9-5fbe-4983-8d2d-7e06de48da3b None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:03.295806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 68/140] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:03 2022] GET /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:03.297256 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f9ce9-dbd2-4add-a65e-3e92aa0057da None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:03.297645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f9ce9-dbd2-4add-a65e-3e92aa0057da None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:03.298310 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f9ce9-dbd2-4add-a65e-3e92aa0057da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:03.305097 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:03.310003 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512e629-4b52-4615-86f1-bf5468861283 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:03.324728 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-346f9ce9-dbd2-4add-a65e-3e92aa0057da None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:03.326746 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-346f9ce9-dbd2-4add-a65e-3e92aa0057da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:03.358843 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ec8a6-594f-4aae-9683-2223625a8d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:03.359547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ec8a6-594f-4aae-9683-2223625a8d82 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:03.359825 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ec8a6-594f-4aae-9683-2223625a8d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:03.360110 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ec8a6-594f-4aae-9683-2223625a8d82 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:03.360878 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ec8a6-594f-4aae-9683-2223625a8d82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:03.363201 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ec8a6-594f-4aae-9683-2223625a8d82 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:03.407116 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:03.419980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 69/141] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:03.420910 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f9ce9-dbd2-4add-a65e-3e92aa0057da None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:03.460962 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 73/142] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jul 5 12:41:03 2022] POST /identity/v3/users => generated 283 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:41:03.461873 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ec8a6-594f-4aae-9683-2223625a8d82 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:03.636948 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f9ce9-dbd2-4add-a65e-3e92aa0057da None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:03.641511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ec8a6-594f-4aae-9683-2223625a8d82 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:03.681372 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d6147-e6b7-46c4-8a3e-4c1bfb5dbfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:03.682623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d6147-e6b7-46c4-8a3e-4c1bfb5dbfad None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:03.683107 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d6147-e6b7-46c4-8a3e-4c1bfb5dbfad None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:03.683583 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d6147-e6b7-46c4-8a3e-4c1bfb5dbfad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:03.694942 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a4e5b-fa67-4c65-997a-eded936d5287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:03.695879 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a4e5b-fa67-4c65-997a-eded936d5287 None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:03.696170 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a4e5b-fa67-4c65-997a-eded936d5287 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:03.696455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a4e5b-fa67-4c65-997a-eded936d5287 None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808/users/52ebb4f8be97463abd2bc87a56c1e3ca/roles/5ea7d4a868fb49b8992c3adb30476789` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:03.698016 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d6147-e6b7-46c4-8a3e-4c1bfb5dbfad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:03.702492 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a4e5b-fa67-4c65-997a-eded936d5287 None admin] RBAC: Authorizing `identity:create_grant(project_id=3643e64d3f194dc5bef838b26b6bb808, user_id=52ebb4f8be97463abd2bc87a56c1e3ca, role_id=5ea7d4a868fb49b8992c3adb30476789)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:03.703993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a4e5b-fa67-4c65-997a-eded936d5287 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:03.706886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-d43d6147-e6b7-46c4-8a3e-4c1bfb5dbfad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:41:03.706886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:03.706886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:03.706886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:03.706886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:03.706886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:03.706886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:03.706886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:03.706886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:03.706886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:03.706886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:03.706886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:03.706886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:03.706886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:03.706886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:03.706886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:03.707718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:03.707718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:03.707718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:03.707718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:03.707718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:03.707718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:03.707718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:03.707718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:03.707718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:03.707718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:03.707718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:03.707718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:03.707718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:03.707718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:03.707718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:03.707718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:03.708454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:03.708454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:03.708454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:03.708454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:03.708454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:03.708454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:03.708454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:03.708454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:03.708454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:03.708454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:03.708454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:41:03.708454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:03.710509 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 74/143] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:03.716699 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d6147-e6b7-46c4-8a3e-4c1bfb5dbfad None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:03.735006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:03.778868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 70/144] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:41:03 2022] PUT /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808/users/52ebb4f8be97463abd2bc87a56c1e3ca/roles/5ea7d4a868fb49b8992c3adb30476789 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:41:03.859615 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d6147-e6b7-46c4-8a3e-4c1bfb5dbfad None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:03.900117 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aebad8-e24c-4267-909c-0743a828c07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:03.901083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aebad8-e24c-4267-909c-0743a828c07d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:03.901511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aebad8-e24c-4267-909c-0743a828c07d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:03.901937 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aebad8-e24c-4267-909c-0743a828c07d None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:03.902851 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aebad8-e24c-4267-909c-0743a828c07d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:03.903301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aebad8-e24c-4267-909c-0743a828c07d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:03.904929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aebad8-e24c-4267-909c-0743a828c07d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:03.915162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 75/145] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:03.920997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a4e5b-fa67-4c65-997a-eded936d5287 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:03.996371 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:04.056860 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a4e5b-fa67-4c65-997a-eded936d5287 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:04.094144 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37a9dc-4cac-41f9-894a-15c0f25294c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:04.095025 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37a9dc-4cac-41f9-894a-15c0f25294c9 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:04.095312 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37a9dc-4cac-41f9-894a-15c0f25294c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:04.095590 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37a9dc-4cac-41f9-894a-15c0f25294c9 None admin] PATH_INFO: `/v3/users/1194063dba364142993c89675145e4ac` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:04.096824 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37a9dc-4cac-41f9-894a-15c0f25294c9 None admin] RBAC: Authorizing `identity:get_user(user_id=1194063dba364142993c89675145e4ac)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:04.098284 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37a9dc-4cac-41f9-894a-15c0f25294c9 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:04.100491 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 71/146] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:03 2022] GET /identity/v3/users/1194063dba364142993c89675145e4ac => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:04.105920 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aebad8-e24c-4267-909c-0743a828c07d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:04.209030 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:04.238953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd7524-dc30-4663-85f8-408e3288804d None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:04.239273 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd7524-dc30-4663-85f8-408e3288804d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:04.239516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd7524-dc30-4663-85f8-408e3288804d None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:04.239611 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aebad8-e24c-4267-909c-0743a828c07d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:04.241184 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 72/147] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:41:04.254680 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2859f05-40a2-47b7-bb27-16779d5465f8 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:04.255022 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2859f05-40a2-47b7-bb27-16779d5465f8 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:04.255238 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2859f05-40a2-47b7-bb27-16779d5465f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:04.277362 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e2859f05-40a2-47b7-bb27-16779d5465f8 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:04.278573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e2859f05-40a2-47b7-bb27-16779d5465f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:04.292172 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37855a-025f-4834-92f4-e4e6b2343087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:04.293108 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37855a-025f-4834-92f4-e4e6b2343087 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:04.293395 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37855a-025f-4834-92f4-e4e6b2343087 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:04.293670 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37855a-025f-4834-92f4-e4e6b2343087 None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:04.297345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37855a-025f-4834-92f4-e4e6b2343087 None admin] RBAC: Authorizing `identity:get_project(project_id=3643e64d3f194dc5bef838b26b6bb808)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:04.299904 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37855a-025f-4834-92f4-e4e6b2343087 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:04.300613 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 76/148] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:04 2022] GET /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:04.306286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37855a-025f-4834-92f4-e4e6b2343087 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:04.414028 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 73/149] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:41:04.438651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37855a-025f-4834-92f4-e4e6b2343087 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:04.456417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2859f05-40a2-47b7-bb27-16779d5465f8 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:04.475453 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa158f-3059-4bbe-abc8-36a99bc74b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:04.476759 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa158f-3059-4bbe-abc8-36a99bc74b5b None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:04.477213 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa158f-3059-4bbe-abc8-36a99bc74b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:04.477663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa158f-3059-4bbe-abc8-36a99bc74b5b None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808/users/1194063dba364142993c89675145e4ac/roles/fcf1354e3e794c0297def593c19f0a76` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:04.479859 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa158f-3059-4bbe-abc8-36a99bc74b5b None admin] RBAC: Authorizing `identity:create_grant(project_id=3643e64d3f194dc5bef838b26b6bb808, user_id=1194063dba364142993c89675145e4ac, role_id=fcf1354e3e794c0297def593c19f0a76)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:04.481674 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa158f-3059-4bbe-abc8-36a99bc74b5b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:04.525063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:04.558314 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 77/150] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:41:04 2022] PUT /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808/users/1194063dba364142993c89675145e4ac/roles/fcf1354e3e794c0297def593c19f0a76 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:41:04.607071 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2859f05-40a2-47b7-bb27-16779d5465f8 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:04.653962 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437537a1-d464-45ee-ad66-e41b7aabebd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:04.655183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437537a1-d464-45ee-ad66-e41b7aabebd1 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:04.655682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437537a1-d464-45ee-ad66-e41b7aabebd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:04.656128 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437537a1-d464-45ee-ad66-e41b7aabebd1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:04.671399 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437537a1-d464-45ee-ad66-e41b7aabebd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:04.680485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-437537a1-d464-45ee-ad66-e41b7aabebd1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:04.680485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:04.680485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:04.680485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:04.680485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:04.680485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:04.680485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:04.680485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:04.680485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:04.680485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:04.680485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:04.680485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:04.680485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:04.680485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:04.680485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:04.680485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:04.684010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:04.684010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:04.684010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:04.684010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:04.684010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:04.684010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:04.684010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:04.684010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:04.684010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:04.684010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:04.684010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:04.684010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:04.684010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:04.684010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:04.684010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:04.684010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:04.684789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:04.684789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:04.684789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:04.684789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:04.684789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:04.684789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:04.684789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:04.684789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:04.684789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:04.684789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:04.684789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:04.684789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:04.687334 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 74/151] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:04.693081 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa158f-3059-4bbe-abc8-36a99bc74b5b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:04.712996 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:04.864670 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa158f-3059-4bbe-abc8-36a99bc74b5b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:04.864670 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfe0e6-1a4e-4c78-8e34-7209152b6895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:04.864670 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfe0e6-1a4e-4c78-8e34-7209152b6895 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:04.864670 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfe0e6-1a4e-4c78-8e34-7209152b6895 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:04.865183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfe0e6-1a4e-4c78-8e34-7209152b6895 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:04.865183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfe0e6-1a4e-4c78-8e34-7209152b6895 None admin] RBAC: Adding query filter params (name=member) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:04.865183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfe0e6-1a4e-4c78-8e34-7209152b6895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:04.865183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfe0e6-1a4e-4c78-8e34-7209152b6895 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:04.865183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 78/152] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:04.866811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437537a1-d464-45ee-ad66-e41b7aabebd1 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:05.009627 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437537a1-d464-45ee-ad66-e41b7aabebd1 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:05.011183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:05.049924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307f4a5-188b-4648-b177-53dee5c89c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:05.049924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307f4a5-188b-4648-b177-53dee5c89c74 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:05.049924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307f4a5-188b-4648-b177-53dee5c89c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:05.049924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307f4a5-188b-4648-b177-53dee5c89c74 None admin] PATH_INFO: `/v3/users/52ebb4f8be97463abd2bc87a56c1e3ca` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:05.052530 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307f4a5-188b-4648-b177-53dee5c89c74 None admin] RBAC: Authorizing `identity:get_user(user_id=52ebb4f8be97463abd2bc87a56c1e3ca)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:05.052530 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307f4a5-188b-4648-b177-53dee5c89c74 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:05.056607 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 75/153] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:04 2022] GET /identity/v3/users/52ebb4f8be97463abd2bc87a56c1e3ca => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:05.059674 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfe0e6-1a4e-4c78-8e34-7209152b6895 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:05.139480 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:05.179410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfe0e6-1a4e-4c78-8e34-7209152b6895 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:05.219149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11596648-99ca-4e4f-9a50-4febf7640c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:05.219785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11596648-99ca-4e4f-9a50-4febf7640c7e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:05.220073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11596648-99ca-4e4f-9a50-4febf7640c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:05.220348 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11596648-99ca-4e4f-9a50-4febf7640c7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:05.297297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11596648-99ca-4e4f-9a50-4febf7640c7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:05.298815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11596648-99ca-4e4f-9a50-4febf7640c7e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:05.364662 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:05.412113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 79/154] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:05.417708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307f4a5-188b-4648-b177-53dee5c89c74 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:05.542360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307f4a5-188b-4648-b177-53dee5c89c74 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:05.576614 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe62b4-6f13-46d7-a526-a0445f68e32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:05.577506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe62b4-6f13-46d7-a526-a0445f68e32c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:05.577834 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe62b4-6f13-46d7-a526-a0445f68e32c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:05.578114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe62b4-6f13-46d7-a526-a0445f68e32c None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:05.579294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe62b4-6f13-46d7-a526-a0445f68e32c None admin] RBAC: Authorizing `identity:get_project(project_id=3643e64d3f194dc5bef838b26b6bb808)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:05.580771 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe62b4-6f13-46d7-a526-a0445f68e32c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:05.582826 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 76/155] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:05 2022] GET /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:05.589231 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11596648-99ca-4e4f-9a50-4febf7640c7e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:05.740412 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11596648-99ca-4e4f-9a50-4febf7640c7e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:05.779647 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241e9be-2d0d-434d-bff5-535061514019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:05.780726 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241e9be-2d0d-434d-bff5-535061514019 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:05.781219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241e9be-2d0d-434d-bff5-535061514019 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:05.781697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241e9be-2d0d-434d-bff5-535061514019 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:05.782763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241e9be-2d0d-434d-bff5-535061514019 None admin] RBAC: Adding query filter params (role.id=66d9c5a190d544b3b3588bbdadf2cf39, scope.project.id=3643e64d3f194dc5bef838b26b6bb808, user.id=52ebb4f8be97463abd2bc87a56c1e3ca) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:05.783300 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241e9be-2d0d-434d-bff5-535061514019 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:05.785189 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241e9be-2d0d-434d-bff5-535061514019 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:05.797792 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 80/156] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:41:05 2022] GET /identity/v3/role_assignments?user.id=52ebb4f8be97463abd2bc87a56c1e3ca&scope.project.id=3643e64d3f194dc5bef838b26b6bb808&role.id=66d9c5a190d544b3b3588bbdadf2cf39 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:06.304505 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b1542-afbc-4d30-893e-2e873aeacdae None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:06.305025 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b1542-afbc-4d30-893e-2e873aeacdae None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:06.305097 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b1542-afbc-4d30-893e-2e873aeacdae None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:06.306755 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 77/157] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:06.312044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a0684-eca4-4489-a516-f08ad3890170 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:06.312953 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a0684-eca4-4489-a516-f08ad3890170 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:06.313438 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a0684-eca4-4489-a516-f08ad3890170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:06.333622 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-958a0684-eca4-4489-a516-f08ad3890170 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:06.335161 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-958a0684-eca4-4489-a516-f08ad3890170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:06.361161 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:06.409978 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 81/158] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:06.452000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b1542-afbc-4d30-893e-2e873aeacdae None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:06.504008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:06.574517 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b1542-afbc-4d30-893e-2e873aeacdae None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:06.611195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b65d7b-5cec-475b-b414-00a29dade500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:06.611928 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b65d7b-5cec-475b-b414-00a29dade500 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:06.612210 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b65d7b-5cec-475b-b414-00a29dade500 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:06.612481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b65d7b-5cec-475b-b414-00a29dade500 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:06.615520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe4c74-1727-427c-a181-ce5bc388bf31 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:06.616489 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe4c74-1727-427c-a181-ce5bc388bf31 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:06.616887 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe4c74-1727-427c-a181-ce5bc388bf31 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:06.618476 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 82/159] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:41:06.632052 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba23b42-a384-4672-8a34-d36aed9a2f3c None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:06.632052 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba23b42-a384-4672-8a34-d36aed9a2f3c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:06.632052 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba23b42-a384-4672-8a34-d36aed9a2f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:06.633123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b65d7b-5cec-475b-b414-00a29dade500 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:06.641813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-12b65d7b-5cec-475b-b414-00a29dade500 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:41:06.641813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:06.641813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:06.641813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:06.641813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:06.641813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:06.641813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:06.641813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:06.641813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:06.641813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:06.641813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:06.641813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:06.641813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:06.641813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:06.641813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:06.641813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:06.642701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:06.642701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:06.642701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:06.642701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:06.642701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:06.642701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:06.642701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:06.642701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:06.642701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:06.642701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:06.642701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:06.642701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:06.642701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:06.642701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:06.642701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:06.642701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:06.643561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:06.643561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:06.643561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:06.643561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:06.643561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:06.643561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:06.643561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:06.643561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:06.643561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:06.643561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:06.643561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:41:06.643561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:06.647552 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 78/160] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:41:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:06.653105 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b65d7b-5cec-475b-b414-00a29dade500 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:06.662494 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-2ba23b42-a384-4672-8a34-d36aed9a2f3c None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:06.663869 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2ba23b42-a384-4672-8a34-d36aed9a2f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:06.799649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 83/161] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:06.826209 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:06.830885 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b65d7b-5cec-475b-b414-00a29dade500 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:06.837717 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba23b42-a384-4672-8a34-d36aed9a2f3c None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:06.920609 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff83894-f523-4944-beaf-a646774e61f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:06.921270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff83894-f523-4944-beaf-a646774e61f5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:06.921554 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff83894-f523-4944-beaf-a646774e61f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:06.922281 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff83894-f523-4944-beaf-a646774e61f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:06.923327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff83894-f523-4944-beaf-a646774e61f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:06.923641 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff83894-f523-4944-beaf-a646774e61f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:06.925359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff83894-f523-4944-beaf-a646774e61f5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:06.939927 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 79/162] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:06.948782 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff83894-f523-4944-beaf-a646774e61f5 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:07.027430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:07.050152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba23b42-a384-4672-8a34-d36aed9a2f3c None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:07.142814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff83894-f523-4944-beaf-a646774e61f5 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:07.146223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa8400-fa65-4a96-a72e-15506ed3a2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:07.147091 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa8400-fa65-4a96-a72e-15506ed3a2be None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:07.147863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa8400-fa65-4a96-a72e-15506ed3a2be None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:07.148133 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa8400-fa65-4a96-a72e-15506ed3a2be None admin] PATH_INFO: `/v3/roles/member` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:07.171150 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa8400-fa65-4a96-a72e-15506ed3a2be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:07.184010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-adaa8400-fa65-4a96-a72e-15506ed3a2be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:07.184010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:07.184010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:07.184010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:07.184010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:07.184010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:07.184010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:07.184010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:07.184010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:07.184010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:07.184010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:07.184010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:07.184010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:07.184010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:07.184010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:07.184010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:07.184906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:07.184906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:07.184906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:07.184906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:07.184906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:07.184906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:07.184906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:07.184906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:07.184906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:07.184906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:07.184906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:07.184906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:07.184906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:07.184906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:07.184906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:07.184906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:07.185689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:07.185689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:07.185689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:07.185689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:07.185689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:07.185689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:07.185689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:07.185689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:07.185689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:07.185689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:07.185689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:07.185689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:07.185689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 84/163] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:41:07.197607 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa8400-fa65-4a96-a72e-15506ed3a2be None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:07.211452 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84f687-4bb7-488e-9c8e-a143c5d62b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:07.212390 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84f687-4bb7-488e-9c8e-a143c5d62b50 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:07.212725 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84f687-4bb7-488e-9c8e-a143c5d62b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:07.213007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84f687-4bb7-488e-9c8e-a143c5d62b50 None admin] PATH_INFO: `/v3/users/1dacaea933b24b6082a79a2c673ec9f1` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:07.214289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84f687-4bb7-488e-9c8e-a143c5d62b50 None admin] RBAC: Authorizing `identity:get_user(user_id=1dacaea933b24b6082a79a2c673ec9f1)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:07.215756 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84f687-4bb7-488e-9c8e-a143c5d62b50 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:07.217599 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 80/164] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:06 2022] GET /identity/v3/users/1dacaea933b24b6082a79a2c673ec9f1 => generated 247 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:07.223084 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84f687-4bb7-488e-9c8e-a143c5d62b50 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:07.284990 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:07.376532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa8400-fa65-4a96-a72e-15506ed3a2be None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:07.393263 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84f687-4bb7-488e-9c8e-a143c5d62b50 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:07.428696 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d399572-1cc0-4081-b311-710b1be6a0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:07.429449 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d399572-1cc0-4081-b311-710b1be6a0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:07.429741 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d399572-1cc0-4081-b311-710b1be6a0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:07.430160 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d399572-1cc0-4081-b311-710b1be6a0c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:07.430931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d399572-1cc0-4081-b311-710b1be6a0c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:07.431393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d399572-1cc0-4081-b311-710b1be6a0c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:07.432810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d399572-1cc0-4081-b311-710b1be6a0c6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:07.446755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 85/165] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:07.452640 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d399572-1cc0-4081-b311-710b1be6a0c6 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:07.474756 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce393df-b84c-47b4-b59a-964a1a65cabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:07.476007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce393df-b84c-47b4-b59a-964a1a65cabc None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:07.476299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce393df-b84c-47b4-b59a-964a1a65cabc None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:07.476577 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce393df-b84c-47b4-b59a-964a1a65cabc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:07.477499 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:07.605966 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d399572-1cc0-4081-b311-710b1be6a0c6 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:07.654194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce393df-b84c-47b4-b59a-964a1a65cabc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:07.655800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce393df-b84c-47b4-b59a-964a1a65cabc None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:07.656085 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa0f43-5dbb-4279-9926-0824821f9816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:07.656999 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa0f43-5dbb-4279-9926-0824821f9816 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:07.657282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa0f43-5dbb-4279-9926-0824821f9816 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:07.657557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa0f43-5dbb-4279-9926-0824821f9816 None admin] PATH_INFO: `/v3/users/52ebb4f8be97463abd2bc87a56c1e3ca` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:07.660090 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa0f43-5dbb-4279-9926-0824821f9816 None admin] RBAC: Authorizing `identity:get_user(user_id=52ebb4f8be97463abd2bc87a56c1e3ca)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:07.662407 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa0f43-5dbb-4279-9926-0824821f9816 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:07.664138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 86/166] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:07 2022] GET /identity/v3/users/52ebb4f8be97463abd2bc87a56c1e3ca => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:07.669920 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa0f43-5dbb-4279-9926-0824821f9816 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:07.713017 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:07.762188 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:07.814549 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa0f43-5dbb-4279-9926-0824821f9816 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:07.859404 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 81/167] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:07.860800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264f2e3-9bd6-4b23-ab63-093c36750a57 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:07.861093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264f2e3-9bd6-4b23-ab63-093c36750a57 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:07.861374 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264f2e3-9bd6-4b23-ab63-093c36750a57 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:07.862670 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 82/168] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:07.863369 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264f2e3-9bd6-4b23-ab63-093c36750a57 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:07.873880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb364d-e800-4928-9e4e-2a5772f76570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:07.874542 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb364d-e800-4928-9e4e-2a5772f76570 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:07.874827 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb364d-e800-4928-9e4e-2a5772f76570 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:07.875104 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb364d-e800-4928-9e4e-2a5772f76570 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:07.959765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb364d-e800-4928-9e4e-2a5772f76570 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:07.961346 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb364d-e800-4928-9e4e-2a5772f76570 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:08.021072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264f2e3-9bd6-4b23-ab63-093c36750a57 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:08.054453 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:08.068010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef70cb0-77dd-4482-9b1a-58a7c02cc5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:08.069699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef70cb0-77dd-4482-9b1a-58a7c02cc5ae None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:08.070203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef70cb0-77dd-4482-9b1a-58a7c02cc5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:08.070682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef70cb0-77dd-4482-9b1a-58a7c02cc5ae None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:08.072232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef70cb0-77dd-4482-9b1a-58a7c02cc5ae None admin] RBAC: Authorizing `identity:get_project(project_id=3643e64d3f194dc5bef838b26b6bb808)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:08.074022 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef70cb0-77dd-4482-9b1a-58a7c02cc5ae None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:08.076142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 83/169] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:07 2022] GET /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:08.081836 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e1ffe-3ac7-47ed-91a3-47fde879c123 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:08.081836 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e1ffe-3ac7-47ed-91a3-47fde879c123 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:08.081836 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e1ffe-3ac7-47ed-91a3-47fde879c123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:08.095762 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ec3e1ffe-3ac7-47ed-91a3-47fde879c123 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:08.097392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ec3e1ffe-3ac7-47ed-91a3-47fde879c123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:08.117518 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:08.157232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 87/170] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 12:41:08.158627 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e5da9-5d96-4c2c-8cf6-c1a9762cc7b9 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:08.158924 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e5da9-5d96-4c2c-8cf6-c1a9762cc7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:08.159812 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e5da9-5d96-4c2c-8cf6-c1a9762cc7b9 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:08.162334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 88/171] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:08.163243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e5da9-5d96-4c2c-8cf6-c1a9762cc7b9 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:08.231015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 84/172] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:08.231892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e1ffe-3ac7-47ed-91a3-47fde879c123 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:08.332943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e1ffe-3ac7-47ed-91a3-47fde879c123 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:08.361547 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:08.369942 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71df30d-7c6a-48d9-a28d-c7174ef804b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:08.373422 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71df30d-7c6a-48d9-a28d-c7174ef804b0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:08.373422 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71df30d-7c6a-48d9-a28d-c7174ef804b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:08.373422 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71df30d-7c6a-48d9-a28d-c7174ef804b0 None admin] PATH_INFO: `/v3/projects/fb659514b3c54a58bb9176391e18d2eb` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:08.373422 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71df30d-7c6a-48d9-a28d-c7174ef804b0 None admin] RBAC: Authorizing `identity:get_project(project_id=fb659514b3c54a58bb9176391e18d2eb)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:08.374234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e5da9-5d96-4c2c-8cf6-c1a9762cc7b9 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:08.374702 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71df30d-7c6a-48d9-a28d-c7174ef804b0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:08.376932 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 85/173] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:08 2022] GET /identity/v3/projects/fb659514b3c54a58bb9176391e18d2eb => generated 312 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:08.378037 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eaf72-2eae-4f4d-8fbf-24d73154e5e8 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:08.378417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eaf72-2eae-4f4d-8fbf-24d73154e5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:08.378787 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eaf72-2eae-4f4d-8fbf-24d73154e5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:08.409912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a814ef-288b-4c35-894b-0780d33c653c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:08.410582 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a814ef-288b-4c35-894b-0780d33c653c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:08.410863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a814ef-288b-4c35-894b-0780d33c653c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:08.411140 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a814ef-288b-4c35-894b-0780d33c653c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:08.411992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a814ef-288b-4c35-894b-0780d33c653c None admin] RBAC: Adding query filter params (role.id=868c7a356c674ded875dd079f5a9f5e0, scope.project.id=3643e64d3f194dc5bef838b26b6bb808, user.id=1dacaea933b24b6082a79a2c673ec9f1) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:08.412305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a814ef-288b-4c35-894b-0780d33c653c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:08.412851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b32eaf72-2eae-4f4d-8fbf-24d73154e5e8 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:08.413861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a814ef-288b-4c35-894b-0780d33c653c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:08.414051 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b32eaf72-2eae-4f4d-8fbf-24d73154e5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:08.420438 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 89/174] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:41:08 2022] GET /identity/v3/role_assignments?user.id=1dacaea933b24b6082a79a2c673ec9f1&scope.project.id=3643e64d3f194dc5bef838b26b6bb808&role.id=868c7a356c674ded875dd079f5a9f5e0 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:08.421176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a814ef-288b-4c35-894b-0780d33c653c None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:08.470618 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:08.530526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 86/175] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:08.531392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32eaf72-2eae-4f4d-8fbf-24d73154e5e8 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:08.573900 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a814ef-288b-4c35-894b-0780d33c653c None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:08.614070 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a5d71-d4ad-423a-a8b9-b8a14e2ee7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:08.614831 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a5d71-d4ad-423a-a8b9-b8a14e2ee7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:08.615279 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a5d71-d4ad-423a-a8b9-b8a14e2ee7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:08.615556 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a5d71-d4ad-423a-a8b9-b8a14e2ee7f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:08.630741 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a5d71-d4ad-423a-a8b9-b8a14e2ee7f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:08.641533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-f85a5d71-d4ad-423a-a8b9-b8a14e2ee7f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:08.641533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:08.641533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:08.641533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:08.641533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:08.641533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:08.641533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:08.641533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:08.641533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:08.641533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:08.641533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:08.641533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:08.641533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:08.641533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:08.641533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:08.641533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:08.642406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:08.642406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:08.642406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:08.642406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:08.642406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:08.642406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:08.642406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:08.642406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:08.642406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:08.642406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:08.642406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:08.642406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:08.642406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:08.642406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:08.642406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:08.642406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:08.643167 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:08.643167 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:08.643167 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:08.643167 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:08.643167 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:08.643167 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:08.643167 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:08.643167 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:08.643167 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:08.643167 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:08.643167 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:08.643167 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:08.643167 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 90/176] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jul 5 12:41:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:08.644095 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada9eb5-36dc-487e-92fd-a480a2da9ba8 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:08.644261 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada9eb5-36dc-487e-92fd-a480a2da9ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:08.644534 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada9eb5-36dc-487e-92fd-a480a2da9ba8 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:08.646881 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 91/177] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:08.648420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af83f4e-d6c3-4a1a-83f2-f7d3046e0613 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:08.648728 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af83f4e-d6c3-4a1a-83f2-f7d3046e0613 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:08.649006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af83f4e-d6c3-4a1a-83f2-f7d3046e0613 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:08.650369 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 92/178] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:08.655222 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af83f4e-d6c3-4a1a-83f2-f7d3046e0613 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:08.666253 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32eaf72-2eae-4f4d-8fbf-24d73154e5e8 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:08.691450 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:08.709351 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d20a2f-156a-427d-ab33-d71ddf0034de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:08.710573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d20a2f-156a-427d-ab33-d71ddf0034de None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:08.710900 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d20a2f-156a-427d-ab33-d71ddf0034de None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:08.711137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d20a2f-156a-427d-ab33-d71ddf0034de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:08.711989 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d20a2f-156a-427d-ab33-d71ddf0034de None admin] RBAC: Adding query filter params (role.id=66d9c5a190d544b3b3588bbdadf2cf39, scope.project.id=fb659514b3c54a58bb9176391e18d2eb, user.id=52ebb4f8be97463abd2bc87a56c1e3ca) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:08.712302 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d20a2f-156a-427d-ab33-d71ddf0034de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:08.713794 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d20a2f-156a-427d-ab33-d71ddf0034de None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:08.719850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 87/179] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:41:08 2022] GET /identity/v3/role_assignments?user.id=52ebb4f8be97463abd2bc87a56c1e3ca&scope.project.id=fb659514b3c54a58bb9176391e18d2eb&role.id=66d9c5a190d544b3b3588bbdadf2cf39 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:08.721125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057e17e-cb0e-4095-8a81-854afad5ca6e None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:08.721420 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057e17e-cb0e-4095-8a81-854afad5ca6e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:08.721744 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057e17e-cb0e-4095-8a81-854afad5ca6e None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:08.727199 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 88/180] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:08.727199 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb6beb-88d8-4aea-ac0a-0cbb7015043f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:08.727199 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb6beb-88d8-4aea-ac0a-0cbb7015043f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:08.727199 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb6beb-88d8-4aea-ac0a-0cbb7015043f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:08.744761 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-9ecb6beb-88d8-4aea-ac0a-0cbb7015043f None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:08.746015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9ecb6beb-88d8-4aea-ac0a-0cbb7015043f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:08.782835 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af83f4e-d6c3-4a1a-83f2-f7d3046e0613 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:08.785609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:08.824901 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9608c-64e1-4a5e-99e2-4ae8bc4c89bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:08.825746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9608c-64e1-4a5e-99e2-4ae8bc4c89bf None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:08.826025 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9608c-64e1-4a5e-99e2-4ae8bc4c89bf None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:08.826294 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9608c-64e1-4a5e-99e2-4ae8bc4c89bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:08.826585 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 89/181] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:08.827889 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ad1de-5b38-43b6-93fe-fad816fb54c9 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:08.828178 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ad1de-5b38-43b6-93fe-fad816fb54c9 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:08.828464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ad1de-5b38-43b6-93fe-fad816fb54c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:08.845824 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-488ad1de-5b38-43b6-93fe-fad816fb54c9 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:08.847049 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-488ad1de-5b38-43b6-93fe-fad816fb54c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:08.849517 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9608c-64e1-4a5e-99e2-4ae8bc4c89bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:08.860505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-e4c9608c-64e1-4a5e-99e2-4ae8bc4c89bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:41:08.860505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:08.860505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:08.860505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:08.860505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:08.860505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:08.860505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:08.860505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:08.860505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:08.860505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:08.860505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:08.860505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:08.860505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:08.860505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:08.860505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:08.860505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:08.861701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:08.861701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:08.861701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:08.861701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:08.861701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:08.861701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:08.861701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:08.861701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:08.861701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:08.861701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:08.861701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:08.861701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:08.861701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:08.861701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:08.861701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:08.861701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:08.862533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:08.862533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:08.862533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:08.862533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:08.862533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:08.862533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:08.862533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:08.862533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:08.862533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:08.862533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:08.862533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:41:08.862533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:08.862533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 93/182] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:41:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:08.863188 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9608c-64e1-4a5e-99e2-4ae8bc4c89bf None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:08.940913 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 90/183] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:08.942095 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c6ad7-7888-4958-a4ac-ae102b96c2fb None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:08.942386 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c6ad7-7888-4958-a4ac-ae102b96c2fb None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:08.942658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c6ad7-7888-4958-a4ac-ae102b96c2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:08.960834 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-850c6ad7-7888-4958-a4ac-ae102b96c2fb None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:08.962018 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-850c6ad7-7888-4958-a4ac-ae102b96c2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:08.989067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9608c-64e1-4a5e-99e2-4ae8bc4c89bf None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:09.006222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:09.022353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159e370-1232-4a1c-bd5c-213177d0dd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:09.023019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159e370-1232-4a1c-bd5c-213177d0dd37 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:09.023308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159e370-1232-4a1c-bd5c-213177d0dd37 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:09.023586 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159e370-1232-4a1c-bd5c-213177d0dd37 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:09.024337 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159e370-1232-4a1c-bd5c-213177d0dd37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:09.024681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159e370-1232-4a1c-bd5c-213177d0dd37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:09.026086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159e370-1232-4a1c-bd5c-213177d0dd37 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:09.028633 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 91/184] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:09.036762 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c6ad7-7888-4958-a4ac-ae102b96c2fb None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:09.036861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 94/185] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:41:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:09.036861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159e370-1232-4a1c-bd5c-213177d0dd37 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:09.067142 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:09.132173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c6ad7-7888-4958-a4ac-ae102b96c2fb None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:09.138082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159e370-1232-4a1c-bd5c-213177d0dd37 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:09.165791 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3886a8c-77a5-46e3-976c-5f386949d00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:09.166613 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3886a8c-77a5-46e3-976c-5f386949d00a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:09.166884 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3886a8c-77a5-46e3-976c-5f386949d00a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:09.167165 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3886a8c-77a5-46e3-976c-5f386949d00a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:09.170827 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f095e1-463c-40bc-bb2e-ad42588fbbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:09.171485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f095e1-463c-40bc-bb2e-ad42588fbbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:09.171763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f095e1-463c-40bc-bb2e-ad42588fbbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:09.172034 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f095e1-463c-40bc-bb2e-ad42588fbbd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:09.172808 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f095e1-463c-40bc-bb2e-ad42588fbbd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:09.173109 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f095e1-463c-40bc-bb2e-ad42588fbbd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:09.174497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f095e1-463c-40bc-bb2e-ad42588fbbd2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:09.177304 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3886a8c-77a5-46e3-976c-5f386949d00a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:09.182971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 95/186] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:09.183749 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f095e1-463c-40bc-bb2e-ad42588fbbd2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:09.185833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-a3886a8c-77a5-46e3-976c-5f386949d00a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:09.185833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:09.185833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:09.185833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:09.185833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:09.185833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:09.185833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:09.185833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:09.185833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:09.185833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:09.185833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:09.185833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:09.185833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:09.185833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:09.185833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:09.185833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:09.186705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:09.186705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:09.186705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:09.186705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:09.186705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:09.186705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:09.186705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:09.186705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:09.186705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:09.186705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:09.186705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:09.186705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:09.186705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:09.186705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:09.186705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:09.186705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:09.188152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:09.188152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:09.188152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:09.188152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:09.188152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:09.188152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:09.188152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:09.188152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:09.188152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:09.188152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:09.188152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:09.188152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:09.188152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 92/187] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jul 5 12:41:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:09.188152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3886a8c-77a5-46e3-976c-5f386949d00a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:09.227769 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:09.273634 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:09.284993 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f095e1-463c-40bc-bb2e-ad42588fbbd2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:09.285691 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3886a8c-77a5-46e3-976c-5f386949d00a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:09.318335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619dce4d-412b-4553-bda4-ad2370490003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:09.319289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96880c1e-f74d-4a89-b6f1-dec328103d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:09.319702 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619dce4d-412b-4553-bda4-ad2370490003 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:09.319983 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619dce4d-412b-4553-bda4-ad2370490003 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:09.320115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96880c1e-f74d-4a89-b6f1-dec328103d13 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:09.320255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619dce4d-412b-4553-bda4-ad2370490003 None admin] PATH_INFO: `/v3/users/52ebb4f8be97463abd2bc87a56c1e3ca` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:09.320400 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96880c1e-f74d-4a89-b6f1-dec328103d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:09.320710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96880c1e-f74d-4a89-b6f1-dec328103d13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:09.321568 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619dce4d-412b-4553-bda4-ad2370490003 None admin] RBAC: Authorizing `identity:get_user(user_id=52ebb4f8be97463abd2bc87a56c1e3ca)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:09.321869 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96880c1e-f74d-4a89-b6f1-dec328103d13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:09.323019 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619dce4d-412b-4553-bda4-ad2370490003 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:09.323306 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96880c1e-f74d-4a89-b6f1-dec328103d13 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:09.324681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 93/188] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:09 2022] GET /identity/v3/users/52ebb4f8be97463abd2bc87a56c1e3ca => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:09.325112 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 96/189] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:09.325447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619dce4d-412b-4553-bda4-ad2370490003 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:09.329413 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96880c1e-f74d-4a89-b6f1-dec328103d13 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:09.426030 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96880c1e-f74d-4a89-b6f1-dec328103d13 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:09.426657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619dce4d-412b-4553-bda4-ad2370490003 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:09.433543 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:09.460481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad28c3-bb4a-4c42-b0eb-51acea9a5c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:09.461297 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad28c3-bb4a-4c42-b0eb-51acea9a5c05 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:09.461407 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62744f4-0b9d-4e38-97b6-20da0cc00640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:09.461584 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad28c3-bb4a-4c42-b0eb-51acea9a5c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:09.461857 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad28c3-bb4a-4c42-b0eb-51acea9a5c05 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:09.462313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62744f4-0b9d-4e38-97b6-20da0cc00640 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:09.462599 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62744f4-0b9d-4e38-97b6-20da0cc00640 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:09.462876 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62744f4-0b9d-4e38-97b6-20da0cc00640 None admin] PATH_INFO: `/v3/users/ea3d250455814500ba0ebe26e648d3b2` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:09.472603 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad28c3-bb4a-4c42-b0eb-51acea9a5c05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:09.476341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62744f4-0b9d-4e38-97b6-20da0cc00640 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3d250455814500ba0ebe26e648d3b2)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:09.477899 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62744f4-0b9d-4e38-97b6-20da0cc00640 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:09.479512 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 97/190] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:09 2022] GET /identity/v3/users/ea3d250455814500ba0ebe26e648d3b2 => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:09.480282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62744f4-0b9d-4e38-97b6-20da0cc00640 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:09.480694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-b0ad28c3-bb4a-4c42-b0eb-51acea9a5c05 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:41:09.480694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:09.480694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:09.480694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:09.480694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:09.480694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:09.480694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:09.480694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:09.480694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:09.480694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:09.480694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:09.480694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:09.480694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:09.480694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:09.480694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:09.480694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:09.481571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:09.481571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:09.481571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:09.481571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:09.481571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:09.481571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:09.481571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:09.481571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:09.481571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:09.481571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:09.481571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:09.481571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:09.481571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:09.481571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:09.481571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:09.481571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:09.482363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:09.482363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:09.482363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:09.482363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:09.482363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:09.482363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:09.482363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:09.482363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:09.482363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:09.482363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:09.482363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:41:09.482363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:09.482363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 94/191] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:09.483022 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad28c3-bb4a-4c42-b0eb-51acea9a5c05 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:09.498888 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:09.581688 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad28c3-bb4a-4c42-b0eb-51acea9a5c05 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:09.583893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62744f4-0b9d-4e38-97b6-20da0cc00640 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:09.614627 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f133cd-43e0-48aa-add3-716298ee216e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:09.615300 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f133cd-43e0-48aa-add3-716298ee216e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:09.615586 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f133cd-43e0-48aa-add3-716298ee216e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:09.616427 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f133cd-43e0-48aa-add3-716298ee216e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:09.618412 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa36e3-722c-4b07-9546-fc8159a893d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:09.619078 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa36e3-722c-4b07-9546-fc8159a893d9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:09.619356 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa36e3-722c-4b07-9546-fc8159a893d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:09.619627 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa36e3-722c-4b07-9546-fc8159a893d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:09.620378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa36e3-722c-4b07-9546-fc8159a893d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:09.620709 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa36e3-722c-4b07-9546-fc8159a893d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:09.622099 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa36e3-722c-4b07-9546-fc8159a893d9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:09.629922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 98/192] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:41:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:09.630686 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa36e3-722c-4b07-9546-fc8159a893d9 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:09.653928 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:09.688280 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f133cd-43e0-48aa-add3-716298ee216e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:09.689822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f133cd-43e0-48aa-add3-716298ee216e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:09.706691 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:09.729596 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa36e3-722c-4b07-9546-fc8159a893d9 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:09.763307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019aede-a364-4b28-91be-d8316c5d6aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:09.763979 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019aede-a364-4b28-91be-d8316c5d6aac None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:09.764264 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019aede-a364-4b28-91be-d8316c5d6aac None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:09.764544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019aede-a364-4b28-91be-d8316c5d6aac None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:09.765290 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019aede-a364-4b28-91be-d8316c5d6aac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:09.766778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019aede-a364-4b28-91be-d8316c5d6aac None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:09.789137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 95/193] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:09.789983 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f133cd-43e0-48aa-add3-716298ee216e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:09.852848 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:09.884475 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 99/194] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jul 5 12:41:09 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:41:09.885588 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019aede-a364-4b28-91be-d8316c5d6aac None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:09.888679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f133cd-43e0-48aa-add3-716298ee216e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:09.931849 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bd775-e63d-4852-929b-4f07860f3bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:09.932525 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bd775-e63d-4852-929b-4f07860f3bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:09.932874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bd775-e63d-4852-929b-4f07860f3bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:09.933182 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bd775-e63d-4852-929b-4f07860f3bf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:10.008546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8bd775-e63d-4852-929b-4f07860f3bf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:10.008753 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019aede-a364-4b28-91be-d8316c5d6aac None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:10.010011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8bd775-e63d-4852-929b-4f07860f3bf2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:10.042538 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:10.050067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb9347-a7c6-4a4a-b0c2-60fd9ef56512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:10.050854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb9347-a7c6-4a4a-b0c2-60fd9ef56512 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:10.051136 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb9347-a7c6-4a4a-b0c2-60fd9ef56512 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:10.051417 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb9347-a7c6-4a4a-b0c2-60fd9ef56512 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:10.052647 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb9347-a7c6-4a4a-b0c2-60fd9ef56512 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:10.052647 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb9347-a7c6-4a4a-b0c2-60fd9ef56512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:10.056392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb9347-a7c6-4a4a-b0c2-60fd9ef56512 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:10.068049 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 100/195] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:10.069824 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb9347-a7c6-4a4a-b0c2-60fd9ef56512 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:10.082903 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:10.127798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 96/196] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:10.129489 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bd775-e63d-4852-929b-4f07860f3bf2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:10.195395 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb9347-a7c6-4a4a-b0c2-60fd9ef56512 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:10.236573 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeb307-2873-4f3d-85b6-289b77479950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:10.237649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeb307-2873-4f3d-85b6-289b77479950 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:10.237932 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeb307-2873-4f3d-85b6-289b77479950 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:10.238238 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeb307-2873-4f3d-85b6-289b77479950 None admin] PATH_INFO: `/v3/users/ea3d250455814500ba0ebe26e648d3b2` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:10.239478 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eeb307-2873-4f3d-85b6-289b77479950 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3d250455814500ba0ebe26e648d3b2)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:10.241148 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eeb307-2873-4f3d-85b6-289b77479950 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:10.243161 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 101/197] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:10 2022] GET /identity/v3/users/ea3d250455814500ba0ebe26e648d3b2 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:10.243984 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeb307-2873-4f3d-85b6-289b77479950 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:10.277548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bd775-e63d-4852-929b-4f07860f3bf2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:10.315900 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:10.321451 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb16d0-ab4a-4971-a608-5385950f5cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:10.323182 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb16d0-ab4a-4971-a608-5385950f5cea None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:10.323937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb16d0-ab4a-4971-a608-5385950f5cea None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:10.324384 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb16d0-ab4a-4971-a608-5385950f5cea None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:10.326800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb16d0-ab4a-4971-a608-5385950f5cea None admin] RBAC: Authorizing `identity:get_project(project_id=3643e64d3f194dc5bef838b26b6bb808)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:10.328659 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb16d0-ab4a-4971-a608-5385950f5cea None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:10.330813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 97/198] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:10 2022] GET /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:10.332377 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb16d0-ab4a-4971-a608-5385950f5cea None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:10.359896 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeb307-2873-4f3d-85b6-289b77479950 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:10.377488 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:10.398264 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a55f1c-00b6-4963-b2e0-75534daddb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:10.399188 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55f1c-00b6-4963-b2e0-75534daddb72 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:10.399480 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55f1c-00b6-4963-b2e0-75534daddb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:10.399896 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55f1c-00b6-4963-b2e0-75534daddb72 None admin] PATH_INFO: `/v3/users/1194063dba364142993c89675145e4ac` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:10.400980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a55f1c-00b6-4963-b2e0-75534daddb72 None admin] RBAC: Authorizing `identity:get_user(user_id=1194063dba364142993c89675145e4ac)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:10.402508 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a55f1c-00b6-4963-b2e0-75534daddb72 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:10.404268 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 102/199] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:10 2022] GET /identity/v3/users/1194063dba364142993c89675145e4ac => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:10.409459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a55f1c-00b6-4963-b2e0-75534daddb72 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:10.464760 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb16d0-ab4a-4971-a608-5385950f5cea None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:10.502880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12666b-4d19-4021-b650-65204a1845d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:10.503757 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12666b-4d19-4021-b650-65204a1845d2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:10.504041 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12666b-4d19-4021-b650-65204a1845d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:10.504363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12666b-4d19-4021-b650-65204a1845d2 None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:10.506081 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12666b-4d19-4021-b650-65204a1845d2 None admin] RBAC: Authorizing `identity:get_project(project_id=769c25d7cd5442f3a9359fa294a9befe)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:10.507589 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12666b-4d19-4021-b650-65204a1845d2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:10.509567 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 98/200] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:10 2022] GET /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:10.510216 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12666b-4d19-4021-b650-65204a1845d2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:10.561624 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a55f1c-00b6-4963-b2e0-75534daddb72 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:10.611189 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:10.619377 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebd072-2920-4065-97d8-c50ece6beb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:10.625739 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebd072-2920-4065-97d8-c50ece6beb99 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:10.625739 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebd072-2920-4065-97d8-c50ece6beb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:10.625739 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebd072-2920-4065-97d8-c50ece6beb99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:10.625980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12666b-4d19-4021-b650-65204a1845d2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:10.625980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:10.658280 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d10a3-e7c9-4ac0-87a5-a9ac609cdc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:10.659005 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d10a3-e7c9-4ac0-87a5-a9ac609cdc8f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:10.659328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d10a3-e7c9-4ac0-87a5-a9ac609cdc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:10.659668 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d10a3-e7c9-4ac0-87a5-a9ac609cdc8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:10.660630 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d10a3-e7c9-4ac0-87a5-a9ac609cdc8f None admin] RBAC: Adding query filter params (role.id=5ea7d4a868fb49b8992c3adb30476789, scope.project.id=3643e64d3f194dc5bef838b26b6bb808, user.id=52ebb4f8be97463abd2bc87a56c1e3ca) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:10.660943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d10a3-e7c9-4ac0-87a5-a9ac609cdc8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:10.663183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d10a3-e7c9-4ac0-87a5-a9ac609cdc8f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:10.669862 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 99/201] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:41:10 2022] GET /identity/v3/role_assignments?user.id=52ebb4f8be97463abd2bc87a56c1e3ca&scope.project.id=3643e64d3f194dc5bef838b26b6bb808&role.id=5ea7d4a868fb49b8992c3adb30476789 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:10.671879 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d10a3-e7c9-4ac0-87a5-a9ac609cdc8f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:10.716199 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ebd072-2920-4065-97d8-c50ece6beb99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:10.718122 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ebd072-2920-4065-97d8-c50ece6beb99 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:10.801530 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d10a3-e7c9-4ac0-87a5-a9ac609cdc8f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:10.839436 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 103/202] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:10.841161 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebd072-2920-4065-97d8-c50ece6beb99 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:10.863243 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7adaf-244f-4476-b236-81fac24357e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:10.863989 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7adaf-244f-4476-b236-81fac24357e3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:10.864379 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7adaf-244f-4476-b236-81fac24357e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:10.864774 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7adaf-244f-4476-b236-81fac24357e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:10.886084 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:10.942217 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:10.980609 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7adaf-244f-4476-b236-81fac24357e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:10.982423 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7adaf-244f-4476-b236-81fac24357e3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:10.985961 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebd072-2920-4065-97d8-c50ece6beb99 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:11.021137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c00ac-1c3c-43e1-8b97-89f1111c0824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:11.021802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c00ac-1c3c-43e1-8b97-89f1111c0824 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:11.022116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c00ac-1c3c-43e1-8b97-89f1111c0824 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:11.022396 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c00ac-1c3c-43e1-8b97-89f1111c0824 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:11.023231 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c00ac-1c3c-43e1-8b97-89f1111c0824 None admin] RBAC: Adding query filter params (role.id=868c7a356c674ded875dd079f5a9f5e0, scope.project.id=769c25d7cd5442f3a9359fa294a9befe, user.id=ea3d250455814500ba0ebe26e648d3b2) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:11.023543 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c00ac-1c3c-43e1-8b97-89f1111c0824 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:11.025011 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c00ac-1c3c-43e1-8b97-89f1111c0824 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:11.031054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 104/203] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:41:10 2022] GET /identity/v3/role_assignments?user.id=ea3d250455814500ba0ebe26e648d3b2&scope.project.id=769c25d7cd5442f3a9359fa294a9befe&role.id=868c7a356c674ded875dd079f5a9f5e0 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:11.031695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c00ac-1c3c-43e1-8b97-89f1111c0824 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:11.096270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 100/204] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:11.105256 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7adaf-244f-4476-b236-81fac24357e3 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:11.142067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:11.149958 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c00ac-1c3c-43e1-8b97-89f1111c0824 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:11.189989 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1ddc0-6d9c-494b-bd35-32d7c0e03bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:11.190908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1ddc0-6d9c-494b-bd35-32d7c0e03bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:11.191187 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1ddc0-6d9c-494b-bd35-32d7c0e03bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:11.191464 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1ddc0-6d9c-494b-bd35-32d7c0e03bf8 None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:11.194626 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1ddc0-6d9c-494b-bd35-32d7c0e03bf8 None admin] RBAC: Authorizing `identity:get_project(project_id=769c25d7cd5442f3a9359fa294a9befe)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:11.196152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1ddc0-6d9c-494b-bd35-32d7c0e03bf8 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:11.199091 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 105/205] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:11 2022] GET /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:11.205632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1ddc0-6d9c-494b-bd35-32d7c0e03bf8 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:11.213277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:11.293705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7adaf-244f-4476-b236-81fac24357e3 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:11.342108 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789de4c3-d9f3-4a03-a4f5-81b0d6d7c9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:11.342982 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789de4c3-d9f3-4a03-a4f5-81b0d6d7c9be None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:11.343267 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789de4c3-d9f3-4a03-a4f5-81b0d6d7c9be None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:11.343547 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789de4c3-d9f3-4a03-a4f5-81b0d6d7c9be None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:11.344793 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789de4c3-d9f3-4a03-a4f5-81b0d6d7c9be None admin] RBAC: Authorizing `identity:get_project(project_id=3643e64d3f194dc5bef838b26b6bb808)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:11.346777 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789de4c3-d9f3-4a03-a4f5-81b0d6d7c9be None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:11.348551 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 101/206] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:11 2022] GET /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:11.356293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789de4c3-d9f3-4a03-a4f5-81b0d6d7c9be None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:11.440071 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1ddc0-6d9c-494b-bd35-32d7c0e03bf8 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:11.505247 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e05eb-3bdf-4121-9e8c-f3f6b12ffe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:11.506798 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e05eb-3bdf-4121-9e8c-f3f6b12ffe8f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:11.507306 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e05eb-3bdf-4121-9e8c-f3f6b12ffe8f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:11.507792 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e05eb-3bdf-4121-9e8c-f3f6b12ffe8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:11.508862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e05eb-3bdf-4121-9e8c-f3f6b12ffe8f None admin] RBAC: Adding query filter params (role.id=5ea7d4a868fb49b8992c3adb30476789, scope.project.id=769c25d7cd5442f3a9359fa294a9befe, user.id=ea3d250455814500ba0ebe26e648d3b2) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:11.509384 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e05eb-3bdf-4121-9e8c-f3f6b12ffe8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:11.511097 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e05eb-3bdf-4121-9e8c-f3f6b12ffe8f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:11.519480 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 106/207] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:41:11 2022] GET /identity/v3/role_assignments?user.id=ea3d250455814500ba0ebe26e648d3b2&scope.project.id=769c25d7cd5442f3a9359fa294a9befe&role.id=5ea7d4a868fb49b8992c3adb30476789 => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:11.533191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789de4c3-d9f3-4a03-a4f5-81b0d6d7c9be None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:11.586721 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c437c1-6ab0-4ecc-ba12-723540c937a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:11.587405 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c437c1-6ab0-4ecc-ba12-723540c937a2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:11.587694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c437c1-6ab0-4ecc-ba12-723540c937a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:11.587974 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c437c1-6ab0-4ecc-ba12-723540c937a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:11.588869 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c437c1-6ab0-4ecc-ba12-723540c937a2 None admin] RBAC: Adding query filter params (role.id=fcf1354e3e794c0297def593c19f0a76, scope.project.id=3643e64d3f194dc5bef838b26b6bb808, user.id=1194063dba364142993c89675145e4ac) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:11.589187 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c437c1-6ab0-4ecc-ba12-723540c937a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:11.590694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c437c1-6ab0-4ecc-ba12-723540c937a2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:11.592884 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:11.610842 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 102/208] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:41:11 2022] GET /identity/v3/role_assignments?user.id=1194063dba364142993c89675145e4ac&scope.project.id=3643e64d3f194dc5bef838b26b6bb808&role.id=fcf1354e3e794c0297def593c19f0a76 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:12.233931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314c4e2-10ec-4caf-ba6b-b8144662f8d2 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:12.234618 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314c4e2-10ec-4caf-ba6b-b8144662f8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:12.234808 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314c4e2-10ec-4caf-ba6b-b8144662f8d2 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:12.236379 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 107/209] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:12.242879 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a1a3d-3f95-417c-920d-04758f92a330 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:12.243173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a1a3d-3f95-417c-920d-04758f92a330 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:12.243458 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a1a3d-3f95-417c-920d-04758f92a330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:12.266991 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-9a9a1a3d-3f95-417c-920d-04758f92a330 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:12.268200 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9a9a1a3d-3f95-417c-920d-04758f92a330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:12.314820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d4d0d-d9bb-4bc3-b94b-b2e8a49fb2d9 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:12.315097 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d4d0d-d9bb-4bc3-b94b-b2e8a49fb2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:12.315306 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d4d0d-d9bb-4bc3-b94b-b2e8a49fb2d9 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:12.316845 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 108/210] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:12.321820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a2ab4-482f-406b-b96c-47969b6a6204 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:12.322109 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a2ab4-482f-406b-b96c-47969b6a6204 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:12.322391 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a2ab4-482f-406b-b96c-47969b6a6204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:12.339253 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-cd5a2ab4-482f-406b-b96c-47969b6a6204 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:12.340454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-cd5a2ab4-482f-406b-b96c-47969b6a6204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:12.348351 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 103/211] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:12.362465 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:12.379765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a1a3d-3f95-417c-920d-04758f92a330 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:12.424731 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 109/212] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:41:12.447931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a2ab4-482f-406b-b96c-47969b6a6204 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:12.491197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a1a3d-3f95-417c-920d-04758f92a330 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:12.520347 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:12.529358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0a0c0-25fc-4056-a0e2-fc3e661b11b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:12.530430 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0a0c0-25fc-4056-a0e2-fc3e661b11b7 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:12.530860 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0a0c0-25fc-4056-a0e2-fc3e661b11b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:12.531284 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0a0c0-25fc-4056-a0e2-fc3e661b11b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:12.548193 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0a0c0-25fc-4056-a0e2-fc3e661b11b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:12.557847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-1ad0a0c0-25fc-4056-a0e2-fc3e661b11b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:12.557847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:12.557847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:12.557847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:12.557847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:12.557847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:12.557847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:12.557847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:12.557847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:12.557847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:12.557847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:12.557847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:12.557847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:12.557847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:12.557847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:12.557847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:12.558947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:12.558947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:12.558947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:12.558947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:12.558947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:12.558947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:12.558947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:12.558947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:12.558947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:12.558947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:12.558947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:12.558947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:12.558947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:12.558947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:12.558947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:12.558947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:12.559837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:12.559837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:12.559837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:12.559837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:12.559837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:12.559837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:12.559837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:12.559837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:12.559837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:12.559837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:12.559837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:12.559837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:12.562727 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 104/213] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:41:12.569881 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0a0c0-25fc-4056-a0e2-fc3e661b11b7 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:12.575414 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a2ab4-482f-406b-b96c-47969b6a6204 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:12.614094 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7274de6-4511-4201-a354-de871d64ec31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:12.615195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7274de6-4511-4201-a354-de871d64ec31 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:12.615705 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7274de6-4511-4201-a354-de871d64ec31 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:12.616176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7274de6-4511-4201-a354-de871d64ec31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:12.617567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7274de6-4511-4201-a354-de871d64ec31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:12.619366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7274de6-4511-4201-a354-de871d64ec31 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:12.621317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 110/214] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:12.626774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7274de6-4511-4201-a354-de871d64ec31 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:12.660927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:12.700998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0a0c0-25fc-4056-a0e2-fc3e661b11b7 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:12.738851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103f8ce-9418-4a7c-aef2-8bca1e54bfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:12.739871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103f8ce-9418-4a7c-aef2-8bca1e54bfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:12.740393 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103f8ce-9418-4a7c-aef2-8bca1e54bfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:12.740929 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103f8ce-9418-4a7c-aef2-8bca1e54bfc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:12.741859 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103f8ce-9418-4a7c-aef2-8bca1e54bfc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:12.742333 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103f8ce-9418-4a7c-aef2-8bca1e54bfc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:12.743490 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7274de6-4511-4201-a354-de871d64ec31 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:12.744033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103f8ce-9418-4a7c-aef2-8bca1e54bfc2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:12.753470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 105/215] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:12.759034 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103f8ce-9418-4a7c-aef2-8bca1e54bfc2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:12.790098 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce71947-a465-474e-a9b3-7c52ea1cc2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:12.790816 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce71947-a465-474e-a9b3-7c52ea1cc2f5 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:12.791100 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce71947-a465-474e-a9b3-7c52ea1cc2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:12.791379 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce71947-a465-474e-a9b3-7c52ea1cc2f5 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:12.792373 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce71947-a465-474e-a9b3-7c52ea1cc2f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:12.794625 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce71947-a465-474e-a9b3-7c52ea1cc2f5 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:12.824049 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:12.878080 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103f8ce-9418-4a7c-aef2-8bca1e54bfc2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:12.915083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7815d-abe5-4909-9dd8-8a488d5f1eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:12.917037 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7815d-abe5-4909-9dd8-8a488d5f1eca None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:12.921006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7815d-abe5-4909-9dd8-8a488d5f1eca None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:12.921006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7815d-abe5-4909-9dd8-8a488d5f1eca None admin] PATH_INFO: `/v3/users/ff5a5fddbe75489689a492e5177fcb6c` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:12.925303 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 111/216] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jul 5 12:41:12 2022] POST /identity/v3/users => generated 297 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:41:12.942941 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7815d-abe5-4909-9dd8-8a488d5f1eca None admin] RBAC: Authorizing `identity:get_user(user_id=ff5a5fddbe75489689a492e5177fcb6c)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:12.945054 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7815d-abe5-4909-9dd8-8a488d5f1eca None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:12.947321 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 106/217] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:12 2022] GET /identity/v3/users/ff5a5fddbe75489689a492e5177fcb6c => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:12.954722 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce71947-a465-474e-a9b3-7c52ea1cc2f5 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:13.049040 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:13.074746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce71947-a465-474e-a9b3-7c52ea1cc2f5 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:13.114756 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d1682-3831-46b8-a49c-6eed4408e03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:13.115797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d1682-3831-46b8-a49c-6eed4408e03a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:13.116292 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d1682-3831-46b8-a49c-6eed4408e03a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:13.116792 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d1682-3831-46b8-a49c-6eed4408e03a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:13.187338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d1682-3831-46b8-a49c-6eed4408e03a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:13.189278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d1682-3831-46b8-a49c-6eed4408e03a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:13.276196 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:13.301640 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 112/218] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:13.309581 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7815d-abe5-4909-9dd8-8a488d5f1eca None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:13.405034 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026fc54-6a8f-4989-beee-dddd7be2edbf None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:13.405324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026fc54-6a8f-4989-beee-dddd7be2edbf None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:13.405513 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026fc54-6a8f-4989-beee-dddd7be2edbf None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:13.408782 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 113/219] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:41:13.413396 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b7f0d-45df-4200-b5e3-4f1f04ac24b9 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:13.413685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b7f0d-45df-4200-b5e3-4f1f04ac24b9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:13.414134 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b7f0d-45df-4200-b5e3-4f1f04ac24b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:13.434109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7815d-abe5-4909-9dd8-8a488d5f1eca None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:13.435972 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-036b7f0d-45df-4200-b5e3-4f1f04ac24b9 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:13.438131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-036b7f0d-45df-4200-b5e3-4f1f04ac24b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:13.445068 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:13.471208 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54109c34-362c-45ff-a07e-89e3c2a92869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:13.472069 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54109c34-362c-45ff-a07e-89e3c2a92869 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:13.472351 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54109c34-362c-45ff-a07e-89e3c2a92869 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:13.472674 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54109c34-362c-45ff-a07e-89e3c2a92869 None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:13.473874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54109c34-362c-45ff-a07e-89e3c2a92869 None admin] RBAC: Authorizing `identity:get_project(project_id=769c25d7cd5442f3a9359fa294a9befe)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:13.475602 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54109c34-362c-45ff-a07e-89e3c2a92869 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:13.477339 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 107/220] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:13 2022] GET /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:13.483126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54109c34-362c-45ff-a07e-89e3c2a92869 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:13.530847 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 114/221] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:41:13.626006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b7f0d-45df-4200-b5e3-4f1f04ac24b9 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:13.640246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54109c34-362c-45ff-a07e-89e3c2a92869 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:13.706906 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1547f25-15bf-43f1-b0c7-a8efe737e4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:13.707485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1547f25-15bf-43f1-b0c7-a8efe737e4ef None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:13.707770 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1547f25-15bf-43f1-b0c7-a8efe737e4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:13.708044 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1547f25-15bf-43f1-b0c7-a8efe737e4ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:13.708912 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1547f25-15bf-43f1-b0c7-a8efe737e4ef None admin] RBAC: Adding query filter params (role.id=66d9c5a190d544b3b3588bbdadf2cf39, scope.project.id=769c25d7cd5442f3a9359fa294a9befe, user.id=ff5a5fddbe75489689a492e5177fcb6c) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:13.712513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1547f25-15bf-43f1-b0c7-a8efe737e4ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:13.717069 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1547f25-15bf-43f1-b0c7-a8efe737e4ef None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:13.730897 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 108/222] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:41:13 2022] GET /identity/v3/role_assignments?user.id=ff5a5fddbe75489689a492e5177fcb6c&scope.project.id=769c25d7cd5442f3a9359fa294a9befe&role.id=66d9c5a190d544b3b3588bbdadf2cf39 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:13.756775 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7878c-e481-40f2-81fa-b0725be7166d None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:13.757466 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7878c-e481-40f2-81fa-b0725be7166d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:13.757909 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7878c-e481-40f2-81fa-b0725be7166d None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:13.759603 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 109/223] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:41:13.765264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173acb1-8c8a-40ac-a812-51abcd54afc3 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:13.765590 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173acb1-8c8a-40ac-a812-51abcd54afc3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:13.765851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173acb1-8c8a-40ac-a812-51abcd54afc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:13.786481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b7f0d-45df-4200-b5e3-4f1f04ac24b9 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:13.799274 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:13.805808 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2173acb1-8c8a-40ac-a812-51abcd54afc3 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:13.807134 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2173acb1-8c8a-40ac-a812-51abcd54afc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:13.835567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32678f82-937b-4356-b109-45eaa78c8f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:13.836390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32678f82-937b-4356-b109-45eaa78c8f6f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:13.836696 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32678f82-937b-4356-b109-45eaa78c8f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:13.836974 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32678f82-937b-4356-b109-45eaa78c8f6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:13.863528 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32678f82-937b-4356-b109-45eaa78c8f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:13.877442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-32678f82-937b-4356-b109-45eaa78c8f6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:41:13.877442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:13.877442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:13.877442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:13.877442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:13.877442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:13.877442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:13.877442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:13.877442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:13.877442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:13.877442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:13.877442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:13.877442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:13.877442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:13.877442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:13.877442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:13.878427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:13.878427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:13.878427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:13.878427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:13.878427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:13.878427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:13.878427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:13.878427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:13.878427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:13.878427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:13.878427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:13.878427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:13.878427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:13.878427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:13.878427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:13.878427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:13.879206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:13.879206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:13.879206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:13.879206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:13.879206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:13.879206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:13.879206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:13.879206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:13.879206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:13.879206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:13.879206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:41:13.879206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:13.879808 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 115/224] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:41:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:41:13.889717 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32678f82-937b-4356-b109-45eaa78c8f6f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:13.906532 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:13.958142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 110/225] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:41:13.997066 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173acb1-8c8a-40ac-a812-51abcd54afc3 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:14.009823 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32678f82-937b-4356-b109-45eaa78c8f6f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:14.044883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bda56-42ff-4fc9-b8e4-2be03a56d7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:14.045567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bda56-42ff-4fc9-b8e4-2be03a56d7ca None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:14.045851 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bda56-42ff-4fc9-b8e4-2be03a56d7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:14.046128 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bda56-42ff-4fc9-b8e4-2be03a56d7ca None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:14.046886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163bda56-42ff-4fc9-b8e4-2be03a56d7ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:14.047196 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163bda56-42ff-4fc9-b8e4-2be03a56d7ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:14.052609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163bda56-42ff-4fc9-b8e4-2be03a56d7ca None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:14.059053 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 116/226] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:14.064721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bda56-42ff-4fc9-b8e4-2be03a56d7ca None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:14.098338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:14.177053 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bda56-42ff-4fc9-b8e4-2be03a56d7ca None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:14.214548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d0218-44d8-47f7-b566-e30767510b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:14.215524 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d0218-44d8-47f7-b566-e30767510b52 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:14.215898 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d0218-44d8-47f7-b566-e30767510b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:14.216268 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d0218-44d8-47f7-b566-e30767510b52 None admin] PATH_INFO: `/v3/users/ea3d250455814500ba0ebe26e648d3b2` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:14.217651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d0218-44d8-47f7-b566-e30767510b52 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3d250455814500ba0ebe26e648d3b2)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:14.219680 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d0218-44d8-47f7-b566-e30767510b52 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:14.221446 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 117/227] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:14 2022] GET /identity/v3/users/ea3d250455814500ba0ebe26e648d3b2 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:14.227200 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d0218-44d8-47f7-b566-e30767510b52 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:14.280501 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173acb1-8c8a-40ac-a812-51abcd54afc3 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:14.337289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d0218-44d8-47f7-b566-e30767510b52 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:14.348918 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:14.370214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0859c-9ba3-4e2e-97e0-a6d0de4b9aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:14.371240 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0859c-9ba3-4e2e-97e0-a6d0de4b9aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:14.371528 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0859c-9ba3-4e2e-97e0-a6d0de4b9aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:14.371898 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0859c-9ba3-4e2e-97e0-a6d0de4b9aa2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:14.374537 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac528e-6626-48f2-a439-034967cdf1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:14.375871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac528e-6626-48f2-a439-034967cdf1af None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:14.376252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac528e-6626-48f2-a439-034967cdf1af None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:14.376662 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac528e-6626-48f2-a439-034967cdf1af None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:14.378017 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac528e-6626-48f2-a439-034967cdf1af None admin] RBAC: Authorizing `identity:get_project(project_id=769c25d7cd5442f3a9359fa294a9befe)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:14.379764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac528e-6626-48f2-a439-034967cdf1af None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:14.382375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 118/228] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:14 2022] GET /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:14.388008 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac528e-6626-48f2-a439-034967cdf1af None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:14.405264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0859c-9ba3-4e2e-97e0-a6d0de4b9aa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:14.413446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-62d0859c-9ba3-4e2e-97e0-a6d0de4b9aa2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:14.413446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:14.413446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:14.413446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:14.413446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:14.413446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:14.413446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:14.413446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:14.413446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:14.413446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:14.413446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:14.413446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:14.413446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:14.413446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:14.413446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:14.413446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:14.414527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:14.414527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:14.414527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:14.414527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:14.414527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:14.414527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:14.414527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:14.414527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:14.414527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:14.414527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:14.414527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:14.414527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:14.414527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:14.414527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:14.414527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:14.414527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:14.415880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:14.415880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:14.415880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:14.415880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:14.415880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:14.415880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:14.415880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:14.415880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:14.415880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:14.415880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:14.415880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:14.415880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:14.422242 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 111/229] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jul 5 12:41:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:41:14.429538 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0859c-9ba3-4e2e-97e0-a6d0de4b9aa2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:14.497174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac528e-6626-48f2-a439-034967cdf1af None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:14.534404 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:14.544421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e17dae-5470-4038-b903-3dfb746d2f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:14.545785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e17dae-5470-4038-b903-3dfb746d2f41 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:14.546069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e17dae-5470-4038-b903-3dfb746d2f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:14.546345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e17dae-5470-4038-b903-3dfb746d2f41 None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe/users/ea3d250455814500ba0ebe26e648d3b2/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:14.551451 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e17dae-5470-4038-b903-3dfb746d2f41 None admin] RBAC: Authorizing `identity:create_grant(project_id=769c25d7cd5442f3a9359fa294a9befe, user_id=ea3d250455814500ba0ebe26e648d3b2, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:14.553302 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e17dae-5470-4038-b903-3dfb746d2f41 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:14.618909 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0859c-9ba3-4e2e-97e0-a6d0de4b9aa2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:14.642340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 119/230] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:41:14 2022] PUT /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe/users/ea3d250455814500ba0ebe26e648d3b2/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:41:14.654343 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681c4bb-61ec-4d1f-acbf-45047e78e06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:14.655133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681c4bb-61ec-4d1f-acbf-45047e78e06d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:14.655418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681c4bb-61ec-4d1f-acbf-45047e78e06d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:14.655745 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681c4bb-61ec-4d1f-acbf-45047e78e06d None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:14.656521 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681c4bb-61ec-4d1f-acbf-45047e78e06d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:14.656863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681c4bb-61ec-4d1f-acbf-45047e78e06d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:14.660574 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681c4bb-61ec-4d1f-acbf-45047e78e06d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:14.668866 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 112/231] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:41:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:14.674565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e17dae-5470-4038-b903-3dfb746d2f41 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:14.729027 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:14.805236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e17dae-5470-4038-b903-3dfb746d2f41 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:14.841265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0348e-999e-462d-9669-e1ff4bbeb0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:14.842213 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0348e-999e-462d-9669-e1ff4bbeb0da None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:14.842498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0348e-999e-462d-9669-e1ff4bbeb0da None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:14.842771 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0348e-999e-462d-9669-e1ff4bbeb0da None admin] PATH_INFO: `/v3/users/ea3d250455814500ba0ebe26e648d3b2` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:14.844014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0348e-999e-462d-9669-e1ff4bbeb0da None admin] RBAC: Authorizing `identity:get_user(user_id=ea3d250455814500ba0ebe26e648d3b2)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:14.845560 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0348e-999e-462d-9669-e1ff4bbeb0da None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:14.847495 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 120/232] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:14 2022] GET /identity/v3/users/ea3d250455814500ba0ebe26e648d3b2 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:14.853533 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681c4bb-61ec-4d1f-acbf-45047e78e06d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:14.966445 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:14.975778 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681c4bb-61ec-4d1f-acbf-45047e78e06d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:15.011018 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadcaa8-2108-49c2-ba7b-e08d93c0719b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:15.011886 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadcaa8-2108-49c2-ba7b-e08d93c0719b None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:15.012172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadcaa8-2108-49c2-ba7b-e08d93c0719b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:15.012451 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadcaa8-2108-49c2-ba7b-e08d93c0719b None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:15.013691 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadcaa8-2108-49c2-ba7b-e08d93c0719b None admin] RBAC: Authorizing `identity:get_project(project_id=769c25d7cd5442f3a9359fa294a9befe)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:15.015163 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadcaa8-2108-49c2-ba7b-e08d93c0719b None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:15.017196 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 113/233] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:14 2022] GET /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:15.022870 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0348e-999e-462d-9669-e1ff4bbeb0da None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:15.130812 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:15.137284 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0348e-999e-462d-9669-e1ff4bbeb0da None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:15.174725 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5899c9-a4b5-4eea-8650-d8f819389a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:15.175628 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5899c9-a4b5-4eea-8650-d8f819389a1f None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:15.175910 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5899c9-a4b5-4eea-8650-d8f819389a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:15.176185 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5899c9-a4b5-4eea-8650-d8f819389a1f None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe/users/ea3d250455814500ba0ebe26e648d3b2/roles/5ea7d4a868fb49b8992c3adb30476789` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:15.179113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5899c9-a4b5-4eea-8650-d8f819389a1f None admin] RBAC: Authorizing `identity:create_grant(project_id=769c25d7cd5442f3a9359fa294a9befe, user_id=ea3d250455814500ba0ebe26e648d3b2, role_id=5ea7d4a868fb49b8992c3adb30476789)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:15.180580 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5899c9-a4b5-4eea-8650-d8f819389a1f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:15.261088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 121/234] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:41:15 2022] PUT /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe/users/ea3d250455814500ba0ebe26e648d3b2/roles/5ea7d4a868fb49b8992c3adb30476789 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:41:15.581689 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a38062-6f3f-400f-9684-ecfa480e3c89 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:15.581987 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a38062-6f3f-400f-9684-ecfa480e3c89 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:15.582271 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a38062-6f3f-400f-9684-ecfa480e3c89 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:15.583801 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 114/235] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:15.585423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3de987-04c6-4c5a-b954-f0b5cf2cd89c None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:15.585881 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3de987-04c6-4c5a-b954-f0b5cf2cd89c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:15.585954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3de987-04c6-4c5a-b954-f0b5cf2cd89c None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:15.587567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 122/236] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:15.590238 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc5467-298c-4116-bb9e-91f353d09af6 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:15.590528 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc5467-298c-4116-bb9e-91f353d09af6 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:15.590808 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc5467-298c-4116-bb9e-91f353d09af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:15.597316 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e6e05-8ecd-4f32-96fd-34dd08fd9062 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:15.597586 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e6e05-8ecd-4f32-96fd-34dd08fd9062 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:15.597862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e6e05-8ecd-4f32-96fd-34dd08fd9062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:15.612443 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-24cc5467-298c-4116-bb9e-91f353d09af6 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:15.613976 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-24cc5467-298c-4116-bb9e-91f353d09af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:15.618984 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-238e6e05-8ecd-4f32-96fd-34dd08fd9062 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:15.620169 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-238e6e05-8ecd-4f32-96fd-34dd08fd9062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:15.720675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 123/237] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:15.721358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 115/238] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:15.747547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e6e05-8ecd-4f32-96fd-34dd08fd9062 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:15.758006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc5467-298c-4116-bb9e-91f353d09af6 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:15.911981 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:15.942071 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e6e05-8ecd-4f32-96fd-34dd08fd9062 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:15.949061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:15.959931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc5467-298c-4116-bb9e-91f353d09af6 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:15.996326 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de6c0f-b231-4a84-8cdb-b07a6bc32b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:15.997503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de6c0f-b231-4a84-8cdb-b07a6bc32b5a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:15.998009 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de6c0f-b231-4a84-8cdb-b07a6bc32b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:15.998512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de6c0f-b231-4a84-8cdb-b07a6bc32b5a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:16.010695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de6c0f-b231-4a84-8cdb-b07a6bc32b5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:16.010942 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c0b4d-cb71-4468-92b2-c39a22a1f896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:16.011746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c0b4d-cb71-4468-92b2-c39a22a1f896 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:16.012034 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c0b4d-cb71-4468-92b2-c39a22a1f896 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:16.012312 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c0b4d-cb71-4468-92b2-c39a22a1f896 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:16.017310 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c0b4d-cb71-4468-92b2-c39a22a1f896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:16.019210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c0b4d-cb71-4468-92b2-c39a22a1f896 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:16.021020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-b8de6c0f-b231-4a84-8cdb-b07a6bc32b5a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:41:16.021020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:16.021020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:16.021020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:16.021020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:16.021020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:16.021020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:16.021020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:16.021020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:16.021020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:16.021020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:16.021020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:16.021020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:16.021020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:16.021020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:16.021020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:16.022459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:16.022459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:16.022459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:16.022459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:16.022459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:16.022459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:16.022459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:16.022459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:16.022459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:16.022459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:16.022459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:16.022459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:16.022459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:16.022459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:16.022459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:16.022459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:16.023227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:16.023227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:16.023227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:16.023227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:16.023227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:16.023227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:16.023227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:16.023227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:16.023227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:16.023227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:16.023227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:41:16.023227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:16.023834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 124/239] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:16.029335 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c0b4d-cb71-4468-92b2-c39a22a1f896 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:16.030498 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 116/240] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:41:16.040265 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de6c0f-b231-4a84-8cdb-b07a6bc32b5a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:16.190221 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c0b4d-cb71-4468-92b2-c39a22a1f896 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:16.227173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908145e5-7a62-453e-9c89-f990fbe013f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:16.227865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908145e5-7a62-453e-9c89-f990fbe013f5 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:16.228150 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908145e5-7a62-453e-9c89-f990fbe013f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:16.228432 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908145e5-7a62-453e-9c89-f990fbe013f5 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:16.229306 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908145e5-7a62-453e-9c89-f990fbe013f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:16.230792 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908145e5-7a62-453e-9c89-f990fbe013f5 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:16.251969 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de6c0f-b231-4a84-8cdb-b07a6bc32b5a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:16.288280 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170fb29-295e-41f3-a560-0fd36cf3673d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:16.288985 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170fb29-295e-41f3-a560-0fd36cf3673d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:16.289328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170fb29-295e-41f3-a560-0fd36cf3673d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:16.289599 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170fb29-295e-41f3-a560-0fd36cf3673d None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:16.290353 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170fb29-295e-41f3-a560-0fd36cf3673d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:16.290661 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170fb29-295e-41f3-a560-0fd36cf3673d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:16.292100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170fb29-295e-41f3-a560-0fd36cf3673d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:16.300845 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 117/241] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:16.304639 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b95b19-b817-4785-afb4-25f69d80e901 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:16.304639 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b95b19-b817-4785-afb4-25f69d80e901 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:16.304639 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b95b19-b817-4785-afb4-25f69d80e901 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:16.304639 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 118/242] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:16.307014 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b95b19-b817-4785-afb4-25f69d80e901 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:16.322021 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 125/243] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jul 5 12:41:16 2022] POST /identity/v3/users => generated 293 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:41:16.323470 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03012b3-8fb8-4a29-b405-d6f27609a5a9 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:16.323823 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03012b3-8fb8-4a29-b405-d6f27609a5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:16.324313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03012b3-8fb8-4a29-b405-d6f27609a5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:16.327708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:16.345356 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-d03012b3-8fb8-4a29-b405-d6f27609a5a9 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:16.346985 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d03012b3-8fb8-4a29-b405-d6f27609a5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:16.351132 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:16.424999 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b95b19-b817-4785-afb4-25f69d80e901 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:16.437568 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 126/244] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:16.491867 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bdbf7-0c83-4c85-b4fc-ad88b73c14c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:16.493379 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bdbf7-0c83-4c85-b4fc-ad88b73c14c7 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:16.493876 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bdbf7-0c83-4c85-b4fc-ad88b73c14c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:16.494356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bdbf7-0c83-4c85-b4fc-ad88b73c14c7 None admin] PATH_INFO: `/v3/users/563518172afd487aaba431be23a70044` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:16.513960 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03012b3-8fb8-4a29-b405-d6f27609a5a9 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:16.526621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69bdbf7-0c83-4c85-b4fc-ad88b73c14c7 None admin] RBAC: Authorizing `identity:get_user(user_id=563518172afd487aaba431be23a70044)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:16.529172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69bdbf7-0c83-4c85-b4fc-ad88b73c14c7 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:16.535481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 119/245] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:16 2022] GET /identity/v3/users/563518172afd487aaba431be23a70044 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:16.540934 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bdbf7-0c83-4c85-b4fc-ad88b73c14c7 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:16.624342 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:16.642745 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03012b3-8fb8-4a29-b405-d6f27609a5a9 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:16.658330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bdbf7-0c83-4c85-b4fc-ad88b73c14c7 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:16.681412 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7903f-808d-4478-8e96-701271841a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:16.682637 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7903f-808d-4478-8e96-701271841a30 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:16.683126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7903f-808d-4478-8e96-701271841a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:16.683602 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7903f-808d-4478-8e96-701271841a30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:16.699499 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:16.701213 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7903f-808d-4478-8e96-701271841a30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:16.705861 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146139fe-94b6-4df5-a14a-2060f0b8ed67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:16.706620 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146139fe-94b6-4df5-a14a-2060f0b8ed67 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:16.706914 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146139fe-94b6-4df5-a14a-2060f0b8ed67 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:16.710828 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146139fe-94b6-4df5-a14a-2060f0b8ed67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:16.711126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-a4f7903f-808d-4478-8e96-701271841a30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:16.711126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:16.711126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:16.711126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:16.711126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:16.711126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:16.711126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:16.711126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:16.711126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:16.711126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:16.711126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:16.711126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:16.711126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:16.711126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:16.711126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:16.711126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:16.711995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:16.711995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:16.711995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:16.711995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:16.711995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:16.711995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:16.711995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:16.711995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:16.711995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:16.711995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:16.711995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:16.711995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:16.711995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:16.711995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:16.711995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:16.711995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:16.712927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:16.712927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:16.712927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:16.712927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:16.712927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:16.712927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:16.712927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:16.712927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:16.712927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:16.712927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:16.712927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:16.712927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:16.714925 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 127/246] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:41:16.721168 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7903f-808d-4478-8e96-701271841a30 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:16.790303 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146139fe-94b6-4df5-a14a-2060f0b8ed67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:16.792067 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146139fe-94b6-4df5-a14a-2060f0b8ed67 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:16.838791 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7903f-808d-4478-8e96-701271841a30 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:16.872016 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:16.880090 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ae957-6745-488a-9386-7ad622d2bcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:16.881222 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ae957-6745-488a-9386-7ad622d2bcbc None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:16.881718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ae957-6745-488a-9386-7ad622d2bcbc None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:16.882166 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ae957-6745-488a-9386-7ad622d2bcbc None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:16.883368 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ae957-6745-488a-9386-7ad622d2bcbc None admin] RBAC: Adding query filter params (name=member) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:16.883887 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ae957-6745-488a-9386-7ad622d2bcbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:16.885629 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ae957-6745-488a-9386-7ad622d2bcbc None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:16.898883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 128/247] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:16.902157 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ae957-6745-488a-9386-7ad622d2bcbc None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:16.907748 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 120/248] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:16.913843 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146139fe-94b6-4df5-a14a-2060f0b8ed67 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:16.976946 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:17.020003 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ae957-6745-488a-9386-7ad622d2bcbc None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:17.026183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146139fe-94b6-4df5-a14a-2060f0b8ed67 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:17.059623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbff9da-6648-421d-846a-e481fd3ced3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:17.060913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbff9da-6648-421d-846a-e481fd3ced3e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:17.061406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbff9da-6648-421d-846a-e481fd3ced3e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:17.061922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbff9da-6648-421d-846a-e481fd3ced3e None admin] PATH_INFO: `/v3/users/ff5a5fddbe75489689a492e5177fcb6c` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:17.063388 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbff9da-6648-421d-846a-e481fd3ced3e None admin] RBAC: Authorizing `identity:get_user(user_id=ff5a5fddbe75489689a492e5177fcb6c)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:17.065942 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbff9da-6648-421d-846a-e481fd3ced3e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:17.071231 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 129/249] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:16 2022] GET /identity/v3/users/ff5a5fddbe75489689a492e5177fcb6c => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:17.074148 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbff9da-6648-421d-846a-e481fd3ced3e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:17.074911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eea9f8-3061-43fb-b16a-fa87c1769399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:17.075833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eea9f8-3061-43fb-b16a-fa87c1769399 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:17.076117 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eea9f8-3061-43fb-b16a-fa87c1769399 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:17.076445 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eea9f8-3061-43fb-b16a-fa87c1769399 None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:17.077758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eea9f8-3061-43fb-b16a-fa87c1769399 None admin] RBAC: Authorizing `identity:get_project(project_id=769c25d7cd5442f3a9359fa294a9befe)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:17.079721 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eea9f8-3061-43fb-b16a-fa87c1769399 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:17.081429 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 121/250] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:16 2022] GET /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:17.088332 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eea9f8-3061-43fb-b16a-fa87c1769399 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:17.137576 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:17.190951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbff9da-6648-421d-846a-e481fd3ced3e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:17.201833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eea9f8-3061-43fb-b16a-fa87c1769399 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:17.225013 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:17.234127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355997d-b0f6-4058-8a65-e4a74dcf18f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:17.235674 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355997d-b0f6-4058-8a65-e4a74dcf18f8 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:17.236166 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355997d-b0f6-4058-8a65-e4a74dcf18f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:17.236693 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355997d-b0f6-4058-8a65-e4a74dcf18f8 None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:17.238338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355997d-b0f6-4058-8a65-e4a74dcf18f8 None admin] RBAC: Authorizing `identity:get_project(project_id=769c25d7cd5442f3a9359fa294a9befe)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:17.239020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac2c7d-1dba-4875-8a5a-2a3bba2bb20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:17.239686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac2c7d-1dba-4875-8a5a-2a3bba2bb20d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:17.247323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac2c7d-1dba-4875-8a5a-2a3bba2bb20d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:17.247323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac2c7d-1dba-4875-8a5a-2a3bba2bb20d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:17.247498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355997d-b0f6-4058-8a65-e4a74dcf18f8 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:17.247570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac2c7d-1dba-4875-8a5a-2a3bba2bb20d None admin] RBAC: Adding query filter params (role.id=fcf1354e3e794c0297def593c19f0a76, scope.project.id=769c25d7cd5442f3a9359fa294a9befe, user.id=563518172afd487aaba431be23a70044) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:17.247570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac2c7d-1dba-4875-8a5a-2a3bba2bb20d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:17.247570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac2c7d-1dba-4875-8a5a-2a3bba2bb20d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:17.248218 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 130/251] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:17 2022] GET /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:17.251474 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355997d-b0f6-4058-8a65-e4a74dcf18f8 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:17.254392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 122/252] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:41:17 2022] GET /identity/v3/role_assignments?user.id=563518172afd487aaba431be23a70044&scope.project.id=769c25d7cd5442f3a9359fa294a9befe&role.id=fcf1354e3e794c0297def593c19f0a76 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:17.266359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6725bb-6b83-4e59-9643-d2dc9d9dc454 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:17.266665 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6725bb-6b83-4e59-9643-d2dc9d9dc454 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:17.266953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6725bb-6b83-4e59-9643-d2dc9d9dc454 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:17.268346 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 123/253] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:17.276219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42561850-1296-4c03-a09f-28f88f0ae973 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:17.276521 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42561850-1296-4c03-a09f-28f88f0ae973 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:17.276818 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42561850-1296-4c03-a09f-28f88f0ae973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:17.310279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-42561850-1296-4c03-a09f-28f88f0ae973 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:17.312534 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-42561850-1296-4c03-a09f-28f88f0ae973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:17.389333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355997d-b0f6-4058-8a65-e4a74dcf18f8 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:17.402434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 124/254] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:17.436622 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05ca61-a92a-407b-a708-6e1e032c3870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:17.437865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05ca61-a92a-407b-a708-6e1e032c3870 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:17.438328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05ca61-a92a-407b-a708-6e1e032c3870 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:17.438783 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05ca61-a92a-407b-a708-6e1e032c3870 None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe/users/ff5a5fddbe75489689a492e5177fcb6c/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:17.446210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05ca61-a92a-407b-a708-6e1e032c3870 None admin] RBAC: Authorizing `identity:create_grant(project_id=769c25d7cd5442f3a9359fa294a9befe, user_id=ff5a5fddbe75489689a492e5177fcb6c, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:17.448066 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05ca61-a92a-407b-a708-6e1e032c3870 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:17.464812 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42561850-1296-4c03-a09f-28f88f0ae973 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:17.508747 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:17.526801 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 131/255] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:41:17 2022] PUT /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe/users/ff5a5fddbe75489689a492e5177fcb6c/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:41:17.587516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42561850-1296-4c03-a09f-28f88f0ae973 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:17.625507 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cfe29-52b2-47af-8b8d-1309b9b25bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:17.626319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cfe29-52b2-47af-8b8d-1309b9b25bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:17.626610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cfe29-52b2-47af-8b8d-1309b9b25bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:17.626894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cfe29-52b2-47af-8b8d-1309b9b25bd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:17.638353 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cfe29-52b2-47af-8b8d-1309b9b25bd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:17.646246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-bb9cfe29-52b2-47af-8b8d-1309b9b25bd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:41:17.646246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:17.646246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:17.646246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:17.646246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:17.646246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:17.646246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:17.646246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:17.646246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:17.646246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:17.646246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:17.646246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:17.646246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:17.646246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:17.646246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:17.646246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:17.647294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:17.647294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:17.647294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:17.647294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:17.647294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:17.647294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:17.647294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:17.647294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:17.647294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:17.647294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:17.647294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:17.647294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:17.647294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:17.647294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:17.647294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:17.647294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:17.648092 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:17.648092 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:17.648092 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:17.648092 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:17.648092 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:17.648092 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:17.648092 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:17.648092 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:17.648092 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:17.648092 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:17.648092 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:41:17.648092 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:17.648092 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 125/256] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:41:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:41:17.655070 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05ca61-a92a-407b-a708-6e1e032c3870 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:17.764767 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:17.812957 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05ca61-a92a-407b-a708-6e1e032c3870 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:17.852095 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8927774-1bfa-4ae0-9707-87e3c91b04ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:17.852743 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8927774-1bfa-4ae0-9707-87e3c91b04ce None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:17.853066 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8927774-1bfa-4ae0-9707-87e3c91b04ce None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:17.853405 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8927774-1bfa-4ae0-9707-87e3c91b04ce None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:17.854179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8927774-1bfa-4ae0-9707-87e3c91b04ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:17.854544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8927774-1bfa-4ae0-9707-87e3c91b04ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:17.855956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8927774-1bfa-4ae0-9707-87e3c91b04ce None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:17.868907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 132/257] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:17.870656 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cfe29-52b2-47af-8b8d-1309b9b25bd4 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:17.973731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:17.982617 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cfe29-52b2-47af-8b8d-1309b9b25bd4 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:18.018345 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a03db1-6f3c-48ab-915e-1926a22e278c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:18.019292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a03db1-6f3c-48ab-915e-1926a22e278c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:18.019584 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a03db1-6f3c-48ab-915e-1926a22e278c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:18.019861 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a03db1-6f3c-48ab-915e-1926a22e278c None admin] PATH_INFO: `/v3/users/ea3d250455814500ba0ebe26e648d3b2` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:18.021115 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a03db1-6f3c-48ab-915e-1926a22e278c None admin] RBAC: Authorizing `identity:get_user(user_id=ea3d250455814500ba0ebe26e648d3b2)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:18.022673 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a03db1-6f3c-48ab-915e-1926a22e278c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:18.026987 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 126/258] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:17 2022] GET /identity/v3/users/ea3d250455814500ba0ebe26e648d3b2 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:18.030655 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11132a-e200-4631-8b31-526df89e33b0 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:18.030956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11132a-e200-4631-8b31-526df89e33b0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:18.031237 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11132a-e200-4631-8b31-526df89e33b0 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:18.032905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 133/259] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:18.034190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a03db1-6f3c-48ab-915e-1926a22e278c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:18.038031 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc69b9-8a9f-4277-967b-9328e8dbdb3a None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:18.038328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc69b9-8a9f-4277-967b-9328e8dbdb3a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:18.038658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc69b9-8a9f-4277-967b-9328e8dbdb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:18.065781 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-28cc69b9-8a9f-4277-967b-9328e8dbdb3a None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:18.068606 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-28cc69b9-8a9f-4277-967b-9328e8dbdb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:18.207251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 134/260] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:18.226584 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a03db1-6f3c-48ab-915e-1926a22e278c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:18.253848 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc69b9-8a9f-4277-967b-9328e8dbdb3a None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:18.280544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1363d-2ccc-4169-b884-222b23610b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:18.281372 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1363d-2ccc-4169-b884-222b23610b66 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:18.281669 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1363d-2ccc-4169-b884-222b23610b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:18.281953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1363d-2ccc-4169-b884-222b23610b66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:18.312347 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:18.354679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1363d-2ccc-4169-b884-222b23610b66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:18.356171 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1363d-2ccc-4169-b884-222b23610b66 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:18.356686 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:18.432709 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc69b9-8a9f-4277-967b-9328e8dbdb3a None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:18.458662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 127/261] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:18.464423 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1363d-2ccc-4169-b884-222b23610b66 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:18.498203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf370c3-4cf8-4d9a-beeb-3bcca13937d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:18.499039 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf370c3-4cf8-4d9a-beeb-3bcca13937d2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:18.499322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf370c3-4cf8-4d9a-beeb-3bcca13937d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:18.499600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf370c3-4cf8-4d9a-beeb-3bcca13937d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:18.527780 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf370c3-4cf8-4d9a-beeb-3bcca13937d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:18.536018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-5bf370c3-4cf8-4d9a-beeb-3bcca13937d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:18.536018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:18.536018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:18.536018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:18.536018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:18.536018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:18.536018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:18.536018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:18.536018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:18.536018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:18.536018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:18.536018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:18.536018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:18.536018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:18.536018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:18.536018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:18.537137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:18.537137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:18.537137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:18.537137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:18.537137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:18.537137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:18.537137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:18.537137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:18.537137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:18.537137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:18.537137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:18.537137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:18.537137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:18.537137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:18.537137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:18.537137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:18.538760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:18.538760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:18.538760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:18.538760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:18.538760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:18.538760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:18.538760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:18.538760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:18.538760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:18.538760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:18.538760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:18.538760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:18.540965 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:18.545372 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 135/262] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jul 5 12:41:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:41:18.551909 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf370c3-4cf8-4d9a-beeb-3bcca13937d2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:18.581274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1363d-2ccc-4169-b884-222b23610b66 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:18.619477 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058f43d-88c3-4d06-9950-434b11232ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:18.620516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058f43d-88c3-4d06-9950-434b11232ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:18.620985 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058f43d-88c3-4d06-9950-434b11232ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:18.621448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058f43d-88c3-4d06-9950-434b11232ef5 None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:18.622844 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058f43d-88c3-4d06-9950-434b11232ef5 None admin] RBAC: Authorizing `identity:get_project(project_id=769c25d7cd5442f3a9359fa294a9befe)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:18.624685 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058f43d-88c3-4d06-9950-434b11232ef5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:18.626695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 128/263] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:18 2022] GET /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:18.632951 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058f43d-88c3-4d06-9950-434b11232ef5 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:18.720879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf370c3-4cf8-4d9a-beeb-3bcca13937d2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:18.729989 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:18.742456 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058f43d-88c3-4d06-9950-434b11232ef5 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:18.773418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:18.777375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ab36b-f720-4bd9-a28c-005f745b772b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:18.778072 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ab36b-f720-4bd9-a28c-005f745b772b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:18.778381 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ab36b-f720-4bd9-a28c-005f745b772b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:18.778681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ab36b-f720-4bd9-a28c-005f745b772b None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:18.779520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ab36b-f720-4bd9-a28c-005f745b772b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:18.782544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ed41b-4721-4605-90d0-f844679cee16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:18.783300 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ed41b-4721-4605-90d0-f844679cee16 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:18.784101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ed41b-4721-4605-90d0-f844679cee16 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:18.784101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ed41b-4721-4605-90d0-f844679cee16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:18.785068 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ed41b-4721-4605-90d0-f844679cee16 None admin] RBAC: Adding query filter params (role.id=868c7a356c674ded875dd079f5a9f5e0, scope.project.id=769c25d7cd5442f3a9359fa294a9befe, user.id=ea3d250455814500ba0ebe26e648d3b2) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:18.785185 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ab36b-f720-4bd9-a28c-005f745b772b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:18.785497 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ed41b-4721-4605-90d0-f844679cee16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:18.786551 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ab36b-f720-4bd9-a28c-005f745b772b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:18.787198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ed41b-4721-4605-90d0-f844679cee16 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:18.796336 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 136/265] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:41:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:18.797622 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 129/265] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:41:18 2022] GET /identity/v3/role_assignments?user.id=ea3d250455814500ba0ebe26e648d3b2&scope.project.id=769c25d7cd5442f3a9359fa294a9befe&role.id=868c7a356c674ded875dd079f5a9f5e0 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:18.802545 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ab36b-f720-4bd9-a28c-005f745b772b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:18.954297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ab36b-f720-4bd9-a28c-005f745b772b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:19.001975 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e7bf1-a18e-4d15-9233-3c1f7c28a58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:19.002782 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e7bf1-a18e-4d15-9233-3c1f7c28a58c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:19.003062 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e7bf1-a18e-4d15-9233-3c1f7c28a58c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:19.003339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e7bf1-a18e-4d15-9233-3c1f7c28a58c None admin] PATH_INFO: `/v3/users/ea3d250455814500ba0ebe26e648d3b2` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:19.005315 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e7bf1-a18e-4d15-9233-3c1f7c28a58c None admin] RBAC: Authorizing `identity:get_user(user_id=ea3d250455814500ba0ebe26e648d3b2)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:19.007349 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e7bf1-a18e-4d15-9233-3c1f7c28a58c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:19.009325 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 137/266] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:18 2022] GET /identity/v3/users/ea3d250455814500ba0ebe26e648d3b2 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:19.015003 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ed41b-4721-4605-90d0-f844679cee16 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:19.163482 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ed41b-4721-4605-90d0-f844679cee16 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:19.199023 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea009e-b40e-482d-81dd-0dece3070b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:19.199685 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea009e-b40e-482d-81dd-0dece3070b0f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:19.199981 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea009e-b40e-482d-81dd-0dece3070b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:19.200269 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea009e-b40e-482d-81dd-0dece3070b0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:19.269033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:19.277640 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea009e-b40e-482d-81dd-0dece3070b0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:19.279227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea009e-b40e-482d-81dd-0dece3070b0f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:19.390982 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 130/267] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:19.397475 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e7bf1-a18e-4d15-9233-3c1f7c28a58c None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:19.468969 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:19.571201 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e7bf1-a18e-4d15-9233-3c1f7c28a58c None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:19.623828 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1fbf6-30de-44c1-b542-488a25cb1995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:19.625069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1fbf6-30de-44c1-b542-488a25cb1995 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:19.625560 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1fbf6-30de-44c1-b542-488a25cb1995 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:19.626065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1fbf6-30de-44c1-b542-488a25cb1995 None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:19.627477 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1fbf6-30de-44c1-b542-488a25cb1995 None admin] RBAC: Authorizing `identity:get_project(project_id=769c25d7cd5442f3a9359fa294a9befe)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:19.629168 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1fbf6-30de-44c1-b542-488a25cb1995 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:19.631741 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 138/268] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:19 2022] GET /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:19.637580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea009e-b40e-482d-81dd-0dece3070b0f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:19.759954 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:19.768721 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea009e-b40e-482d-81dd-0dece3070b0f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:19.813782 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd842252-146a-4584-b034-9824267ecb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:19.814448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd842252-146a-4584-b034-9824267ecb10 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:19.814739 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd842252-146a-4584-b034-9824267ecb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:19.815025 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd842252-146a-4584-b034-9824267ecb10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:19.815865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd842252-146a-4584-b034-9824267ecb10 None admin] RBAC: Adding query filter params (role.id=5ea7d4a868fb49b8992c3adb30476789, scope.project.id=769c25d7cd5442f3a9359fa294a9befe, user.id=ea3d250455814500ba0ebe26e648d3b2) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:19.816178 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd842252-146a-4584-b034-9824267ecb10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:19.817703 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd842252-146a-4584-b034-9824267ecb10 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:19.829161 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 131/269] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:41:19 2022] GET /identity/v3/role_assignments?user.id=ea3d250455814500ba0ebe26e648d3b2&scope.project.id=769c25d7cd5442f3a9359fa294a9befe&role.id=5ea7d4a868fb49b8992c3adb30476789 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:20.143151 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb7c1c-03f4-48dd-a2de-d0c29436e7f9 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:20.143638 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb7c1c-03f4-48dd-a2de-d0c29436e7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:20.143638 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb7c1c-03f4-48dd-a2de-d0c29436e7f9 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:20.145285 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 139/270] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:20.151093 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bd79c-7e59-48ca-9e4d-869765906ce6 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:20.151388 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bd79c-7e59-48ca-9e4d-869765906ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:20.151670 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bd79c-7e59-48ca-9e4d-869765906ce6 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:20.153088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 140/271] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:41:20.154516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30675e3-188a-4f3f-831f-d89bb47b240a None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:20.154941 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30675e3-188a-4f3f-831f-d89bb47b240a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:20.155116 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30675e3-188a-4f3f-831f-d89bb47b240a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:20.158989 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1496ea-0f1c-4e11-a03d-808964bfed3d None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:20.159274 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1496ea-0f1c-4e11-a03d-808964bfed3d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:20.159560 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1496ea-0f1c-4e11-a03d-808964bfed3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:20.182604 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-9d1496ea-0f1c-4e11-a03d-808964bfed3d None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:20.184161 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9d1496ea-0f1c-4e11-a03d-808964bfed3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:20.187465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e30675e3-188a-4f3f-831f-d89bb47b240a None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:20.192067 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e30675e3-188a-4f3f-831f-d89bb47b240a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:20.277217 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 141/272] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:20.297359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 132/273] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:20.305374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1496ea-0f1c-4e11-a03d-808964bfed3d None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:20.327420 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30675e3-188a-4f3f-831f-d89bb47b240a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:20.358015 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:20.414261 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1496ea-0f1c-4e11-a03d-808964bfed3d None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:20.430197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:20.447405 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30675e3-188a-4f3f-831f-d89bb47b240a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:20.453566 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d312785-a639-47bd-84b1-02787c937aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:20.454630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d312785-a639-47bd-84b1-02787c937aac None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:20.455078 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d312785-a639-47bd-84b1-02787c937aac None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:20.455352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d312785-a639-47bd-84b1-02787c937aac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:20.467031 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d312785-a639-47bd-84b1-02787c937aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:20.475116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-1d312785-a639-47bd-84b1-02787c937aac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:20.475116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:20.475116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:20.475116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:20.475116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:20.475116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:20.475116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:20.475116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:20.475116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:20.475116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:20.475116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:20.475116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:20.475116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:20.475116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:20.475116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:20.475116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:20.476162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:20.476162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:20.476162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:20.476162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:20.476162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:20.476162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:20.476162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:20.476162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:20.476162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:20.476162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:20.476162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:20.476162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:20.476162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:20.476162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:20.476162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:20.476162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:20.481883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:20.481883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:20.481883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:20.481883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:20.481883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:20.481883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:20.481883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:20.481883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:20.481883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:20.481883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:20.481883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:20.481883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:20.481883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 142/274] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:20.481883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd66ac-4ed8-48fd-9891-d5c9cce37743 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:20.482759 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd66ac-4ed8-48fd-9891-d5c9cce37743 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:20.482759 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd66ac-4ed8-48fd-9891-d5c9cce37743 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:20.482759 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 143/275] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:20.483912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd66ac-4ed8-48fd-9891-d5c9cce37743 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:20.491912 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01064215-dcdb-48ca-92f4-7c4cb51df384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:20.492742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01064215-dcdb-48ca-92f4-7c4cb51df384 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:20.493033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01064215-dcdb-48ca-92f4-7c4cb51df384 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:20.493310 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01064215-dcdb-48ca-92f4-7c4cb51df384 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:20.494496 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01064215-dcdb-48ca-92f4-7c4cb51df384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:20.495962 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01064215-dcdb-48ca-92f4-7c4cb51df384 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:20.497630 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 133/276] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:20.500038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b46794-f209-4004-94ba-2711075724f0 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:20.500888 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b46794-f209-4004-94ba-2711075724f0 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:20.501180 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b46794-f209-4004-94ba-2711075724f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:20.518314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f6b46794-f209-4004-94ba-2711075724f0 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:20.519507 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f6b46794-f209-4004-94ba-2711075724f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:20.579655 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:20.583782 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 134/277] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:20.584181 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd66ac-4ed8-48fd-9891-d5c9cce37743 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:20.585126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a0ea7-cb4c-4c00-8717-0991bc44fbb7 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:20.585453 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a0ea7-cb4c-4c00-8717-0991bc44fbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:20.585733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a0ea7-cb4c-4c00-8717-0991bc44fbb7 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:20.590865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 135/278] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:20.590865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a0ea7-cb4c-4c00-8717-0991bc44fbb7 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:20.619619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9139b5f-189d-4188-9c65-c48c1565fd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:20.620295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9139b5f-189d-4188-9c65-c48c1565fd91 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:20.620577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9139b5f-189d-4188-9c65-c48c1565fd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:20.620883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9139b5f-189d-4188-9c65-c48c1565fd91 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:20.621632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9139b5f-189d-4188-9c65-c48c1565fd91 None admin] RBAC: Adding query filter params (name=member) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:20.621940 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9139b5f-189d-4188-9c65-c48c1565fd91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:20.623324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9139b5f-189d-4188-9c65-c48c1565fd91 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:20.631328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 144/279] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:20.632492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32063eb3-a032-45b3-ae49-12fed43e1b83 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:20.632810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32063eb3-a032-45b3-ae49-12fed43e1b83 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:20.633092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32063eb3-a032-45b3-ae49-12fed43e1b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:20.648393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-32063eb3-a032-45b3-ae49-12fed43e1b83 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:20.649600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-32063eb3-a032-45b3-ae49-12fed43e1b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:20.690215 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:20.706167 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a0ea7-cb4c-4c00-8717-0991bc44fbb7 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:20.716557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 145/280] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:20.717410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32063eb3-a032-45b3-ae49-12fed43e1b83 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:20.743035 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603fdbc-fbf6-4200-83ba-1280cab8fc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:20.743930 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603fdbc-fbf6-4200-83ba-1280cab8fc9b None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:20.744215 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603fdbc-fbf6-4200-83ba-1280cab8fc9b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:20.744498 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603fdbc-fbf6-4200-83ba-1280cab8fc9b None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:20.745266 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603fdbc-fbf6-4200-83ba-1280cab8fc9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:20.746711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603fdbc-fbf6-4200-83ba-1280cab8fc9b None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:20.807305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:20.816315 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32063eb3-a032-45b3-ae49-12fed43e1b83 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:20.842794 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 136/281] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jul 5 12:41:20 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:41:20.843674 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603fdbc-fbf6-4200-83ba-1280cab8fc9b None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:20.859678 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459adeb-de71-44e6-9726-ffbfe4bf434b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:20.860515 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459adeb-de71-44e6-9726-ffbfe4bf434b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:20.860832 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459adeb-de71-44e6-9726-ffbfe4bf434b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:20.861111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459adeb-de71-44e6-9726-ffbfe4bf434b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:20.875733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459adeb-de71-44e6-9726-ffbfe4bf434b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:20.883567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-5459adeb-de71-44e6-9726-ffbfe4bf434b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:41:20.883567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:20.883567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:20.883567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:20.883567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:20.883567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:20.883567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:20.883567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:20.883567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:20.883567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:20.883567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:20.883567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:20.883567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:20.883567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:20.883567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:20.883567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:20.884529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:20.884529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:20.884529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:20.884529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:20.884529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:20.884529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:20.884529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:20.884529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:20.884529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:20.884529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:20.884529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:20.884529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:20.884529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:20.884529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:20.884529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:20.884529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:20.885415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:20.885415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:20.885415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:20.885415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:20.885415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:20.885415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:20.885415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:20.885415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:20.885415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:20.885415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:20.885415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:41:20.885415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:20.885415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 146/282] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:20.886111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459adeb-de71-44e6-9726-ffbfe4bf434b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:20.962748 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603fdbc-fbf6-4200-83ba-1280cab8fc9b None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:21.002181 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459adeb-de71-44e6-9726-ffbfe4bf434b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:21.005326 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c25c0-7ba7-4480-971e-91e628ff6894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:21.006978 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c25c0-7ba7-4480-971e-91e628ff6894 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:21.007267 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c25c0-7ba7-4480-971e-91e628ff6894 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:21.007545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c25c0-7ba7-4480-971e-91e628ff6894 None admin] PATH_INFO: `/v3/users/9f336bfd3d7b46139d438be11b513c34` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:21.021494 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:21.025098 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c25c0-7ba7-4480-971e-91e628ff6894 None admin] RBAC: Authorizing `identity:get_user(user_id=9f336bfd3d7b46139d438be11b513c34)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:21.027017 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c25c0-7ba7-4480-971e-91e628ff6894 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:21.028776 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 137/283] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:20 2022] GET /identity/v3/users/9f336bfd3d7b46139d438be11b513c34 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:21.029554 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c25c0-7ba7-4480-971e-91e628ff6894 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:21.040784 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91e398-1dd9-4068-b6cd-33afbf3e5fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:21.041594 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91e398-1dd9-4068-b6cd-33afbf3e5fdb None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:21.041878 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91e398-1dd9-4068-b6cd-33afbf3e5fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:21.042157 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91e398-1dd9-4068-b6cd-33afbf3e5fdb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:21.056215 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91e398-1dd9-4068-b6cd-33afbf3e5fdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:21.064632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-8c91e398-1dd9-4068-b6cd-33afbf3e5fdb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:21.064632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:21.064632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:21.064632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:21.064632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:21.064632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:21.064632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:21.064632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:21.064632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:21.064632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:21.064632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:21.064632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:21.064632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:21.064632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:21.064632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:21.064632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:21.065563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:21.065563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:21.065563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:21.065563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:21.065563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:21.065563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:21.065563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:21.065563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:21.065563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:21.065563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:21.065563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:21.065563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:21.065563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:21.065563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:21.065563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:21.065563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:21.066359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:21.066359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:21.066359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:21.066359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:21.066359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:21.066359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:21.066359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:21.066359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:21.066359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:21.066359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:21.066359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:21.066359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:21.066359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 147/284] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:21.066359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91e398-1dd9-4068-b6cd-33afbf3e5fdb None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:21.083826 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:21.154305 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c25c0-7ba7-4480-971e-91e628ff6894 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:21.190000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91e398-1dd9-4068-b6cd-33afbf3e5fdb None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:21.195124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b2830-9b36-47bf-aec4-aa886e662472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:21.195799 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b2830-9b36-47bf-aec4-aa886e662472 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:21.196078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b2830-9b36-47bf-aec4-aa886e662472 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:21.196355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b2830-9b36-47bf-aec4-aa886e662472 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:21.197136 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b2830-9b36-47bf-aec4-aa886e662472 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:21.197438 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b2830-9b36-47bf-aec4-aa886e662472 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:21.198819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b2830-9b36-47bf-aec4-aa886e662472 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:21.207654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 138/285] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:21.208489 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b2830-9b36-47bf-aec4-aa886e662472 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:21.230200 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3d474-d2d0-4bd4-83fa-185632f2b06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:21.231200 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3d474-d2d0-4bd4-83fa-185632f2b06f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:21.232240 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3d474-d2d0-4bd4-83fa-185632f2b06f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:21.232765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3d474-d2d0-4bd4-83fa-185632f2b06f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:21.234099 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3d474-d2d0-4bd4-83fa-185632f2b06f None admin] RBAC: Adding query filter params (role.id=66d9c5a190d544b3b3588bbdadf2cf39, user.id=9f336bfd3d7b46139d438be11b513c34, scope.system=all) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:21.234864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3d474-d2d0-4bd4-83fa-185632f2b06f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:21.237406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3d474-d2d0-4bd4-83fa-185632f2b06f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:21.245787 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 148/286] 10.222.0.36 () {56 vars in 1308 bytes} [Tue Jul 5 12:41:21 2022] GET /identity/v3/role_assignments?user.id=9f336bfd3d7b46139d438be11b513c34&scope.system=all&role.id=66d9c5a190d544b3b3588bbdadf2cf39 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:21.247828 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3d474-d2d0-4bd4-83fa-185632f2b06f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:21.274588 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:21.319680 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b2830-9b36-47bf-aec4-aa886e662472 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:21.352386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:21.368412 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debb03a-61fe-4555-96fd-94785e7eda19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:21.369441 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debb03a-61fe-4555-96fd-94785e7eda19 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:21.370993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debb03a-61fe-4555-96fd-94785e7eda19 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:21.371336 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debb03a-61fe-4555-96fd-94785e7eda19 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:21.372926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debb03a-61fe-4555-96fd-94785e7eda19 None admin] RBAC: Adding query filter params (name=member) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:21.373928 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debb03a-61fe-4555-96fd-94785e7eda19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:21.375552 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debb03a-61fe-4555-96fd-94785e7eda19 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:21.383641 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3d474-d2d0-4bd4-83fa-185632f2b06f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:21.390916 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 139/287] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:21.401717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debb03a-61fe-4555-96fd-94785e7eda19 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:21.432814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884fdef-ef5f-4c41-9005-3f86021bc4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:21.433868 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884fdef-ef5f-4c41-9005-3f86021bc4ab None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:21.434256 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884fdef-ef5f-4c41-9005-3f86021bc4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:21.434630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884fdef-ef5f-4c41-9005-3f86021bc4ab None admin] PATH_INFO: `/v3/users/563518172afd487aaba431be23a70044` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:21.436915 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884fdef-ef5f-4c41-9005-3f86021bc4ab None admin] RBAC: Authorizing `identity:get_user(user_id=563518172afd487aaba431be23a70044)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:21.438695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884fdef-ef5f-4c41-9005-3f86021bc4ab None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:21.442479 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 149/288] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:21 2022] GET /identity/v3/users/563518172afd487aaba431be23a70044 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:21.449887 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884fdef-ef5f-4c41-9005-3f86021bc4ab None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:21.582241 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debb03a-61fe-4555-96fd-94785e7eda19 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:21.623724 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:21.636379 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc0619-7869-474c-a913-31e2c9c8bfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:21.637383 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc0619-7869-474c-a913-31e2c9c8bfc6 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:21.637780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc0619-7869-474c-a913-31e2c9c8bfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:21.638119 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc0619-7869-474c-a913-31e2c9c8bfc6 None admin] PATH_INFO: `/v3/users/ff5a5fddbe75489689a492e5177fcb6c` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:21.640538 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc0619-7869-474c-a913-31e2c9c8bfc6 None admin] RBAC: Authorizing `identity:get_user(user_id=ff5a5fddbe75489689a492e5177fcb6c)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:21.642114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc0619-7869-474c-a913-31e2c9c8bfc6 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:21.646100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 140/289] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:21 2022] GET /identity/v3/users/ff5a5fddbe75489689a492e5177fcb6c => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:21.648694 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884fdef-ef5f-4c41-9005-3f86021bc4ab None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:21.651043 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc0619-7869-474c-a913-31e2c9c8bfc6 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:21.713851 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78365da1-477c-480f-b42b-3c65aa961c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:21.714781 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78365da1-477c-480f-b42b-3c65aa961c2b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:21.715064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78365da1-477c-480f-b42b-3c65aa961c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:21.715343 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78365da1-477c-480f-b42b-3c65aa961c2b None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:21.718490 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78365da1-477c-480f-b42b-3c65aa961c2b None admin] RBAC: Authorizing `identity:get_project(project_id=769c25d7cd5442f3a9359fa294a9befe)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:21.720655 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78365da1-477c-480f-b42b-3c65aa961c2b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:21.727663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 150/290] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:21 2022] GET /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:21.732662 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78365da1-477c-480f-b42b-3c65aa961c2b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:21.752371 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:21.828873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc0619-7869-474c-a913-31e2c9c8bfc6 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:21.893306 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947f581-b4dd-4eee-bb6f-c49bb555141b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:21.893880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947f581-b4dd-4eee-bb6f-c49bb555141b None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:21.894223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947f581-b4dd-4eee-bb6f-c49bb555141b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:21.894504 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947f581-b4dd-4eee-bb6f-c49bb555141b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:21.915402 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78365da1-477c-480f-b42b-3c65aa961c2b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:21.977368 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a511ff-8371-463e-b22f-1b551a153924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:21.978313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a511ff-8371-463e-b22f-1b551a153924 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:21.978599 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a511ff-8371-463e-b22f-1b551a153924 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:21.978879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a511ff-8371-463e-b22f-1b551a153924 None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe/users/563518172afd487aaba431be23a70044/roles/fcf1354e3e794c0297def593c19f0a76` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:21.982065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a511ff-8371-463e-b22f-1b551a153924 None admin] RBAC: Authorizing `identity:create_grant(project_id=769c25d7cd5442f3a9359fa294a9befe, user_id=563518172afd487aaba431be23a70044, role_id=fcf1354e3e794c0297def593c19f0a76)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:21.983525 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a511ff-8371-463e-b22f-1b551a153924 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:21.988186 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:21.998932 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947f581-b4dd-4eee-bb6f-c49bb555141b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:22.000510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947f581-b4dd-4eee-bb6f-c49bb555141b None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:22.107781 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 141/291] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:22.117399 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947f581-b4dd-4eee-bb6f-c49bb555141b None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:22.129496 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 151/292] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:41:21 2022] PUT /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe/users/563518172afd487aaba431be23a70044/roles/fcf1354e3e794c0297def593c19f0a76 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:41:22.233057 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:22.235276 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947f581-b4dd-4eee-bb6f-c49bb555141b None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:22.293452 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8b570-41e9-4d5f-8649-8585bedb3ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:22.294358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8b570-41e9-4d5f-8649-8585bedb3ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:22.294649 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8b570-41e9-4d5f-8649-8585bedb3ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:22.294932 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8b570-41e9-4d5f-8649-8585bedb3ba1 None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:22.296282 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8b570-41e9-4d5f-8649-8585bedb3ba1 None admin] RBAC: Authorizing `identity:get_project(project_id=769c25d7cd5442f3a9359fa294a9befe)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:22.297796 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8b570-41e9-4d5f-8649-8585bedb3ba1 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:22.299568 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 142/293] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:22 2022] GET /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:22.305998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a511ff-8371-463e-b22f-1b551a153924 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:22.396044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:22.429514 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a511ff-8371-463e-b22f-1b551a153924 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:22.469672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c2cee-71a8-4c3e-90af-f75cf45cb09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:22.470382 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c2cee-71a8-4c3e-90af-f75cf45cb09d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:22.470671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c2cee-71a8-4c3e-90af-f75cf45cb09d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:22.470953 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c2cee-71a8-4c3e-90af-f75cf45cb09d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:22.471795 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c2cee-71a8-4c3e-90af-f75cf45cb09d None admin] RBAC: Adding query filter params (role.id=66d9c5a190d544b3b3588bbdadf2cf39, scope.project.id=769c25d7cd5442f3a9359fa294a9befe, user.id=ff5a5fddbe75489689a492e5177fcb6c) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:22.472112 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c2cee-71a8-4c3e-90af-f75cf45cb09d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:22.473602 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c2cee-71a8-4c3e-90af-f75cf45cb09d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:22.489182 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 152/294] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:41:22 2022] GET /identity/v3/role_assignments?user.id=ff5a5fddbe75489689a492e5177fcb6c&scope.project.id=769c25d7cd5442f3a9359fa294a9befe&role.id=66d9c5a190d544b3b3588bbdadf2cf39 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:23.337623 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c354a-ad00-4580-b526-8fbe9f9e15ec None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:23.338341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c354a-ad00-4580-b526-8fbe9f9e15ec None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:23.338341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c354a-ad00-4580-b526-8fbe9f9e15ec None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:23.339773 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 143/295] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:23.345074 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8f978-05a7-4518-8901-7773fb6db377 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:23.345587 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8f978-05a7-4518-8901-7773fb6db377 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:23.345756 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8f978-05a7-4518-8901-7773fb6db377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:23.364015 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-ccd8f978-05a7-4518-8901-7773fb6db377 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:23.365305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ccd8f978-05a7-4518-8901-7773fb6db377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:23.368983 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8784a4-3586-4542-a62f-5d853dfbc48d None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:23.369272 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8784a4-3586-4542-a62f-5d853dfbc48d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:23.369546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8784a4-3586-4542-a62f-5d853dfbc48d None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:23.370903 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 144/296] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:41:23.375674 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed797db-aa28-42e1-bd06-222447cda7c4 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:23.375958 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed797db-aa28-42e1-bd06-222447cda7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:23.376233 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed797db-aa28-42e1-bd06-222447cda7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:23.395535 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-5ed797db-aa28-42e1-bd06-222447cda7c4 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:23.397722 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5ed797db-aa28-42e1-bd06-222447cda7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:23.438000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 153/297] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:23.466510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8f978-05a7-4518-8901-7773fb6db377 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:23.472489 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 145/298] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:41:23.496386 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed797db-aa28-42e1-bd06-222447cda7c4 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:23.544820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:23.582536 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8f978-05a7-4518-8901-7773fb6db377 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:23.589605 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:23.602528 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed797db-aa28-42e1-bd06-222447cda7c4 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:23.618277 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43396b-505e-4e11-a6d2-c65e039bd4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:23.619080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43396b-505e-4e11-a6d2-c65e039bd4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:23.619377 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43396b-505e-4e11-a6d2-c65e039bd4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:23.619642 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43396b-505e-4e11-a6d2-c65e039bd4f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:23.620866 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43396b-505e-4e11-a6d2-c65e039bd4f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:23.622338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43396b-505e-4e11-a6d2-c65e039bd4f4 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:23.628677 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 154/299] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:23.628677 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4f868-0dd5-4114-ab27-f0ad88d24433 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:23.628677 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4f868-0dd5-4114-ab27-f0ad88d24433 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:23.628677 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4f868-0dd5-4114-ab27-f0ad88d24433 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:23.628677 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 155/300] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:23.629374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4f868-0dd5-4114-ab27-f0ad88d24433 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:23.644991 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a1f15-6b77-4732-a9ce-2b25cebfb167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:23.645795 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a1f15-6b77-4732-a9ce-2b25cebfb167 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:23.646072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a1f15-6b77-4732-a9ce-2b25cebfb167 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:23.646348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a1f15-6b77-4732-a9ce-2b25cebfb167 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:23.657741 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a1f15-6b77-4732-a9ce-2b25cebfb167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:23.665580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-c18a1f15-6b77-4732-a9ce-2b25cebfb167 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:41:23.665580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:23.665580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:23.665580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:23.665580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:23.665580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:23.665580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:23.665580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:23.665580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:23.665580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:23.665580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:23.665580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:23.665580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:23.665580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:23.665580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:23.665580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:23.666499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:23.666499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:23.666499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:23.666499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:23.666499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:23.666499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:23.666499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:23.666499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:23.666499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:23.666499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:23.666499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:23.666499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:23.666499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:23.666499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:23.666499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:23.666499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:23.667330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:23.667330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:23.667330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:23.667330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:23.667330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:23.667330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:23.667330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:23.667330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:23.667330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:23.667330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:23.667330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:41:23.667330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:23.667330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 146/301] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:41:23.668396 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ddbe8-d3e9-4ce5-bd4c-922fe01bb283 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:23.668396 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ddbe8-d3e9-4ce5-bd4c-922fe01bb283 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:23.668527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ddbe8-d3e9-4ce5-bd4c-922fe01bb283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:23.686955 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-369ddbe8-d3e9-4ce5-bd4c-922fe01bb283 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:23.688146 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-369ddbe8-d3e9-4ce5-bd4c-922fe01bb283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:23.759975 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4f868-0dd5-4114-ab27-f0ad88d24433 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:23.764787 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 147/302] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:23.764787 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ddbe8-d3e9-4ce5-bd4c-922fe01bb283 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:23.820542 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:23.826033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c4034-c5e3-4920-93ba-d6a875a1d079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:23.826707 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c4034-c5e3-4920-93ba-d6a875a1d079 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:23.827016 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c4034-c5e3-4920-93ba-d6a875a1d079 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:23.827292 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c4034-c5e3-4920-93ba-d6a875a1d079 None admin] PATH_INFO: `/v3/groups` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:23.828122 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c4034-c5e3-4920-93ba-d6a875a1d079 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:23.829651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c4034-c5e3-4920-93ba-d6a875a1d079 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:23.867030 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:23.888708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ddbe8-d3e9-4ce5-bd4c-922fe01bb283 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:23.911558 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 156/303] 10.222.0.36 () {60 vars in 1134 bytes} [Tue Jul 5 12:41:23 2022] POST /identity/v3/groups => generated 229 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:41:23.917815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c4034-c5e3-4920-93ba-d6a875a1d079 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:23.926677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e4937-ccba-4e67-bd2f-99813e008258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:23.933003 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e4937-ccba-4e67-bd2f-99813e008258 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:23.933003 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e4937-ccba-4e67-bd2f-99813e008258 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:23.933003 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e4937-ccba-4e67-bd2f-99813e008258 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:23.933003 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e4937-ccba-4e67-bd2f-99813e008258 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:23.933003 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e4937-ccba-4e67-bd2f-99813e008258 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:23.933003 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e4937-ccba-4e67-bd2f-99813e008258 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:23.942854 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 148/304] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:23.949313 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e4937-ccba-4e67-bd2f-99813e008258 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:24.051314 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c4034-c5e3-4920-93ba-d6a875a1d079 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:24.088363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e4937-ccba-4e67-bd2f-99813e008258 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:24.092150 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1bc5f-3a77-4574-b239-e71dbff5f3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:24.092998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1bc5f-3a77-4574-b239-e71dbff5f3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:24.093285 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1bc5f-3a77-4574-b239-e71dbff5f3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:24.093565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1bc5f-3a77-4574-b239-e71dbff5f3d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:24.105747 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1bc5f-3a77-4574-b239-e71dbff5f3d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:24.113022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-b0e1bc5f-3a77-4574-b239-e71dbff5f3d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:24.113022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:24.113022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:24.113022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:24.113022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:24.113022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:24.113022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:24.113022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:24.113022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:24.113022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:24.113022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:24.113022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:24.113022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:24.113022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:24.113022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:24.113022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:24.113931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:24.113931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:24.113931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:24.113931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:24.113931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:24.113931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:24.113931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:24.113931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:24.113931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:24.113931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:24.113931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:24.113931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:24.113931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:24.113931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:24.113931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:24.113931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:24.115703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:24.115703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:24.115703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:24.115703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:24.115703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:24.115703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:24.115703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:24.115703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:24.115703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:24.115703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:24.115703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:24.115703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:24.115703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 157/305] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:24.123728 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1bc5f-3a77-4574-b239-e71dbff5f3d5 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:24.135733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41c61e-190e-414b-986a-39ce66b4b15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:24.136942 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41c61e-190e-414b-986a-39ce66b4b15d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:24.137414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41c61e-190e-414b-986a-39ce66b4b15d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:24.137889 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41c61e-190e-414b-986a-39ce66b4b15d None admin] PATH_INFO: `/v3/users/114904a0bd254fbc9566ffe3119f4455` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:24.150839 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:24.153265 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41c61e-190e-414b-986a-39ce66b4b15d None admin] RBAC: Authorizing `identity:get_user(user_id=114904a0bd254fbc9566ffe3119f4455)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:24.154937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41c61e-190e-414b-986a-39ce66b4b15d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:24.157299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 149/306] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:23 2022] GET /identity/v3/users/114904a0bd254fbc9566ffe3119f4455 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:24.163309 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41c61e-190e-414b-986a-39ce66b4b15d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:24.185256 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:24.244882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1bc5f-3a77-4574-b239-e71dbff5f3d5 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:24.280954 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41c61e-190e-414b-986a-39ce66b4b15d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:24.289289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc6026-d194-412a-9bc3-162dda0448a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:24.290760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc6026-d194-412a-9bc3-162dda0448a4 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:24.291203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc6026-d194-412a-9bc3-162dda0448a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:24.291624 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc6026-d194-412a-9bc3-162dda0448a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:24.292535 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc6026-d194-412a-9bc3-162dda0448a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:24.297928 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc6026-d194-412a-9bc3-162dda0448a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:24.297928 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc6026-d194-412a-9bc3-162dda0448a4 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:24.305737 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 158/307] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:24.311175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc6026-d194-412a-9bc3-162dda0448a4 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:24.329451 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8cce7-5882-4cfb-a337-f7f9702b49b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:24.330132 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8cce7-5882-4cfb-a337-f7f9702b49b3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:24.330418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8cce7-5882-4cfb-a337-f7f9702b49b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:24.330703 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8cce7-5882-4cfb-a337-f7f9702b49b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:24.331567 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8cce7-5882-4cfb-a337-f7f9702b49b3 None admin] RBAC: Adding query filter params (role.id=fcf1354e3e794c0297def593c19f0a76, user.id=114904a0bd254fbc9566ffe3119f4455, scope.system=all) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:24.331983 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8cce7-5882-4cfb-a337-f7f9702b49b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:24.333470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8cce7-5882-4cfb-a337-f7f9702b49b3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:24.346473 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 150/308] 10.222.0.36 () {56 vars in 1308 bytes} [Tue Jul 5 12:41:24 2022] GET /identity/v3/role_assignments?user.id=114904a0bd254fbc9566ffe3119f4455&scope.system=all&role.id=fcf1354e3e794c0297def593c19f0a76 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:24.432856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc6026-d194-412a-9bc3-162dda0448a4 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:24.433923 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ed53f-13af-4ee6-9403-7dec5200c055 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:24.434437 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ed53f-13af-4ee6-9403-7dec5200c055 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:24.434874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ed53f-13af-4ee6-9403-7dec5200c055 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:24.436864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 151/309] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:24.442493 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edcf7a-9b5f-4a09-b0f0-a86ee986ea64 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:24.442779 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edcf7a-9b5f-4a09-b0f0-a86ee986ea64 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:24.443063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edcf7a-9b5f-4a09-b0f0-a86ee986ea64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:24.458375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:24.462404 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d3edcf7a-9b5f-4a09-b0f0-a86ee986ea64 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:24.463901 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d3edcf7a-9b5f-4a09-b0f0-a86ee986ea64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:24.481684 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787acf43-8011-45c3-8138-956bfc4bc462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:24.482586 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787acf43-8011-45c3-8138-956bfc4bc462 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:24.482870 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787acf43-8011-45c3-8138-956bfc4bc462 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:24.483140 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787acf43-8011-45c3-8138-956bfc4bc462 None admin] PATH_INFO: `/v3/users/9f336bfd3d7b46139d438be11b513c34` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:24.484432 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787acf43-8011-45c3-8138-956bfc4bc462 None admin] RBAC: Authorizing `identity:get_user(user_id=9f336bfd3d7b46139d438be11b513c34)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:24.486098 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787acf43-8011-45c3-8138-956bfc4bc462 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:24.488222 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 159/310] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:24 2022] GET /identity/v3/users/9f336bfd3d7b46139d438be11b513c34 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:24.496888 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787acf43-8011-45c3-8138-956bfc4bc462 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:24.535012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:24.550107 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 152/311] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:24.573754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edcf7a-9b5f-4a09-b0f0-a86ee986ea64 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:24.612776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787acf43-8011-45c3-8138-956bfc4bc462 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:24.649381 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbaa22-ed11-41af-af11-f307d98208b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:24.653371 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbaa22-ed11-41af-af11-f307d98208b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:24.654242 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbaa22-ed11-41af-af11-f307d98208b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:24.654721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbaa22-ed11-41af-af11-f307d98208b3 None admin] PATH_INFO: `/v3/system/users/9f336bfd3d7b46139d438be11b513c34/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:24.656874 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbaa22-ed11-41af-af11-f307d98208b3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9f336bfd3d7b46139d438be11b513c34, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:24.659046 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbaa22-ed11-41af-af11-f307d98208b3 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:24.681848 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edcf7a-9b5f-4a09-b0f0-a86ee986ea64 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:24.718973 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112cf827-cad5-465f-bfd2-997171c20791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:24.719899 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112cf827-cad5-465f-bfd2-997171c20791 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:24.720188 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112cf827-cad5-465f-bfd2-997171c20791 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:24.720464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112cf827-cad5-465f-bfd2-997171c20791 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:24.731444 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112cf827-cad5-465f-bfd2-997171c20791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:24.739814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-112cf827-cad5-465f-bfd2-997171c20791 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:41:24.739814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:24.739814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:24.739814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:24.739814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:24.739814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:24.739814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:24.739814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:24.739814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:24.739814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:24.739814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:24.739814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:24.739814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:24.739814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:24.739814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:24.739814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:24.741544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:24.741544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:24.741544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:24.741544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:24.741544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:24.741544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:24.741544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:24.741544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:24.741544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:24.741544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:24.741544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:24.741544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:24.741544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:24.741544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:24.741544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:24.741544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:24.742348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:24.742348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:24.742348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:24.742348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:24.742348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:24.742348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:24.742348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:24.742348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:24.742348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:24.742348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:24.742348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:41:24.742348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:24.742348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 153/312] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:41:24.748657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112cf827-cad5-465f-bfd2-997171c20791 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:24.758142 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 160/313] 10.222.0.36 () {58 vars in 1334 bytes} [Tue Jul 5 12:41:24 2022] PUT /identity/v3/system/users/9f336bfd3d7b46139d438be11b513c34/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:41:24.819597 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:24.875265 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112cf827-cad5-465f-bfd2-997171c20791 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:24.914507 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55657f62-8ef1-4fec-b4c3-7f11fa47968e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:24.915212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55657f62-8ef1-4fec-b4c3-7f11fa47968e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:24.915502 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55657f62-8ef1-4fec-b4c3-7f11fa47968e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:24.915785 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55657f62-8ef1-4fec-b4c3-7f11fa47968e None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:24.916541 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55657f62-8ef1-4fec-b4c3-7f11fa47968e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:24.916884 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55657f62-8ef1-4fec-b4c3-7f11fa47968e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:24.918317 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55657f62-8ef1-4fec-b4c3-7f11fa47968e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:24.928404 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 154/314] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:24.933788 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbaa22-ed11-41af-af11-f307d98208b3 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:24.990994 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:25.045176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbaa22-ed11-41af-af11-f307d98208b3 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:25.079761 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75c7b1-53bd-452a-90ba-2707557b0004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:25.080794 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75c7b1-53bd-452a-90ba-2707557b0004 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:25.081197 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75c7b1-53bd-452a-90ba-2707557b0004 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:25.081580 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75c7b1-53bd-452a-90ba-2707557b0004 None admin] PATH_INFO: `/v3/users/563518172afd487aaba431be23a70044` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:25.082884 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75c7b1-53bd-452a-90ba-2707557b0004 None admin] RBAC: Authorizing `identity:get_user(user_id=563518172afd487aaba431be23a70044)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:25.084467 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75c7b1-53bd-452a-90ba-2707557b0004 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:25.086215 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 161/315] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:24 2022] GET /identity/v3/users/563518172afd487aaba431be23a70044 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:25.091664 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55657f62-8ef1-4fec-b4c3-7f11fa47968e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:25.198735 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55657f62-8ef1-4fec-b4c3-7f11fa47968e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:25.212988 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:25.234415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa832d-8f0e-47ff-b7da-460c241a4fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:25.235067 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa832d-8f0e-47ff-b7da-460c241a4fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:25.235345 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa832d-8f0e-47ff-b7da-460c241a4fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:25.235617 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa832d-8f0e-47ff-b7da-460c241a4fc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:25.310798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa832d-8f0e-47ff-b7da-460c241a4fc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:25.312626 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa832d-8f0e-47ff-b7da-460c241a4fc5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:25.416008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 155/316] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:25.421248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75c7b1-53bd-452a-90ba-2707557b0004 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:25.524284 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75c7b1-53bd-452a-90ba-2707557b0004 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:25.538912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:25.558913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1339cf3-e9e6-4c4d-a2f6-dacb267e911d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:25.559786 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1339cf3-e9e6-4c4d-a2f6-dacb267e911d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:25.560065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1339cf3-e9e6-4c4d-a2f6-dacb267e911d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:25.560335 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1339cf3-e9e6-4c4d-a2f6-dacb267e911d None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:25.561635 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1339cf3-e9e6-4c4d-a2f6-dacb267e911d None admin] RBAC: Authorizing `identity:get_project(project_id=769c25d7cd5442f3a9359fa294a9befe)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:25.563021 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1339cf3-e9e6-4c4d-a2f6-dacb267e911d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:25.565054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 162/317] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:25 2022] GET /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:25.571111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa832d-8f0e-47ff-b7da-460c241a4fc5 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:25.587974 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:25.678773 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa832d-8f0e-47ff-b7da-460c241a4fc5 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:25.714925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a9a27-9542-4af1-8d4b-aeb2af6bb84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:25.715906 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a9a27-9542-4af1-8d4b-aeb2af6bb84a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:25.716394 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a9a27-9542-4af1-8d4b-aeb2af6bb84a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:25.716900 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a9a27-9542-4af1-8d4b-aeb2af6bb84a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:25.717959 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a9a27-9542-4af1-8d4b-aeb2af6bb84a None admin] RBAC: Adding query filter params (role.id=fcf1354e3e794c0297def593c19f0a76, scope.project.id=769c25d7cd5442f3a9359fa294a9befe, user.id=563518172afd487aaba431be23a70044) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:25.718474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a9a27-9542-4af1-8d4b-aeb2af6bb84a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:25.720119 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a9a27-9542-4af1-8d4b-aeb2af6bb84a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:25.727374 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 156/318] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:41:25 2022] GET /identity/v3/role_assignments?user.id=563518172afd487aaba431be23a70044&scope.project.id=769c25d7cd5442f3a9359fa294a9befe&role.id=fcf1354e3e794c0297def593c19f0a76 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:26.110770 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539eb72-39c3-413b-a010-d6f8eb4a2f8b None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:26.111129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539eb72-39c3-413b-a010-d6f8eb4a2f8b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:26.111334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539eb72-39c3-413b-a010-d6f8eb4a2f8b None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:26.112884 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 163/319] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:26.117958 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc347598-d37a-4b9b-b6d0-00ab7b4908e0 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:26.118273 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc347598-d37a-4b9b-b6d0-00ab7b4908e0 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:26.118514 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc347598-d37a-4b9b-b6d0-00ab7b4908e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:26.135400 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-cc347598-d37a-4b9b-b6d0-00ab7b4908e0 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:26.136573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-cc347598-d37a-4b9b-b6d0-00ab7b4908e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:26.206552 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 157/320] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:41:26.228685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539eb72-39c3-413b-a010-d6f8eb4a2f8b None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:26.327012 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539eb72-39c3-413b-a010-d6f8eb4a2f8b None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:26.359149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3da8d5-d5bc-412f-8979-6e8049c4cc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:26.359939 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3da8d5-d5bc-412f-8979-6e8049c4cc30 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:26.360223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3da8d5-d5bc-412f-8979-6e8049c4cc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:26.360502 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3da8d5-d5bc-412f-8979-6e8049c4cc30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:26.361675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3da8d5-d5bc-412f-8979-6e8049c4cc30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:26.363113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3da8d5-d5bc-412f-8979-6e8049c4cc30 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:26.364929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 164/321] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:26.370644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc347598-d37a-4b9b-b6d0-00ab7b4908e0 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:26.381324 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:26.469396 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc347598-d37a-4b9b-b6d0-00ab7b4908e0 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:26.503156 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a73a1-d0c8-48a7-a709-f33e044c5e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:26.503825 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a73a1-d0c8-48a7-a709-f33e044c5e9c None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:26.504106 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a73a1-d0c8-48a7-a709-f33e044c5e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:26.504382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a73a1-d0c8-48a7-a709-f33e044c5e9c None admin] PATH_INFO: `/v3/groups` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:26.505109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a73a1-d0c8-48a7-a709-f33e044c5e9c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:26.507101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a73a1-d0c8-48a7-a709-f33e044c5e9c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:26.562727 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98edb19-6bc0-431b-bdb8-cc292981fda6 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:26.563268 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98edb19-6bc0-431b-bdb8-cc292981fda6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:26.563268 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98edb19-6bc0-431b-bdb8-cc292981fda6 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:26.564718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 165/322] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:26.569755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb26ddb-3569-4578-822f-d9e571dfc4eb None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:26.570071 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb26ddb-3569-4578-822f-d9e571dfc4eb None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:26.570499 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb26ddb-3569-4578-822f-d9e571dfc4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:26.586986 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-edb26ddb-3569-4578-822f-d9e571dfc4eb None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:26.588155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-edb26ddb-3569-4578-822f-d9e571dfc4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:26.604121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 158/323] 10.222.0.36 () {60 vars in 1134 bytes} [Tue Jul 5 12:41:26 2022] POST /identity/v3/groups => generated 226 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:41:26.640440 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:26.664429 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 166/324] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:41:26.687330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a73a1-d0c8-48a7-a709-f33e044c5e9c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:26.763564 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:26.800020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a73a1-d0c8-48a7-a709-f33e044c5e9c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:26.842274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b61ec-366f-41d5-810d-0e5252845979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:26.843019 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b61ec-366f-41d5-810d-0e5252845979 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:26.843310 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b61ec-366f-41d5-810d-0e5252845979 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:26.843583 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b61ec-366f-41d5-810d-0e5252845979 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:26.856424 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b61ec-366f-41d5-810d-0e5252845979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:26.864381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-579b61ec-366f-41d5-810d-0e5252845979 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:41:26.864381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:26.864381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:26.864381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:26.864381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:26.864381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:26.864381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:26.864381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:26.864381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:26.864381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:26.864381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:26.864381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:26.864381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:26.864381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:26.864381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:26.864381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:26.866111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:26.866111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:26.866111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:26.866111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:26.866111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:26.866111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:26.866111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:26.866111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:26.866111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:26.866111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:26.866111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:26.866111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:26.866111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:26.866111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:26.866111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:26.866111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:26.867011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:26.867011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:26.867011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:26.867011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:26.867011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:26.867011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:26.867011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:26.867011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:26.867011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:26.867011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:26.867011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:41:26.867011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:26.867011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 159/325] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:41:26.872522 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb26ddb-3569-4578-822f-d9e571dfc4eb None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:26.960386 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f485e70-9463-4a7b-b673-9331fd2e4750 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:26.960788 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f485e70-9463-4a7b-b673-9331fd2e4750 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:26.961142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f485e70-9463-4a7b-b673-9331fd2e4750 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:26.962508 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 160/326] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:26.967539 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df447dc-ed3c-4cba-9f8f-fa544ec36cf8 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:26.967826 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df447dc-ed3c-4cba-9f8f-fa544ec36cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:26.968105 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df447dc-ed3c-4cba-9f8f-fa544ec36cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:26.987689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb26ddb-3569-4578-822f-d9e571dfc4eb None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:27.002376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-5df447dc-ed3c-4cba-9f8f-fa544ec36cf8 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:27.004315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5df447dc-ed3c-4cba-9f8f-fa544ec36cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:27.031347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933b800-b745-4250-b2eb-e7ada43fbea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:27.032131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933b800-b745-4250-b2eb-e7ada43fbea3 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:27.032494 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933b800-b745-4250-b2eb-e7ada43fbea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:27.032984 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933b800-b745-4250-b2eb-e7ada43fbea3 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:27.033825 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933b800-b745-4250-b2eb-e7ada43fbea3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:27.034209 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933b800-b745-4250-b2eb-e7ada43fbea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:27.038198 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933b800-b745-4250-b2eb-e7ada43fbea3 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:27.047065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 167/327] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:27.057310 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933b800-b745-4250-b2eb-e7ada43fbea3 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:27.100692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 161/328] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:41:27.127927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:27.128556 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df447dc-ed3c-4cba-9f8f-fa544ec36cf8 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:27.193904 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933b800-b745-4250-b2eb-e7ada43fbea3 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:27.196857 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:27.231377 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb090a-29c3-45fd-98d8-44eeb2204181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:27.232033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb090a-29c3-45fd-98d8-44eeb2204181 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:27.232369 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb090a-29c3-45fd-98d8-44eeb2204181 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:27.232677 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb090a-29c3-45fd-98d8-44eeb2204181 None admin] PATH_INFO: `/v3/users/114904a0bd254fbc9566ffe3119f4455` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:27.233896 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb090a-29c3-45fd-98d8-44eeb2204181 None admin] RBAC: Authorizing `identity:get_user(user_id=114904a0bd254fbc9566ffe3119f4455)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:27.235360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb090a-29c3-45fd-98d8-44eeb2204181 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:27.237081 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 168/329] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:27 2022] GET /identity/v3/users/114904a0bd254fbc9566ffe3119f4455 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:27.243351 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb090a-29c3-45fd-98d8-44eeb2204181 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:27.257036 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df447dc-ed3c-4cba-9f8f-fa544ec36cf8 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:27.307254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e377c99-d3bb-411b-b241-fc596a4e3f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:27.309611 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e377c99-d3bb-411b-b241-fc596a4e3f55 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:27.310130 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e377c99-d3bb-411b-b241-fc596a4e3f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:27.310606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e377c99-d3bb-411b-b241-fc596a4e3f55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:27.321713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e377c99-d3bb-411b-b241-fc596a4e3f55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:27.337904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-9e377c99-d3bb-411b-b241-fc596a4e3f55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:27.337904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:27.337904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:27.337904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:27.337904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:27.337904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:27.337904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:27.337904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:27.337904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:27.337904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:27.337904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:27.337904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:27.337904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:27.337904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:27.337904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:27.337904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:27.338840 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:27.338840 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:27.338840 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:27.338840 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:27.338840 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:27.338840 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:27.338840 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:27.338840 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:27.338840 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:27.338840 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:27.338840 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:27.338840 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:27.338840 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:27.338840 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:27.338840 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:27.338840 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:27.339612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:27.339612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:27.339612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:27.339612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:27.339612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:27.339612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:27.339612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:27.339612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:27.339612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:27.339612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:27.339612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:27.339612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:27.342321 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 162/330] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:41:27.347970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e377c99-d3bb-411b-b241-fc596a4e3f55 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:27.353095 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb090a-29c3-45fd-98d8-44eeb2204181 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:27.364249 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:27.396095 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7af1a-e29f-46a2-9f26-7ad085ef08ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:27.397054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7af1a-e29f-46a2-9f26-7ad085ef08ce None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:27.397332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7af1a-e29f-46a2-9f26-7ad085ef08ce None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:27.397604 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7af1a-e29f-46a2-9f26-7ad085ef08ce None admin] PATH_INFO: `/v3/system/users/114904a0bd254fbc9566ffe3119f4455/roles/fcf1354e3e794c0297def593c19f0a76` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:27.399271 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7af1a-e29f-46a2-9f26-7ad085ef08ce None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=114904a0bd254fbc9566ffe3119f4455, role_id=fcf1354e3e794c0297def593c19f0a76)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:27.400888 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7af1a-e29f-46a2-9f26-7ad085ef08ce None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:27.460678 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 169/331] 10.222.0.36 () {58 vars in 1334 bytes} [Tue Jul 5 12:41:27 2022] PUT /identity/v3/system/users/114904a0bd254fbc9566ffe3119f4455/roles/fcf1354e3e794c0297def593c19f0a76 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:41:27.472229 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e377c99-d3bb-411b-b241-fc596a4e3f55 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:27.498964 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:27.519045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d8a22-1954-4860-a65f-4823d69455e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:27.519996 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d8a22-1954-4860-a65f-4823d69455e3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:27.520428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d8a22-1954-4860-a65f-4823d69455e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:27.520893 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d8a22-1954-4860-a65f-4823d69455e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:27.522041 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d8a22-1954-4860-a65f-4823d69455e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:27.522586 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d8a22-1954-4860-a65f-4823d69455e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:27.524138 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d8a22-1954-4860-a65f-4823d69455e3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:27.538244 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 163/332] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:27.542093 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7af1a-e29f-46a2-9f26-7ad085ef08ce None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:27.677424 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7af1a-e29f-46a2-9f26-7ad085ef08ce None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:27.713553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3456c-02d8-408e-aee8-830310de3b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:27.714741 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3456c-02d8-408e-aee8-830310de3b25 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:27.715236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3456c-02d8-408e-aee8-830310de3b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:27.715681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3456c-02d8-408e-aee8-830310de3b25 None admin] PATH_INFO: `/v3/users/9f336bfd3d7b46139d438be11b513c34` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:27.717079 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3456c-02d8-408e-aee8-830310de3b25 None admin] RBAC: Authorizing `identity:get_user(user_id=9f336bfd3d7b46139d438be11b513c34)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:27.718692 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3456c-02d8-408e-aee8-830310de3b25 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:27.720813 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 170/333] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:27 2022] GET /identity/v3/users/9f336bfd3d7b46139d438be11b513c34 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:27.727581 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d8a22-1954-4860-a65f-4823d69455e3 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:27.839526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d8a22-1954-4860-a65f-4823d69455e3 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:27.886106 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca056dd-72de-41cc-828b-f0b9f08606cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:27.887052 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca056dd-72de-41cc-828b-f0b9f08606cc None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:27.887497 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca056dd-72de-41cc-828b-f0b9f08606cc None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:27.888003 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca056dd-72de-41cc-828b-f0b9f08606cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:27.889013 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca056dd-72de-41cc-828b-f0b9f08606cc None admin] RBAC: Adding query filter params (role.id=66d9c5a190d544b3b3588bbdadf2cf39, user.id=9f336bfd3d7b46139d438be11b513c34, scope.system=all) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:27.889463 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca056dd-72de-41cc-828b-f0b9f08606cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:27.891137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca056dd-72de-41cc-828b-f0b9f08606cc None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:27.906951 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 164/334] 10.222.0.36 () {56 vars in 1308 bytes} [Tue Jul 5 12:41:27 2022] GET /identity/v3/role_assignments?user.id=9f336bfd3d7b46139d438be11b513c34&scope.system=all&role.id=66d9c5a190d544b3b3588bbdadf2cf39 => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:28.962802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e5a10-2a50-4f89-b0be-4cd0533616ce None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:28.963681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e5a10-2a50-4f89-b0be-4cd0533616ce None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:28.964180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e5a10-2a50-4f89-b0be-4cd0533616ce None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:28.966067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 171/335] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:28.971189 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8012c-cd1a-46aa-b2e3-f74dd4b7a404 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:28.972023 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8012c-cd1a-46aa-b2e3-f74dd4b7a404 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:28.972516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8012c-cd1a-46aa-b2e3-f74dd4b7a404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:28.994650 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-74f8012c-cd1a-46aa-b2e3-f74dd4b7a404 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:28.996456 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-74f8012c-cd1a-46aa-b2e3-f74dd4b7a404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:29.035366 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:29.096333 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 165/336] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:29.138993 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e5a10-2a50-4f89-b0be-4cd0533616ce None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:29.188567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:29.256697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e5a10-2a50-4f89-b0be-4cd0533616ce None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:29.298600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b944115-cfff-44d6-8888-400e67f703e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:29.299402 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b944115-cfff-44d6-8888-400e67f703e3 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:29.299686 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b944115-cfff-44d6-8888-400e67f703e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:29.299964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b944115-cfff-44d6-8888-400e67f703e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:29.315168 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b944115-cfff-44d6-8888-400e67f703e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:29.322922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-7b944115-cfff-44d6-8888-400e67f703e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:29.322922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:29.322922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:29.322922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:29.322922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:29.322922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:29.322922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:29.322922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:29.322922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:29.322922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:29.322922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:29.322922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:29.322922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:29.322922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:29.322922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:29.322922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:29.323820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:29.323820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:29.323820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:29.323820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:29.323820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:29.323820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:29.323820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:29.323820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:29.323820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:29.323820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:29.323820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:29.323820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:29.323820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:29.323820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:29.323820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:29.323820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:29.324623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:29.324623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:29.324623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:29.324623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:29.324623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:29.324623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:29.324623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:29.324623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:29.324623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:29.324623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:29.324623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:29.324623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:29.324623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 172/337] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:29.334223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8012c-cd1a-46aa-b2e3-f74dd4b7a404 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:29.484169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8012c-cd1a-46aa-b2e3-f74dd4b7a404 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:29.531864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74615c-f5f2-4b16-b988-f5c43279db0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:29.532539 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74615c-f5f2-4b16-b988-f5c43279db0e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:29.532841 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74615c-f5f2-4b16-b988-f5c43279db0e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:29.533175 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74615c-f5f2-4b16-b988-f5c43279db0e None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:29.533870 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74615c-f5f2-4b16-b988-f5c43279db0e None admin] RBAC: Adding query filter params (name=member) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:29.534171 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74615c-f5f2-4b16-b988-f5c43279db0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:29.535547 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74615c-f5f2-4b16-b988-f5c43279db0e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:29.546428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 166/338] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:29.552438 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b944115-cfff-44d6-8888-400e67f703e3 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:29.680625 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b944115-cfff-44d6-8888-400e67f703e3 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:29.682584 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:29.724853 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81f032-07af-4c2d-b05b-0c4d9610db8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:29.725524 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81f032-07af-4c2d-b05b-0c4d9610db8a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:29.725806 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81f032-07af-4c2d-b05b-0c4d9610db8a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:29.726082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81f032-07af-4c2d-b05b-0c4d9610db8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:29.756543 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8c1ee-8646-4b0a-a727-e1f71d4cc8a2 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:29.757267 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8c1ee-8646-4b0a-a727-e1f71d4cc8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:29.757896 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8c1ee-8646-4b0a-a727-e1f71d4cc8a2 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:29.759557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 167/339] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:41:29.766321 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a95ba-416d-4093-b394-90e8994b10ba None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:29.766941 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a95ba-416d-4093-b394-90e8994b10ba None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:29.767416 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a95ba-416d-4093-b394-90e8994b10ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:29.786528 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-248a95ba-416d-4093-b394-90e8994b10ba None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:29.788893 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-248a95ba-416d-4093-b394-90e8994b10ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:29.809230 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81f032-07af-4c2d-b05b-0c4d9610db8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:29.811003 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81f032-07af-4c2d-b05b-0c4d9610db8a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:29.820023 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:29.870528 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 168/340] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:29.896210 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a95ba-416d-4093-b394-90e8994b10ba None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:29.957455 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 173/341] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:29.962862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81f032-07af-4c2d-b05b-0c4d9610db8a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:29.965023 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:30.013684 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a95ba-416d-4093-b394-90e8994b10ba None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:30.070368 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cffb68-c9d1-4c15-a22e-4c660df08fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:30.071201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cffb68-c9d1-4c15-a22e-4c660df08fea None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:30.071480 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cffb68-c9d1-4c15-a22e-4c660df08fea None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:30.071753 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cffb68-c9d1-4c15-a22e-4c660df08fea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:30.083416 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cffb68-c9d1-4c15-a22e-4c660df08fea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:30.093219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-09cffb68-c9d1-4c15-a22e-4c660df08fea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:30.093219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:30.093219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:30.093219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:30.093219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:30.093219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:30.093219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:30.093219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:30.093219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:30.093219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:30.093219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:30.093219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:30.093219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:30.093219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:30.093219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:30.093219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:30.094100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:30.094100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:30.094100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:30.094100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:30.094100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:30.094100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:30.094100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:30.094100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:30.094100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:30.094100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:30.094100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:30.094100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:30.094100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:30.094100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:30.094100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:30.094100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:30.094894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:30.094894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:30.094894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:30.094894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:30.094894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:30.094894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:30.094894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:30.094894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:30.094894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:30.094894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:30.094894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:30.094894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:30.094894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 169/342] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jul 5 12:41:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:30.101464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cffb68-c9d1-4c15-a22e-4c660df08fea None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:30.154197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:30.171223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81f032-07af-4c2d-b05b-0c4d9610db8a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:30.223300 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad84ec-74bb-48f1-a63e-626ef1043c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:30.224171 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad84ec-74bb-48f1-a63e-626ef1043c39 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:30.224807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad84ec-74bb-48f1-a63e-626ef1043c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:30.225084 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad84ec-74bb-48f1-a63e-626ef1043c39 None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:30.227016 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad84ec-74bb-48f1-a63e-626ef1043c39 None admin] RBAC: Authorizing `identity:get_project(project_id=3643e64d3f194dc5bef838b26b6bb808)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:30.228458 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad84ec-74bb-48f1-a63e-626ef1043c39 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:30.235676 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 174/343] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:29 2022] GET /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:30.236961 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd03fbe-2b78-4447-893b-42b3d9a81074 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:30.237243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd03fbe-2b78-4447-893b-42b3d9a81074 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:30.237705 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd03fbe-2b78-4447-893b-42b3d9a81074 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:30.241067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 175/344] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:30.241649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd03fbe-2b78-4447-893b-42b3d9a81074 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:30.302276 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cffb68-c9d1-4c15-a22e-4c660df08fea None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:30.375793 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9888547-cb22-42cd-b611-18a897535a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:30.377566 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9888547-cb22-42cd-b611-18a897535a99 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:30.377858 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9888547-cb22-42cd-b611-18a897535a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:30.379881 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9888547-cb22-42cd-b611-18a897535a99 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:30.380726 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9888547-cb22-42cd-b611-18a897535a99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:30.381045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9888547-cb22-42cd-b611-18a897535a99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:30.382445 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9888547-cb22-42cd-b611-18a897535a99 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:30.385624 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:30.403918 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 170/345] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:41:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:30.411097 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657e0aa-0d70-4cd1-b21d-3078dc14e9ec None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:30.411388 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657e0aa-0d70-4cd1-b21d-3078dc14e9ec None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:30.411667 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657e0aa-0d70-4cd1-b21d-3078dc14e9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:30.448566 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-0657e0aa-0d70-4cd1-b21d-3078dc14e9ec None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:30.449786 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0657e0aa-0d70-4cd1-b21d-3078dc14e9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:30.451864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd03fbe-2b78-4447-893b-42b3d9a81074 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:30.518483 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ca21d-dff1-437f-9d5d-c27884435a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:30.519555 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ca21d-dff1-437f-9d5d-c27884435a8a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:30.519830 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ca21d-dff1-437f-9d5d-c27884435a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:30.520103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ca21d-dff1-437f-9d5d-c27884435a8a None admin] PATH_INFO: `/v3/groups/80d3225599fd4914837c49dc6f92d39e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:30.534354 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ca21d-dff1-437f-9d5d-c27884435a8a None admin] RBAC: Authorizing `identity:get_group(group_id=80d3225599fd4914837c49dc6f92d39e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:30.537858 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ca21d-dff1-437f-9d5d-c27884435a8a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:30.539813 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 176/346] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jul 5 12:41:30 2022] GET /identity/v3/groups/80d3225599fd4914837c49dc6f92d39e => generated 226 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:30.540634 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ca21d-dff1-437f-9d5d-c27884435a8a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:30.595819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 171/347] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:30.596560 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657e0aa-0d70-4cd1-b21d-3078dc14e9ec None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:30.637027 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:30.703126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ca21d-dff1-437f-9d5d-c27884435a8a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:30.753050 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd0168-bf1c-49f2-b92c-9af1b8c8b902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:30.753720 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd0168-bf1c-49f2-b92c-9af1b8c8b902 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:30.754000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd0168-bf1c-49f2-b92c-9af1b8c8b902 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:30.754410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd0168-bf1c-49f2-b92c-9af1b8c8b902 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:30.757821 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657e0aa-0d70-4cd1-b21d-3078dc14e9ec None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:30.776990 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:30.798497 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534e51d-8b87-4133-8d5e-318f45be16ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:30.799160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534e51d-8b87-4133-8d5e-318f45be16ea None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:30.799448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534e51d-8b87-4133-8d5e-318f45be16ea None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:30.800746 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534e51d-8b87-4133-8d5e-318f45be16ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:30.800746 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534e51d-8b87-4133-8d5e-318f45be16ea None admin] RBAC: Adding query filter params (group.id=80d3225599fd4914837c49dc6f92d39e, role.id=66d9c5a190d544b3b3588bbdadf2cf39, scope.project.id=3643e64d3f194dc5bef838b26b6bb808) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:30.800989 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534e51d-8b87-4133-8d5e-318f45be16ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:30.802934 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534e51d-8b87-4133-8d5e-318f45be16ea None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:30.809151 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 172/348] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jul 5 12:41:30 2022] GET /identity/v3/role_assignments?group.id=80d3225599fd4914837c49dc6f92d39e&scope.project.id=3643e64d3f194dc5bef838b26b6bb808&role.id=66d9c5a190d544b3b3588bbdadf2cf39 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:30.809969 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534e51d-8b87-4133-8d5e-318f45be16ea None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:30.878108 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd0168-bf1c-49f2-b92c-9af1b8c8b902 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:30.883263 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd0168-bf1c-49f2-b92c-9af1b8c8b902 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:30.964019 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:30.992160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534e51d-8b87-4133-8d5e-318f45be16ea None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:31.071173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009df69-09ed-4c55-b6d5-f2274eacc377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:31.071999 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009df69-09ed-4c55-b6d5-f2274eacc377 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:31.072280 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009df69-09ed-4c55-b6d5-f2274eacc377 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:31.072556 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009df69-09ed-4c55-b6d5-f2274eacc377 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:31.076872 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 177/349] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:31.083248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd0168-bf1c-49f2-b92c-9af1b8c8b902 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:31.089759 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009df69-09ed-4c55-b6d5-f2274eacc377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:31.098729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-3009df69-09ed-4c55-b6d5-f2274eacc377 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:31.098729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:31.098729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:31.098729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:31.098729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:31.098729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:31.098729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:31.098729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:31.098729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:31.098729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:31.098729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:31.098729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:31.098729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:31.098729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:31.098729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:31.098729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:31.100299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:31.100299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:31.100299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:31.100299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:31.100299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:31.100299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:31.100299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:31.100299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:31.100299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:31.100299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:31.100299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:31.100299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:31.100299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:31.100299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:31.100299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:31.100299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:31.101169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:31.101169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:31.101169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:31.101169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:31.101169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:31.101169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:31.101169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:31.101169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:31.101169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:31.101169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:31.101169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:31.101169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:31.101169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 173/350] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:31.106706 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009df69-09ed-4c55-b6d5-f2274eacc377 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:31.152343 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:31.233410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd0168-bf1c-49f2-b92c-9af1b8c8b902 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:31.253079 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009df69-09ed-4c55-b6d5-f2274eacc377 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:31.270879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d555f9a-17bb-478d-b897-3dd4f3c10253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:31.272457 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d555f9a-17bb-478d-b897-3dd4f3c10253 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:31.272806 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d555f9a-17bb-478d-b897-3dd4f3c10253 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:31.273092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d555f9a-17bb-478d-b897-3dd4f3c10253 None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:31.274439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d555f9a-17bb-478d-b897-3dd4f3c10253 None admin] RBAC: Authorizing `identity:get_project(project_id=3643e64d3f194dc5bef838b26b6bb808)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:31.275896 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d555f9a-17bb-478d-b897-3dd4f3c10253 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:31.278154 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 178/351] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:31 2022] GET /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:31.279344 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff6944-55b9-4de5-90f7-8af9e56df274 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:31.279682 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff6944-55b9-4de5-90f7-8af9e56df274 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:31.279960 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff6944-55b9-4de5-90f7-8af9e56df274 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:31.288292 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 179/352] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:31.288292 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d31063-e1ae-4f71-81fb-6b209c43a06c None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:31.288292 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d31063-e1ae-4f71-81fb-6b209c43a06c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:31.288292 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d31063-e1ae-4f71-81fb-6b209c43a06c None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:31.288292 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 180/353] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:31.289707 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6f30a-7a45-4eb7-9178-2a5cd8a7623c None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:31.290246 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6f30a-7a45-4eb7-9178-2a5cd8a7623c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:31.291530 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6f30a-7a45-4eb7-9178-2a5cd8a7623c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:31.307951 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1585d-c58d-400f-b3aa-2a89941e1aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:31.309044 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1585d-c58d-400f-b3aa-2a89941e1aeb None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:31.309353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-6ca6f30a-7a45-4eb7-9178-2a5cd8a7623c None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:31.309717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1585d-c58d-400f-b3aa-2a89941e1aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:31.310173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1585d-c58d-400f-b3aa-2a89941e1aeb None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:31.310750 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6ca6f30a-7a45-4eb7-9178-2a5cd8a7623c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:31.311293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1585d-c58d-400f-b3aa-2a89941e1aeb None admin] RBAC: Adding query filter params (name=member) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:31.311769 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1585d-c58d-400f-b3aa-2a89941e1aeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:31.314029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1585d-c58d-400f-b3aa-2a89941e1aeb None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:31.317734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:31.327532 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 174/354] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:31.329699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819c157-2c50-48ad-b1ab-0949aa0e890e None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:31.336099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819c157-2c50-48ad-b1ab-0949aa0e890e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:31.336099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819c157-2c50-48ad-b1ab-0949aa0e890e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:31.352683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-3819c157-2c50-48ad-b1ab-0949aa0e890e None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:31.354199 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3819c157-2c50-48ad-b1ab-0949aa0e890e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:31.395011 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 181/355] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:31.396797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6f30a-7a45-4eb7-9178-2a5cd8a7623c None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:31.454667 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 175/356] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:31.455546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819c157-2c50-48ad-b1ab-0949aa0e890e None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:31.465669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:31.561125 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6f30a-7a45-4eb7-9178-2a5cd8a7623c None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:31.582483 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819c157-2c50-48ad-b1ab-0949aa0e890e None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:31.610816 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0aaf2-9608-4c10-942f-b803bc1610cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:31.611751 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0aaf2-9608-4c10-942f-b803bc1610cb None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:31.612041 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0aaf2-9608-4c10-942f-b803bc1610cb None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:31.612321 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0aaf2-9608-4c10-942f-b803bc1610cb None admin] PATH_INFO: `/v3/groups/80d3225599fd4914837c49dc6f92d39e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:31.613678 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0aaf2-9608-4c10-942f-b803bc1610cb None admin] RBAC: Authorizing `identity:get_group(group_id=80d3225599fd4914837c49dc6f92d39e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:31.614226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:31.616371 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0aaf2-9608-4c10-942f-b803bc1610cb None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:31.618375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 182/357] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jul 5 12:41:31 2022] GET /identity/v3/groups/80d3225599fd4914837c49dc6f92d39e => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:31.619226 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0aaf2-9608-4c10-942f-b803bc1610cb None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:31.625288 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fd31d-fc0e-4229-8334-8b98761c2380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:31.631254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fd31d-fc0e-4229-8334-8b98761c2380 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:31.631254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fd31d-fc0e-4229-8334-8b98761c2380 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:31.631254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fd31d-fc0e-4229-8334-8b98761c2380 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:31.710624 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fd31d-fc0e-4229-8334-8b98761c2380 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:31.713418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fd31d-fc0e-4229-8334-8b98761c2380 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:31.759327 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:31.762619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0aaf2-9608-4c10-942f-b803bc1610cb None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:31.804553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9437fc-c34f-4944-b8c6-adb123a84128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:31.805703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9437fc-c34f-4944-b8c6-adb123a84128 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:31.806130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9437fc-c34f-4944-b8c6-adb123a84128 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:31.806577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9437fc-c34f-4944-b8c6-adb123a84128 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:31.820510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9437fc-c34f-4944-b8c6-adb123a84128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:31.828721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-5d9437fc-c34f-4944-b8c6-adb123a84128 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:41:31.828721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:31.828721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:31.828721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:31.828721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:31.828721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:31.828721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:31.828721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:31.828721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:31.828721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:31.828721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:31.828721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:31.828721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:31.828721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:31.828721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:31.828721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:31.829630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:31.829630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:31.829630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:31.829630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:31.829630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:31.829630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:31.829630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:31.829630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:31.829630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:31.829630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:31.829630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:31.829630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:31.829630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:31.829630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:31.829630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:31.829630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:31.830409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:31.830409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:31.830409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:31.830409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:31.830409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:31.830409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:31.830409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:31.830409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:31.830409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:31.830409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:31.830409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 12:41:31.830409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:31.830409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 183/358] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:31.831055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9437fc-c34f-4944-b8c6-adb123a84128 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:31.847223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 176/359] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:31.848966 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82ad88-d0e8-4253-aae2-42e65b14c983 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:31.850034 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82ad88-d0e8-4253-aae2-42e65b14c983 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:31.850697 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82ad88-d0e8-4253-aae2-42e65b14c983 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:31.860536 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 177/360] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:31 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:31.860536 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82ad88-d0e8-4253-aae2-42e65b14c983 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:31.904678 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:31.962924 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9437fc-c34f-4944-b8c6-adb123a84128 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:32.007864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67b4a9-d693-4c70-8601-69c42011b4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:32.009078 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67b4a9-d693-4c70-8601-69c42011b4ff None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:32.009588 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67b4a9-d693-4c70-8601-69c42011b4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:32.010007 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67b4a9-d693-4c70-8601-69c42011b4ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:32.012532 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82ad88-d0e8-4253-aae2-42e65b14c983 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:32.022651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67b4a9-d693-4c70-8601-69c42011b4ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:32.030929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-4f67b4a9-d693-4c70-8601-69c42011b4ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:32.030929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:32.030929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:32.030929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:32.030929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:32.030929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:32.030929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:32.030929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:32.030929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:32.030929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:32.030929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:32.030929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:32.030929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:32.030929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:32.030929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:32.030929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:32.031954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:32.031954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:32.031954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:32.031954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:32.031954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:32.031954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:32.031954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:32.031954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:32.031954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:32.031954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:32.031954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:32.031954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:32.031954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:32.031954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:32.031954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:32.031954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:32.032893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:32.032893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:32.032893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:32.032893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:32.032893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:32.032893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:32.032893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:32.032893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:32.032893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:32.032893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:32.032893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:32.032893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:32.035191 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 184/361] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jul 5 12:41:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:32.036129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67b4a9-d693-4c70-8601-69c42011b4ff None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:32.063050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a3477-8c5e-420f-82e8-60cab4218d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:32.063050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a3477-8c5e-420f-82e8-60cab4218d67 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:32.063050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a3477-8c5e-420f-82e8-60cab4218d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:32.063050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a3477-8c5e-420f-82e8-60cab4218d67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:32.063455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a3477-8c5e-420f-82e8-60cab4218d67 None admin] RBAC: Adding query filter params (group.id=80d3225599fd4914837c49dc6f92d39e, role.id=5ea7d4a868fb49b8992c3adb30476789, scope.project.id=3643e64d3f194dc5bef838b26b6bb808) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:32.063455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a3477-8c5e-420f-82e8-60cab4218d67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:32.064362 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a3477-8c5e-420f-82e8-60cab4218d67 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:32.073659 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:32.073813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 178/362] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jul 5 12:41:31 2022] GET /identity/v3/role_assignments?group.id=80d3225599fd4914837c49dc6f92d39e&scope.project.id=3643e64d3f194dc5bef838b26b6bb808&role.id=5ea7d4a868fb49b8992c3adb30476789 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:32.074573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a3477-8c5e-420f-82e8-60cab4218d67 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:32.167472 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67b4a9-d693-4c70-8601-69c42011b4ff None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:32.193437 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:32.203327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a3477-8c5e-420f-82e8-60cab4218d67 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:32.210754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd883e8-c052-4300-afa6-b7ad690e01ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:32.211758 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd883e8-c052-4300-afa6-b7ad690e01ca None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:32.212226 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd883e8-c052-4300-afa6-b7ad690e01ca None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:32.212750 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd883e8-c052-4300-afa6-b7ad690e01ca None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:32.213894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd883e8-c052-4300-afa6-b7ad690e01ca None admin] RBAC: Adding query filter params (name=reader) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:32.214400 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd883e8-c052-4300-afa6-b7ad690e01ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:32.216040 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd883e8-c052-4300-afa6-b7ad690e01ca None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:32.228459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 185/363] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:32.234472 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058d2e6-33ba-47a9-b43d-fda5d770bebb None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:32.235062 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058d2e6-33ba-47a9-b43d-fda5d770bebb None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:32.235552 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058d2e6-33ba-47a9-b43d-fda5d770bebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:32.253774 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b4987-4030-4ffc-a0c7-fe6342c99555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:32.254560 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b4987-4030-4ffc-a0c7-fe6342c99555 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:32.254850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b4987-4030-4ffc-a0c7-fe6342c99555 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:32.255131 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b4987-4030-4ffc-a0c7-fe6342c99555 None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:32.256471 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b4987-4030-4ffc-a0c7-fe6342c99555 None admin] RBAC: Authorizing `identity:get_project(project_id=769c25d7cd5442f3a9359fa294a9befe)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:32.257023 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-7058d2e6-33ba-47a9-b43d-fda5d770bebb None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:32.257989 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b4987-4030-4ffc-a0c7-fe6342c99555 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:32.258713 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7058d2e6-33ba-47a9-b43d-fda5d770bebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:32.259757 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 179/364] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:32 2022] GET /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:32.260532 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b4987-4030-4ffc-a0c7-fe6342c99555 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:32.342734 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 186/365] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:32.343641 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058d2e6-33ba-47a9-b43d-fda5d770bebb None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:32.361875 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:32.403033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b4987-4030-4ffc-a0c7-fe6342c99555 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:32.445649 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704376b-5488-4a93-85a2-806fb4494d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:32.446641 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704376b-5488-4a93-85a2-806fb4494d81 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:32.447100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704376b-5488-4a93-85a2-806fb4494d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:32.447560 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704376b-5488-4a93-85a2-806fb4494d81 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:32.448943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704376b-5488-4a93-85a2-806fb4494d81 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:32.449429 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704376b-5488-4a93-85a2-806fb4494d81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:32.451122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704376b-5488-4a93-85a2-806fb4494d81 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:32.462826 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 180/366] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:41:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:32.464200 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704376b-5488-4a93-85a2-806fb4494d81 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:32.467112 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058d2e6-33ba-47a9-b43d-fda5d770bebb None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:32.493648 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:32.523614 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bf2ff-c214-4240-871f-f6e7ab1dd3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:32.524611 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bf2ff-c214-4240-871f-f6e7ab1dd3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:32.524976 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bf2ff-c214-4240-871f-f6e7ab1dd3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:32.525326 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bf2ff-c214-4240-871f-f6e7ab1dd3e8 None admin] PATH_INFO: `/v3/users/114904a0bd254fbc9566ffe3119f4455` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:32.527189 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bf2ff-c214-4240-871f-f6e7ab1dd3e8 None admin] RBAC: Authorizing `identity:get_user(user_id=114904a0bd254fbc9566ffe3119f4455)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:32.529610 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bf2ff-c214-4240-871f-f6e7ab1dd3e8 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:32.534324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 187/367] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:41:32 2022] GET /identity/v3/users/114904a0bd254fbc9566ffe3119f4455 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:32.535808 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bf2ff-c214-4240-871f-f6e7ab1dd3e8 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:32.585395 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704376b-5488-4a93-85a2-806fb4494d81 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:32.631850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd9490-8e0c-4d3f-83da-d4b9b71ee855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:32.633178 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd9490-8e0c-4d3f-83da-d4b9b71ee855 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:32.634131 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd9490-8e0c-4d3f-83da-d4b9b71ee855 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:32.634607 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd9490-8e0c-4d3f-83da-d4b9b71ee855 None admin] PATH_INFO: `/v3/groups/80d3225599fd4914837c49dc6f92d39e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:32.636254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd9490-8e0c-4d3f-83da-d4b9b71ee855 None admin] RBAC: Authorizing `identity:get_group(group_id=80d3225599fd4914837c49dc6f92d39e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:32.638132 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd9490-8e0c-4d3f-83da-d4b9b71ee855 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:32.640755 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 181/368] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jul 5 12:41:32 2022] GET /identity/v3/groups/80d3225599fd4914837c49dc6f92d39e => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:32.641752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd9490-8e0c-4d3f-83da-d4b9b71ee855 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:32.665904 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:32.704275 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bf2ff-c214-4240-871f-f6e7ab1dd3e8 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:32.756903 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:32.769918 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd9490-8e0c-4d3f-83da-d4b9b71ee855 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:32.775760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a3ab1-3c44-4a7c-9944-8062349f0256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:32.776565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a3ab1-3c44-4a7c-9944-8062349f0256 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:32.776876 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a3ab1-3c44-4a7c-9944-8062349f0256 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:32.777153 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a3ab1-3c44-4a7c-9944-8062349f0256 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:32.797908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a3ab1-3c44-4a7c-9944-8062349f0256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:32.810369 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21ac6c-ebec-49d3-b3ac-63eeff527845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:32.811325 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21ac6c-ebec-49d3-b3ac-63eeff527845 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:32.811823 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21ac6c-ebec-49d3-b3ac-63eeff527845 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:32.812296 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21ac6c-ebec-49d3-b3ac-63eeff527845 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:32.817712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-d59a3ab1-3c44-4a7c-9944-8062349f0256 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:41:32.817712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:32.817712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:32.817712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:32.817712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:32.817712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:32.817712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:32.817712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:32.817712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:32.817712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:32.817712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:32.817712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:32.817712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:32.817712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:32.817712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:32.817712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:32.818646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:32.818646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:32.818646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:32.818646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:32.818646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:32.818646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:32.818646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:32.818646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:32.818646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:32.818646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:32.818646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:32.818646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:32.818646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:32.818646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:32.818646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:32.818646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:32.819459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:32.819459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:32.819459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:32.819459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:32.819459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:32.819459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:32.819459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:32.819459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:32.819459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:32.819459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:32.819459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:41:32.819459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:32.819459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 188/369] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:41:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:32.822982 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a3ab1-3c44-4a7c-9944-8062349f0256 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:32.899680 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21ac6c-ebec-49d3-b3ac-63eeff527845 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:32.901672 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21ac6c-ebec-49d3-b3ac-63eeff527845 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:33.020181 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:33.026337 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 182/370] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:33.027411 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21ac6c-ebec-49d3-b3ac-63eeff527845 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:33.093353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a3ab1-3c44-4a7c-9944-8062349f0256 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:33.157263 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c72bc-036d-4551-8fb4-b58c35164850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:33.158342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c72bc-036d-4551-8fb4-b58c35164850 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:33.158828 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c72bc-036d-4551-8fb4-b58c35164850 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:33.159305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c72bc-036d-4551-8fb4-b58c35164850 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:33.160512 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c72bc-036d-4551-8fb4-b58c35164850 None admin] RBAC: Adding query filter params (role.id=fcf1354e3e794c0297def593c19f0a76, user.id=114904a0bd254fbc9566ffe3119f4455, scope.system=all) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:33.162403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c72bc-036d-4551-8fb4-b58c35164850 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:33.164071 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c72bc-036d-4551-8fb4-b58c35164850 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:33.185947 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:33.189512 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 189/371] 10.222.0.36 () {56 vars in 1308 bytes} [Tue Jul 5 12:41:32 2022] GET /identity/v3/role_assignments?user.id=114904a0bd254fbc9566ffe3119f4455&scope.system=all&role.id=fcf1354e3e794c0297def593c19f0a76 => generated 510 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:33.190720 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c72bc-036d-4551-8fb4-b58c35164850 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:33.233691 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21ac6c-ebec-49d3-b3ac-63eeff527845 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:33.323161 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4d0ce-1b75-4f44-80f3-4a180e1e8374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:33.323844 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4d0ce-1b75-4f44-80f3-4a180e1e8374 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:33.324130 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4d0ce-1b75-4f44-80f3-4a180e1e8374 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:33.324410 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4d0ce-1b75-4f44-80f3-4a180e1e8374 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:33.325308 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4d0ce-1b75-4f44-80f3-4a180e1e8374 None admin] RBAC: Adding query filter params (group.id=80d3225599fd4914837c49dc6f92d39e, role.id=66d9c5a190d544b3b3588bbdadf2cf39, scope.project.id=769c25d7cd5442f3a9359fa294a9befe) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:33.325624 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4d0ce-1b75-4f44-80f3-4a180e1e8374 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:33.327106 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4d0ce-1b75-4f44-80f3-4a180e1e8374 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:33.337429 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 183/372] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jul 5 12:41:33 2022] GET /identity/v3/role_assignments?group.id=80d3225599fd4914837c49dc6f92d39e&scope.project.id=769c25d7cd5442f3a9359fa294a9befe&role.id=66d9c5a190d544b3b3588bbdadf2cf39 => generated 260 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:33.338491 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4d0ce-1b75-4f44-80f3-4a180e1e8374 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:33.430679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:33.451653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c72bc-036d-4551-8fb4-b58c35164850 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:33.503165 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4d0ce-1b75-4f44-80f3-4a180e1e8374 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:33.507518 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29c674-4dca-4728-a3d9-e70a08cb60e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:33.508502 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29c674-4dca-4728-a3d9-e70a08cb60e6 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:33.509062 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29c674-4dca-4728-a3d9-e70a08cb60e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:33.509585 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29c674-4dca-4728-a3d9-e70a08cb60e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:33.510568 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29c674-4dca-4728-a3d9-e70a08cb60e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:33.511077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29c674-4dca-4728-a3d9-e70a08cb60e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:33.512751 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29c674-4dca-4728-a3d9-e70a08cb60e6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:33.522856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 190/373] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:33.524481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed69bd-c32e-4f8e-9249-51f48fdf4c42 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:33.524998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed69bd-c32e-4f8e-9249-51f48fdf4c42 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:33.525473 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed69bd-c32e-4f8e-9249-51f48fdf4c42 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:33.530360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 191/374] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:33.532006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed69bd-c32e-4f8e-9249-51f48fdf4c42 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:33.548315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a470c40-6284-4548-bbd8-7de16e0bde7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:33.549320 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a470c40-6284-4548-bbd8-7de16e0bde7e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:33.549652 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a470c40-6284-4548-bbd8-7de16e0bde7e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:33.550370 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a470c40-6284-4548-bbd8-7de16e0bde7e None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:33.551943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a470c40-6284-4548-bbd8-7de16e0bde7e None admin] RBAC: Authorizing `identity:get_project(project_id=769c25d7cd5442f3a9359fa294a9befe)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:33.554568 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a470c40-6284-4548-bbd8-7de16e0bde7e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:33.557007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 184/375] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:33 2022] GET /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:33.558231 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96742426-c4c0-4733-85f8-cba8209a6211 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:33.558568 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96742426-c4c0-4733-85f8-cba8209a6211 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:33.558977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96742426-c4c0-4733-85f8-cba8209a6211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:33.581202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-96742426-c4c0-4733-85f8-cba8209a6211 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:33.582663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-96742426-c4c0-4733-85f8-cba8209a6211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:33.610822 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:33.669382 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed69bd-c32e-4f8e-9249-51f48fdf4c42 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:33.678285 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 185/376] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:33.679195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96742426-c4c0-4733-85f8-cba8209a6211 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:33.711374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd924b-772c-4812-8b9e-778320a3887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:33.711959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd924b-772c-4812-8b9e-778320a3887c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:33.712243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd924b-772c-4812-8b9e-778320a3887c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:33.712516 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd924b-772c-4812-8b9e-778320a3887c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:33.760078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:33.809761 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd924b-772c-4812-8b9e-778320a3887c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:33.811870 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd924b-772c-4812-8b9e-778320a3887c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:33.817429 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96742426-c4c0-4733-85f8-cba8209a6211 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:33.869355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d0f5c-6464-4b08-9d3c-f877f44de243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:33.870329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d0f5c-6464-4b08-9d3c-f877f44de243 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:33.870624 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d0f5c-6464-4b08-9d3c-f877f44de243 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:33.870900 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d0f5c-6464-4b08-9d3c-f877f44de243 None admin] PATH_INFO: `/v3/groups/80d3225599fd4914837c49dc6f92d39e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:33.872178 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d0f5c-6464-4b08-9d3c-f877f44de243 None admin] RBAC: Authorizing `identity:get_group(group_id=80d3225599fd4914837c49dc6f92d39e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:33.873687 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d0f5c-6464-4b08-9d3c-f877f44de243 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:33.875698 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 186/377] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jul 5 12:41:33 2022] GET /identity/v3/groups/80d3225599fd4914837c49dc6f92d39e => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:33.876299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d0f5c-6464-4b08-9d3c-f877f44de243 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:33.892900 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:33.948106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 192/378] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:33.953402 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd924b-772c-4812-8b9e-778320a3887c None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:34.009879 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d0f5c-6464-4b08-9d3c-f877f44de243 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:34.035447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:34.052140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42467265-ecc8-4294-bc2b-8fd69af152b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:34.053036 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42467265-ecc8-4294-bc2b-8fd69af152b9 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:34.053447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42467265-ecc8-4294-bc2b-8fd69af152b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:34.054399 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42467265-ecc8-4294-bc2b-8fd69af152b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:34.064925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42467265-ecc8-4294-bc2b-8fd69af152b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:34.074573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-42467265-ecc8-4294-bc2b-8fd69af152b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:34.074573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:34.074573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:34.074573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:34.074573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:34.074573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:34.074573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:34.074573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:34.074573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:34.074573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:34.074573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:34.074573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:34.074573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:34.074573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:34.074573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:34.074573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:34.075509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:34.075509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:34.075509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:34.075509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:34.075509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:34.075509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:34.075509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:34.075509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:34.075509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:34.075509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:34.075509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:34.075509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:34.075509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:34.075509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:34.075509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:34.075509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:34.076360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:34.076360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:34.076360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:34.076360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:34.076360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:34.076360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:34.076360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:34.076360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:34.076360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:34.076360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:34.076360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:34.076360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:34.076360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 187/379] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:34.077518 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42467265-ecc8-4294-bc2b-8fd69af152b9 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:34.082186 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd924b-772c-4812-8b9e-778320a3887c None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:34.119859 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2902f-62f4-4e7c-bb53-2cfcbcc379b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:34.120823 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2902f-62f4-4e7c-bb53-2cfcbcc379b9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:34.121279 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2902f-62f4-4e7c-bb53-2cfcbcc379b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:34.121695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2902f-62f4-4e7c-bb53-2cfcbcc379b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:34.122795 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2902f-62f4-4e7c-bb53-2cfcbcc379b9 None admin] RBAC: Adding query filter params (group.id=80d3225599fd4914837c49dc6f92d39e, role.id=5ea7d4a868fb49b8992c3adb30476789, scope.project.id=769c25d7cd5442f3a9359fa294a9befe) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:34.123256 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2902f-62f4-4e7c-bb53-2cfcbcc379b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:34.124920 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2902f-62f4-4e7c-bb53-2cfcbcc379b9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:34.132055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 193/380] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jul 5 12:41:33 2022] GET /identity/v3/role_assignments?group.id=80d3225599fd4914837c49dc6f92d39e&scope.project.id=769c25d7cd5442f3a9359fa294a9befe&role.id=5ea7d4a868fb49b8992c3adb30476789 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:34.137333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2902f-62f4-4e7c-bb53-2cfcbcc379b9 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:34.185056 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:34.200672 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42467265-ecc8-4294-bc2b-8fd69af152b9 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:34.244963 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9d3ec-0c8b-43e4-bc25-8e719b58c9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:34.245847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9d3ec-0c8b-43e4-bc25-8e719b58c9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:34.246129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9d3ec-0c8b-43e4-bc25-8e719b58c9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:34.246407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9d3ec-0c8b-43e4-bc25-8e719b58c9f4 None admin] PATH_INFO: `/v3/projects/b34caad9134a4665ac2d8976c95be2ac` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:34.247841 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9d3ec-0c8b-43e4-bc25-8e719b58c9f4 None admin] RBAC: Authorizing `identity:get_project(project_id=b34caad9134a4665ac2d8976c95be2ac)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:34.250438 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9d3ec-0c8b-43e4-bc25-8e719b58c9f4 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:34.258474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 188/381] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:34 2022] GET /identity/v3/projects/b34caad9134a4665ac2d8976c95be2ac => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:34.265054 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9d3ec-0c8b-43e4-bc25-8e719b58c9f4 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:34.316257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2902f-62f4-4e7c-bb53-2cfcbcc379b9 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:34.372977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:34.406068 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893509e-0e8b-4c4a-b25f-9427861ea21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:34.406764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893509e-0e8b-4c4a-b25f-9427861ea21d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:34.407046 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893509e-0e8b-4c4a-b25f-9427861ea21d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:34.407323 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893509e-0e8b-4c4a-b25f-9427861ea21d None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:34.408085 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893509e-0e8b-4c4a-b25f-9427861ea21d None admin] RBAC: Adding query filter params (name=member) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:34.408396 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893509e-0e8b-4c4a-b25f-9427861ea21d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:34.409831 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893509e-0e8b-4c4a-b25f-9427861ea21d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:34.426973 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 194/382] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:34.430553 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9d3ec-0c8b-43e4-bc25-8e719b58c9f4 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:34.432799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893509e-0e8b-4c4a-b25f-9427861ea21d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:34.470036 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0abce-0287-4ab4-bb48-7149f28d1685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:34.470907 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0abce-0287-4ab4-bb48-7149f28d1685 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:34.471190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0abce-0287-4ab4-bb48-7149f28d1685 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:34.471467 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0abce-0287-4ab4-bb48-7149f28d1685 None admin] PATH_INFO: `/v3/groups/fc06ca99addd44f3a366211f96f1014f` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:34.489912 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0abce-0287-4ab4-bb48-7149f28d1685 None admin] RBAC: Authorizing `identity:get_group(group_id=fc06ca99addd44f3a366211f96f1014f)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:34.491390 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0abce-0287-4ab4-bb48-7149f28d1685 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:34.493260 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 189/383] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jul 5 12:41:34 2022] GET /identity/v3/groups/fc06ca99addd44f3a366211f96f1014f => generated 229 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:34.501519 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0abce-0287-4ab4-bb48-7149f28d1685 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:34.569278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:34.584834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893509e-0e8b-4c4a-b25f-9427861ea21d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:34.620965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66663a2e-980c-481d-9ca2-685a9b833fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:34.621975 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66663a2e-980c-481d-9ca2-685a9b833fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:34.622326 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66663a2e-980c-481d-9ca2-685a9b833fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:34.622669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66663a2e-980c-481d-9ca2-685a9b833fe6 None admin] PATH_INFO: `/v3/groups/80d3225599fd4914837c49dc6f92d39e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:34.623936 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66663a2e-980c-481d-9ca2-685a9b833fe6 None admin] RBAC: Authorizing `identity:get_group(group_id=80d3225599fd4914837c49dc6f92d39e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:34.625509 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66663a2e-980c-481d-9ca2-685a9b833fe6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:34.627580 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 195/384] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jul 5 12:41:34 2022] GET /identity/v3/groups/80d3225599fd4914837c49dc6f92d39e => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:34.628886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4716d5-3fda-45a2-a681-e1f65bfbfb96 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:34.629239 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4716d5-3fda-45a2-a681-e1f65bfbfb96 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:34.629526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4716d5-3fda-45a2-a681-e1f65bfbfb96 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:34.631563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 196/385] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:34.636060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4716d5-3fda-45a2-a681-e1f65bfbfb96 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:34.657266 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0abce-0287-4ab4-bb48-7149f28d1685 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:34.674861 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:34.703637 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af244162-885d-4e61-941a-3660537fea95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:34.704556 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af244162-885d-4e61-941a-3660537fea95 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:34.704958 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af244162-885d-4e61-941a-3660537fea95 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:34.705330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af244162-885d-4e61-941a-3660537fea95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:34.706324 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af244162-885d-4e61-941a-3660537fea95 None admin] RBAC: Adding query filter params (group.id=fc06ca99addd44f3a366211f96f1014f, role.id=868c7a356c674ded875dd079f5a9f5e0, scope.project.id=b34caad9134a4665ac2d8976c95be2ac) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:34.706733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af244162-885d-4e61-941a-3660537fea95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:34.708330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af244162-885d-4e61-941a-3660537fea95 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:34.716240 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 190/386] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jul 5 12:41:34 2022] GET /identity/v3/role_assignments?group.id=fc06ca99addd44f3a366211f96f1014f&scope.project.id=b34caad9134a4665ac2d8976c95be2ac&role.id=868c7a356c674ded875dd079f5a9f5e0 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:34.717746 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11c9e5-a22f-4345-8f33-f6c476f50774 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:34.718140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11c9e5-a22f-4345-8f33-f6c476f50774 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:34.718525 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11c9e5-a22f-4345-8f33-f6c476f50774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:34.738538 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-bb11c9e5-a22f-4345-8f33-f6c476f50774 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:34.741157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-bb11c9e5-a22f-4345-8f33-f6c476f50774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:34.770143 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4716d5-3fda-45a2-a681-e1f65bfbfb96 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:34.828332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beebcff-aac8-458e-bc49-6aba35b75069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:34.829162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beebcff-aac8-458e-bc49-6aba35b75069 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:34.829445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beebcff-aac8-458e-bc49-6aba35b75069 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:34.829723 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beebcff-aac8-458e-bc49-6aba35b75069 None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:34.831173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beebcff-aac8-458e-bc49-6aba35b75069 None admin] RBAC: Authorizing `identity:get_project(project_id=3643e64d3f194dc5bef838b26b6bb808)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:34.832668 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beebcff-aac8-458e-bc49-6aba35b75069 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:34.835580 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 197/387] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:34 2022] GET /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:34.841171 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beebcff-aac8-458e-bc49-6aba35b75069 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:34.844697 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 191/388] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:34.870637 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:34.879943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11c9e5-a22f-4345-8f33-f6c476f50774 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:35.006034 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beebcff-aac8-458e-bc49-6aba35b75069 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:35.046770 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11c9e5-a22f-4345-8f33-f6c476f50774 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:35.047504 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefb639-c4b6-49e7-ad8a-f21628ec3689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:35.048818 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefb639-c4b6-49e7-ad8a-f21628ec3689 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:35.049394 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefb639-c4b6-49e7-ad8a-f21628ec3689 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:35.049866 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefb639-c4b6-49e7-ad8a-f21628ec3689 None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808/groups/80d3225599fd4914837c49dc6f92d39e/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:35.052079 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefb639-c4b6-49e7-ad8a-f21628ec3689 None admin] RBAC: Authorizing `identity:create_grant(project_id=3643e64d3f194dc5bef838b26b6bb808, group_id=80d3225599fd4914837c49dc6f92d39e, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:35.058255 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefb639-c4b6-49e7-ad8a-f21628ec3689 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:35.061961 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:35.094730 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd150e-7eeb-445a-9871-072c5f766550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:35.095893 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd150e-7eeb-445a-9871-072c5f766550 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:35.096401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd150e-7eeb-445a-9871-072c5f766550 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:35.096891 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd150e-7eeb-445a-9871-072c5f766550 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:35.109305 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd150e-7eeb-445a-9871-072c5f766550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:35.119042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-cfcd150e-7eeb-445a-9871-072c5f766550 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:35.119042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:35.119042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:35.119042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:35.119042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:35.119042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:35.119042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:35.119042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:35.119042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:35.119042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:35.119042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:35.119042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:35.119042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:35.119042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:35.119042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:35.119042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:35.119943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:35.119943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:35.119943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:35.119943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:35.119943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:35.119943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:35.119943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:35.119943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:35.119943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:35.119943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:35.119943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:35.119943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:35.119943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:35.119943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:35.119943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:35.119943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:35.120798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:35.120798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:35.120798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:35.120798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:35.120798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:35.120798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:35.120798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:35.120798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:35.120798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:35.120798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:35.120798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:35.120798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:35.129569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 198/389] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Jul 5 12:41:34 2022] PUT /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808/groups/80d3225599fd4914837c49dc6f92d39e/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:41:35.132637 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 192/390] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jul 5 12:41:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:41:35.137777 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefb639-c4b6-49e7-ad8a-f21628ec3689 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:35.243543 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:35.267919 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefb639-c4b6-49e7-ad8a-f21628ec3689 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:35.307752 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0012ad5-2da7-4500-a553-eb7848b29901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:35.308437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0012ad5-2da7-4500-a553-eb7848b29901 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:35.308746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0012ad5-2da7-4500-a553-eb7848b29901 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:35.309021 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0012ad5-2da7-4500-a553-eb7848b29901 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:35.309819 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0012ad5-2da7-4500-a553-eb7848b29901 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:35.310125 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0012ad5-2da7-4500-a553-eb7848b29901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:35.311494 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0012ad5-2da7-4500-a553-eb7848b29901 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:35.324684 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 199/391] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:41:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:35.330434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd150e-7eeb-445a-9871-072c5f766550 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:35.445924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd150e-7eeb-445a-9871-072c5f766550 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:35.487483 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a891b4-53a2-4e2b-a212-ee7628f667a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:35.488354 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a891b4-53a2-4e2b-a212-ee7628f667a1 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:35.488687 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a891b4-53a2-4e2b-a212-ee7628f667a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:35.488968 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a891b4-53a2-4e2b-a212-ee7628f667a1 None admin] PATH_INFO: `/v3/groups/80d3225599fd4914837c49dc6f92d39e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:35.490196 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a891b4-53a2-4e2b-a212-ee7628f667a1 None admin] RBAC: Authorizing `identity:get_group(group_id=80d3225599fd4914837c49dc6f92d39e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:35.491658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a891b4-53a2-4e2b-a212-ee7628f667a1 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:35.493318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 193/392] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jul 5 12:41:35 2022] GET /identity/v3/groups/80d3225599fd4914837c49dc6f92d39e => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:35.499084 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0012ad5-2da7-4500-a553-eb7848b29901 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:35.640867 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0012ad5-2da7-4500-a553-eb7848b29901 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:35.682567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce76483-9f18-4f06-a52c-9d96e760d326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:35.683863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce76483-9f18-4f06-a52c-9d96e760d326 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:35.684353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce76483-9f18-4f06-a52c-9d96e760d326 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:35.684889 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce76483-9f18-4f06-a52c-9d96e760d326 None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:35.686479 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce76483-9f18-4f06-a52c-9d96e760d326 None admin] RBAC: Authorizing `identity:get_project(project_id=3643e64d3f194dc5bef838b26b6bb808)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:35.688330 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce76483-9f18-4f06-a52c-9d96e760d326 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:35.690461 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 200/393] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:35 2022] GET /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:35.707954 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a891b4-53a2-4e2b-a212-ee7628f667a1 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:35.744043 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:35.829484 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a891b4-53a2-4e2b-a212-ee7628f667a1 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:35.867447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76507229-d66c-4ff7-858f-3b8fb5626afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:35.868334 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76507229-d66c-4ff7-858f-3b8fb5626afe None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:35.868634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76507229-d66c-4ff7-858f-3b8fb5626afe None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:35.868912 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76507229-d66c-4ff7-858f-3b8fb5626afe None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808/groups/80d3225599fd4914837c49dc6f92d39e/roles/5ea7d4a868fb49b8992c3adb30476789` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:35.874385 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76507229-d66c-4ff7-858f-3b8fb5626afe None admin] RBAC: Authorizing `identity:create_grant(project_id=3643e64d3f194dc5bef838b26b6bb808, group_id=80d3225599fd4914837c49dc6f92d39e, role_id=5ea7d4a868fb49b8992c3adb30476789)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:35.875859 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76507229-d66c-4ff7-858f-3b8fb5626afe None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:35.890231 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aad560-5350-4b15-a915-49a465de6d85 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:35.890858 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aad560-5350-4b15-a915-49a465de6d85 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:35.891353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aad560-5350-4b15-a915-49a465de6d85 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:35.892967 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 201/394] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:35.898826 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51da6a-d925-4cd8-88ce-4782c22a6b47 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:35.899345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51da6a-d925-4cd8-88ce-4782c22a6b47 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:35.899836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51da6a-d925-4cd8-88ce-4782c22a6b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:35.924524 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-ae51da6a-d925-4cd8-88ce-4782c22a6b47 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:35.926055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ae51da6a-d925-4cd8-88ce-4782c22a6b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:35.936541 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:35.943234 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 194/395] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Jul 5 12:41:35 2022] PUT /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808/groups/80d3225599fd4914837c49dc6f92d39e/roles/5ea7d4a868fb49b8992c3adb30476789 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:41:36.016411 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 202/396] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:36.058002 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76507229-d66c-4ff7-858f-3b8fb5626afe None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:36.183594 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:36.190712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76507229-d66c-4ff7-858f-3b8fb5626afe None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:36.228712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fb013-7c16-4b12-bec3-50259a0d234c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:36.229530 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fb013-7c16-4b12-bec3-50259a0d234c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:36.229822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fb013-7c16-4b12-bec3-50259a0d234c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:36.230095 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fb013-7c16-4b12-bec3-50259a0d234c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:36.243641 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fb013-7c16-4b12-bec3-50259a0d234c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:36.257677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-244fb013-7c16-4b12-bec3-50259a0d234c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:36.257677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:36.257677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:36.257677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:36.257677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:36.257677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:36.257677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:36.257677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:36.257677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:36.257677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:36.257677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:36.257677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:36.257677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:36.257677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:36.257677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:36.257677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:36.258625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:36.258625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:36.258625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:36.258625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:36.258625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:36.258625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:36.258625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:36.258625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:36.258625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:36.258625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:36.258625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:36.258625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:36.258625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:36.258625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:36.258625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:36.258625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:36.259513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:36.259513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:36.259513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:36.259513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:36.259513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:36.259513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:36.259513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:36.259513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:36.259513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:36.259513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:36.259513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:36.259513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:36.259513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 195/397] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:36.267198 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51da6a-d925-4cd8-88ce-4782c22a6b47 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:36.417463 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51da6a-d925-4cd8-88ce-4782c22a6b47 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:36.470179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd60c0c-00d1-419f-9126-47be7d05f152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:36.471248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd60c0c-00d1-419f-9126-47be7d05f152 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:36.471752 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd60c0c-00d1-419f-9126-47be7d05f152 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:36.472226 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd60c0c-00d1-419f-9126-47be7d05f152 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:36.473216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd60c0c-00d1-419f-9126-47be7d05f152 None admin] RBAC: Adding query filter params (name=member) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:36.473728 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd60c0c-00d1-419f-9126-47be7d05f152 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:36.476090 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd60c0c-00d1-419f-9126-47be7d05f152 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:36.485150 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 203/398] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:36.490978 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fb013-7c16-4b12-bec3-50259a0d234c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:36.609702 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fb013-7c16-4b12-bec3-50259a0d234c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:36.651788 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70dd76-6d35-477e-be12-5025afebabd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:36.653150 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70dd76-6d35-477e-be12-5025afebabd6 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:36.653652 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70dd76-6d35-477e-be12-5025afebabd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:36.654125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70dd76-6d35-477e-be12-5025afebabd6 None admin] PATH_INFO: `/v3/groups/80d3225599fd4914837c49dc6f92d39e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:36.655562 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70dd76-6d35-477e-be12-5025afebabd6 None admin] RBAC: Authorizing `identity:get_group(group_id=80d3225599fd4914837c49dc6f92d39e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:36.657382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70dd76-6d35-477e-be12-5025afebabd6 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:36.659284 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 196/399] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jul 5 12:41:36 2022] GET /identity/v3/groups/80d3225599fd4914837c49dc6f92d39e => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:36.665059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd60c0c-00d1-419f-9126-47be7d05f152 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:36.669249 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:36.706746 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6537ec-d21a-444c-ba9c-62201aadb5ff None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:36.707084 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6537ec-d21a-444c-ba9c-62201aadb5ff None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:36.707338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6537ec-d21a-444c-ba9c-62201aadb5ff None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:36.709442 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 197/400] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:41:36.722772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44637c-27af-46d5-8dd9-26d250ac5906 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:36.723059 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44637c-27af-46d5-8dd9-26d250ac5906 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:36.723335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44637c-27af-46d5-8dd9-26d250ac5906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:36.741359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-af44637c-27af-46d5-8dd9-26d250ac5906 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:36.742539 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-af44637c-27af-46d5-8dd9-26d250ac5906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:36.763696 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:36.850236 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 198/401] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:36.857645 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd60c0c-00d1-419f-9126-47be7d05f152 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:36.889373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44637c-27af-46d5-8dd9-26d250ac5906 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:36.907196 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9db6b-ef2b-4a34-9cd8-0e502df5b897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:36.908073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9db6b-ef2b-4a34-9cd8-0e502df5b897 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:36.908352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9db6b-ef2b-4a34-9cd8-0e502df5b897 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:36.908653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9db6b-ef2b-4a34-9cd8-0e502df5b897 None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:36.913326 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9db6b-ef2b-4a34-9cd8-0e502df5b897 None admin] RBAC: Authorizing `identity:get_project(project_id=769c25d7cd5442f3a9359fa294a9befe)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:36.914792 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9db6b-ef2b-4a34-9cd8-0e502df5b897 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:36.916875 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 204/402] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:36 2022] GET /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:36.934247 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9db6b-ef2b-4a34-9cd8-0e502df5b897 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:37.005903 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44637c-27af-46d5-8dd9-26d250ac5906 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:37.046125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fee46d-71f0-406a-8d87-9dabd57a0af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:37.047407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fee46d-71f0-406a-8d87-9dabd57a0af3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:37.047714 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fee46d-71f0-406a-8d87-9dabd57a0af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:37.050883 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fee46d-71f0-406a-8d87-9dabd57a0af3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:37.061565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fee46d-71f0-406a-8d87-9dabd57a0af3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:37.075618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-c5fee46d-71f0-406a-8d87-9dabd57a0af3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:37.075618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:37.075618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:37.075618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:37.075618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:37.075618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:37.075618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:37.075618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:37.075618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:37.075618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:37.075618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:37.075618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:37.075618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:37.075618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:37.075618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:37.075618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:37.076692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:37.076692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:37.076692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:37.076692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:37.076692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:37.076692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:37.076692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:37.076692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:37.076692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:37.076692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:37.076692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:37.076692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:37.076692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:37.076692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:37.076692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:37.076692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:37.077487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:37.077487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:37.077487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:37.077487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:37.077487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:37.077487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:37.077487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:37.077487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:37.077487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:37.077487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:37.077487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:37.077487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:37.082683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 199/403] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jul 5 12:41:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:41:37.089128 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fee46d-71f0-406a-8d87-9dabd57a0af3 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:37.106613 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:37.170579 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:37.207634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fee46d-71f0-406a-8d87-9dabd57a0af3 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:37.247248 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043f626-c690-48a5-bb24-5122a1e7f70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:37.247921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043f626-c690-48a5-bb24-5122a1e7f70f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:37.248204 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043f626-c690-48a5-bb24-5122a1e7f70f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:37.248476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043f626-c690-48a5-bb24-5122a1e7f70f None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:37.249397 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043f626-c690-48a5-bb24-5122a1e7f70f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:37.249700 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043f626-c690-48a5-bb24-5122a1e7f70f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:37.250735 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9db6b-ef2b-4a34-9cd8-0e502df5b897 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:37.251073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043f626-c690-48a5-bb24-5122a1e7f70f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:37.261050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 200/404] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:41:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:37.266996 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043f626-c690-48a5-bb24-5122a1e7f70f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:37.352220 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:37.353152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc331fc-8408-4925-825c-1f3790530450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:37.354157 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc331fc-8408-4925-825c-1f3790530450 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:37.354561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc331fc-8408-4925-825c-1f3790530450 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:37.354852 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc331fc-8408-4925-825c-1f3790530450 None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe/groups/80d3225599fd4914837c49dc6f92d39e/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:37.362162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc331fc-8408-4925-825c-1f3790530450 None admin] RBAC: Authorizing `identity:create_grant(project_id=769c25d7cd5442f3a9359fa294a9befe, group_id=80d3225599fd4914837c49dc6f92d39e, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:37.363572 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc331fc-8408-4925-825c-1f3790530450 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:37.381907 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043f626-c690-48a5-bb24-5122a1e7f70f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:37.420761 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5ec9e-fc55-4cff-8af2-2cd0a875b959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:37.422073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5ec9e-fc55-4cff-8af2-2cd0a875b959 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:37.422569 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5ec9e-fc55-4cff-8af2-2cd0a875b959 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:37.423141 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5ec9e-fc55-4cff-8af2-2cd0a875b959 None admin] PATH_INFO: `/v3/groups/80d3225599fd4914837c49dc6f92d39e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:37.424663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5ec9e-fc55-4cff-8af2-2cd0a875b959 None admin] RBAC: Authorizing `identity:get_group(group_id=80d3225599fd4914837c49dc6f92d39e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:37.426331 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5ec9e-fc55-4cff-8af2-2cd0a875b959 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:37.432713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 201/405] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jul 5 12:41:37 2022] GET /identity/v3/groups/80d3225599fd4914837c49dc6f92d39e => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:37.434323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5ec9e-fc55-4cff-8af2-2cd0a875b959 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:37.470502 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 205/406] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Jul 5 12:41:36 2022] PUT /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe/groups/80d3225599fd4914837c49dc6f92d39e/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:41:37.554400 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5ec9e-fc55-4cff-8af2-2cd0a875b959 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:37.562160 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38b826-8739-480d-861a-57ca487dad05 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:37.562483 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38b826-8739-480d-861a-57ca487dad05 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:37.562731 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38b826-8739-480d-861a-57ca487dad05 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:37.564375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 206/407] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:41:37.569635 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb4892-dcc9-4243-975b-667e12408745 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:37.569930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb4892-dcc9-4243-975b-667e12408745 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:37.570218 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb4892-dcc9-4243-975b-667e12408745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:37.588394 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-85fb4892-dcc9-4243-975b-667e12408745 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:37.589742 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-85fb4892-dcc9-4243-975b-667e12408745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:37.598279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db78dcf-b736-4cf4-91ff-5a2368e43268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:37.600352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db78dcf-b736-4cf4-91ff-5a2368e43268 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:37.600876 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db78dcf-b736-4cf4-91ff-5a2368e43268 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:37.601356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db78dcf-b736-4cf4-91ff-5a2368e43268 None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:37.603747 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db78dcf-b736-4cf4-91ff-5a2368e43268 None admin] RBAC: Authorizing `identity:get_project(project_id=769c25d7cd5442f3a9359fa294a9befe)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:37.605724 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db78dcf-b736-4cf4-91ff-5a2368e43268 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:37.608722 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 202/408] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:37 2022] GET /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:37.618742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db78dcf-b736-4cf4-91ff-5a2368e43268 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:37.652554 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:37.750398 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 207/409] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:41:37.750700 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db78dcf-b736-4cf4-91ff-5a2368e43268 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:37.751826 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ddc34-9f2d-4e52-bc9d-f8afa389ba92 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:37.752295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ddc34-9f2d-4e52-bc9d-f8afa389ba92 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:37.752616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ddc34-9f2d-4e52-bc9d-f8afa389ba92 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:37.755697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 208/410] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:37.761240 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15c60f-2963-4732-8def-819da3ea95c9 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:37.761537 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15c60f-2963-4732-8def-819da3ea95c9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:37.761838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15c60f-2963-4732-8def-819da3ea95c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:37.783926 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-ba15c60f-2963-4732-8def-819da3ea95c9 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:37.785673 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ba15c60f-2963-4732-8def-819da3ea95c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:37.793227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9c1a7-ab59-45a0-94fc-60e182343924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:37.794079 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9c1a7-ab59-45a0-94fc-60e182343924 None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:37.794369 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9c1a7-ab59-45a0-94fc-60e182343924 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:37.794642 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9c1a7-ab59-45a0-94fc-60e182343924 None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe/groups/80d3225599fd4914837c49dc6f92d39e/roles/5ea7d4a868fb49b8992c3adb30476789` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:37.798623 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9c1a7-ab59-45a0-94fc-60e182343924 None admin] RBAC: Authorizing `identity:create_grant(project_id=769c25d7cd5442f3a9359fa294a9befe, group_id=80d3225599fd4914837c49dc6f92d39e, role_id=5ea7d4a868fb49b8992c3adb30476789)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:37.800137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9c1a7-ab59-45a0-94fc-60e182343924 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:37.849019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:37.864669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 209/411] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:41:37.864669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15c60f-2963-4732-8def-819da3ea95c9 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:37.877500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 203/412] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Jul 5 12:41:37 2022] PUT /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe/groups/80d3225599fd4914837c49dc6f92d39e/roles/5ea7d4a868fb49b8992c3adb30476789 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:41:37.904054 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9c1a7-ab59-45a0-94fc-60e182343924 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:38.021246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:38.033961 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9c1a7-ab59-45a0-94fc-60e182343924 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:38.057922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15c60f-2963-4732-8def-819da3ea95c9 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:38.085138 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a15b1-8b20-42f1-bda6-e3219eed2e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:38.085962 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a15b1-8b20-42f1-bda6-e3219eed2e8e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:38.086731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a15b1-8b20-42f1-bda6-e3219eed2e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:38.087035 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a15b1-8b20-42f1-bda6-e3219eed2e8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:38.101525 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a15b1-8b20-42f1-bda6-e3219eed2e8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:38.110455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-443a15b1-8b20-42f1-bda6-e3219eed2e8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:38.110455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:38.110455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:38.110455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:38.110455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:38.110455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:38.110455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:38.110455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:38.110455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:38.110455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:38.110455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:38.110455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:38.110455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:38.110455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:38.110455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:38.110455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:38.115681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:38.115681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:38.115681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:38.115681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:38.115681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:38.115681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:38.115681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:38.115681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:38.115681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:38.115681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:38.115681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:38.115681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:38.115681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:38.115681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:38.115681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:38.115681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:38.116503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:38.116503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:38.116503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:38.116503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:38.116503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:38.116503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:38.116503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:38.116503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:38.116503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:38.116503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:38.116503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:38.116503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:38.116503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 204/413] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:41:38.120259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a15b1-8b20-42f1-bda6-e3219eed2e8e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:38.149191 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987401f0-299f-40fc-9763-c3eb332ecf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:38.150036 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987401f0-299f-40fc-9763-c3eb332ecf8c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:38.150324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987401f0-299f-40fc-9763-c3eb332ecf8c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:38.150867 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987401f0-299f-40fc-9763-c3eb332ecf8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:38.164714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987401f0-299f-40fc-9763-c3eb332ecf8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:38.174595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-987401f0-299f-40fc-9763-c3eb332ecf8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:41:38.174595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:38.174595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:38.174595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:38.174595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:38.174595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:38.174595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:38.174595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:38.174595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:38.174595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:38.174595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:38.174595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:38.174595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:38.174595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:38.174595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:38.174595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:38.175609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:38.175609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:38.175609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:38.175609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:38.175609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:38.175609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:38.175609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:38.175609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:38.175609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:38.175609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:38.175609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:38.175609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:38.175609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:38.175609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:38.175609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:38.175609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:38.176386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:38.176386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:38.176386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:38.176386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:38.176386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:38.176386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:38.176386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:38.176386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:38.176386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:38.176386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:38.176386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:41:38.176386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:38.176386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 210/414] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:41:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:38.189611 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987401f0-299f-40fc-9763-c3eb332ecf8c None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:38.240501 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a15b1-8b20-42f1-bda6-e3219eed2e8e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:38.252939 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:38.296098 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:38.305420 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f433f-d97c-44f3-a258-b12693d0d0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:38.305617 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987401f0-299f-40fc-9763-c3eb332ecf8c None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:38.306109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f433f-d97c-44f3-a258-b12693d0d0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:38.306396 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f433f-d97c-44f3-a258-b12693d0d0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:38.306678 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f433f-d97c-44f3-a258-b12693d0d0a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:38.307442 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f433f-d97c-44f3-a258-b12693d0d0a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:38.312706 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f433f-d97c-44f3-a258-b12693d0d0a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:38.314408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f433f-d97c-44f3-a258-b12693d0d0a9 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:38.330998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 205/415] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:38.336096 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f433f-d97c-44f3-a258-b12693d0d0a9 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:38.343101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05b79b-7362-411f-9b4f-92cf44a4e7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:38.343869 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05b79b-7362-411f-9b4f-92cf44a4e7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:38.344249 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05b79b-7362-411f-9b4f-92cf44a4e7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:38.345525 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05b79b-7362-411f-9b4f-92cf44a4e7a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:38.346378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05b79b-7362-411f-9b4f-92cf44a4e7a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:38.346765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05b79b-7362-411f-9b4f-92cf44a4e7a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:38.348254 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05b79b-7362-411f-9b4f-92cf44a4e7a1 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:38.359443 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 211/416] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:38.367403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05b79b-7362-411f-9b4f-92cf44a4e7a1 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:38.466589 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f433f-d97c-44f3-a258-b12693d0d0a9 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:38.540717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93a46a-62d0-4ef8-a410-242a49430150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:38.541755 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93a46a-62d0-4ef8-a410-242a49430150 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:38.542231 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93a46a-62d0-4ef8-a410-242a49430150 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:38.542685 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93a46a-62d0-4ef8-a410-242a49430150 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:38.562630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05b79b-7362-411f-9b4f-92cf44a4e7a1 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:38.592977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:38.609192 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949b0d0-38bf-4887-aff7-39e395dbf88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:38.615976 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949b0d0-38bf-4887-aff7-39e395dbf88d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:38.615976 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949b0d0-38bf-4887-aff7-39e395dbf88d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:38.615976 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949b0d0-38bf-4887-aff7-39e395dbf88d None admin] PATH_INFO: `/v3/groups/fc06ca99addd44f3a366211f96f1014f` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:38.615976 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949b0d0-38bf-4887-aff7-39e395dbf88d None admin] RBAC: Authorizing `identity:get_group(group_id=fc06ca99addd44f3a366211f96f1014f)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:38.615976 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949b0d0-38bf-4887-aff7-39e395dbf88d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:38.617111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 212/417] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jul 5 12:41:38 2022] GET /identity/v3/groups/fc06ca99addd44f3a366211f96f1014f => generated 229 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:38.623799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949b0d0-38bf-4887-aff7-39e395dbf88d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:38.671317 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:38.680713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93a46a-62d0-4ef8-a410-242a49430150 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:38.685219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93a46a-62d0-4ef8-a410-242a49430150 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:38.770928 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949b0d0-38bf-4887-aff7-39e395dbf88d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:38.799299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 206/418] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 12:41:38.801119 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a116a-5be4-4a37-b69c-26972d9f0ddc None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:38.801750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a116a-5be4-4a37-b69c-26972d9f0ddc None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:38.802830 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a116a-5be4-4a37-b69c-26972d9f0ddc None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:38.804411 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 207/419] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:38.809407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a116a-5be4-4a37-b69c-26972d9f0ddc None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:38.815447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138d070-cfd2-4f6d-88ff-37a2b1ea241f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:38.816381 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138d070-cfd2-4f6d-88ff-37a2b1ea241f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:38.816804 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138d070-cfd2-4f6d-88ff-37a2b1ea241f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:38.817177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138d070-cfd2-4f6d-88ff-37a2b1ea241f None admin] PATH_INFO: `/v3/projects/b34caad9134a4665ac2d8976c95be2ac` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:38.818541 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138d070-cfd2-4f6d-88ff-37a2b1ea241f None admin] RBAC: Authorizing `identity:get_project(project_id=b34caad9134a4665ac2d8976c95be2ac)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:38.820104 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138d070-cfd2-4f6d-88ff-37a2b1ea241f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:38.827898 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 213/420] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:38 2022] GET /identity/v3/projects/b34caad9134a4665ac2d8976c95be2ac => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:38.829721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc64ed5-f842-44c4-8232-6d67fe3e0f0a None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:38.830113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc64ed5-f842-44c4-8232-6d67fe3e0f0a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:38.830491 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc64ed5-f842-44c4-8232-6d67fe3e0f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:38.857668 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-9dc64ed5-f842-44c4-8232-6d67fe3e0f0a None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:38.857668 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9dc64ed5-f842-44c4-8232-6d67fe3e0f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:38.917195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:38.924332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:38.926920 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a116a-5be4-4a37-b69c-26972d9f0ddc None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:38.946387 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 214/421] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:38.947618 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc64ed5-f842-44c4-8232-6d67fe3e0f0a None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:38.963160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb983eae-0911-438d-9ad4-08332ac081af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:38.964073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb983eae-0911-438d-9ad4-08332ac081af None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:38.964358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb983eae-0911-438d-9ad4-08332ac081af None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:38.964653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb983eae-0911-438d-9ad4-08332ac081af None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:38.965888 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb983eae-0911-438d-9ad4-08332ac081af None admin] RBAC: Authorizing `identity:get_project(project_id=3643e64d3f194dc5bef838b26b6bb808)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:38.967335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb983eae-0911-438d-9ad4-08332ac081af None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:38.969285 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 208/422] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:38 2022] GET /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:38.974436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb983eae-0911-438d-9ad4-08332ac081af None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:39.092445 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb983eae-0911-438d-9ad4-08332ac081af None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:39.097854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc64ed5-f842-44c4-8232-6d67fe3e0f0a None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:39.136138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a2672-7208-43c6-93c3-a72b916eaca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:39.137051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a2672-7208-43c6-93c3-a72b916eaca9 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:39.137321 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a2672-7208-43c6-93c3-a72b916eaca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:39.137602 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a2672-7208-43c6-93c3-a72b916eaca9 None admin] PATH_INFO: `/v3/projects/b34caad9134a4665ac2d8976c95be2ac/groups/fc06ca99addd44f3a366211f96f1014f/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:39.139569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a2672-7208-43c6-93c3-a72b916eaca9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b34caad9134a4665ac2d8976c95be2ac, group_id=fc06ca99addd44f3a366211f96f1014f, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:39.141062 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a2672-7208-43c6-93c3-a72b916eaca9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:39.142056 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a575a2-213f-4b7a-8eea-45fe79974660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:39.143389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a575a2-213f-4b7a-8eea-45fe79974660 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:39.143868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a575a2-213f-4b7a-8eea-45fe79974660 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:39.144724 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a575a2-213f-4b7a-8eea-45fe79974660 None admin] PATH_INFO: `/v3/groups/80d3225599fd4914837c49dc6f92d39e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:39.147562 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a575a2-213f-4b7a-8eea-45fe79974660 None admin] RBAC: Authorizing `identity:get_group(group_id=80d3225599fd4914837c49dc6f92d39e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:39.149196 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a575a2-213f-4b7a-8eea-45fe79974660 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:39.155860 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 209/423] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jul 5 12:41:38 2022] GET /identity/v3/groups/80d3225599fd4914837c49dc6f92d39e => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:39.155860 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a575a2-213f-4b7a-8eea-45fe79974660 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:39.180896 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:39.244974 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 215/424] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Jul 5 12:41:38 2022] PUT /identity/v3/projects/b34caad9134a4665ac2d8976c95be2ac/groups/fc06ca99addd44f3a366211f96f1014f/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:41:39.246294 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a2672-7208-43c6-93c3-a72b916eaca9 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:39.278982 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a575a2-213f-4b7a-8eea-45fe79974660 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:39.337102 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:39.362953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c88dec-15f7-4a7c-86c1-8dbb21d984ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:39.363793 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c88dec-15f7-4a7c-86c1-8dbb21d984ef None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:39.364080 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c88dec-15f7-4a7c-86c1-8dbb21d984ef None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:39.364357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c88dec-15f7-4a7c-86c1-8dbb21d984ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:39.383779 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c88dec-15f7-4a7c-86c1-8dbb21d984ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:39.392122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-d2c88dec-15f7-4a7c-86c1-8dbb21d984ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:39.392122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:39.392122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:39.392122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:39.392122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:39.392122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:39.392122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:39.392122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:39.392122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:39.392122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:39.392122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:39.392122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:39.392122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:39.392122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:39.392122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:39.392122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:39.396512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:39.396512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:39.396512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:39.396512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:39.396512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:39.396512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:39.396512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:39.396512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:39.396512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:39.396512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:39.396512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:39.396512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:39.396512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:39.396512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:39.396512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:39.396512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:39.397548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:39.397548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:39.397548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:39.397548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:39.397548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:39.397548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:39.397548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:39.397548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:39.397548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:39.397548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:39.397548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:39.397548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:39.401060 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 210/425] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jul 5 12:41:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:39.409169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c88dec-15f7-4a7c-86c1-8dbb21d984ef None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:39.448434 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a2672-7208-43c6-93c3-a72b916eaca9 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:39.511592 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511b10c-3e4c-4f48-b71a-8e5096dfbf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:39.513813 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511b10c-3e4c-4f48-b71a-8e5096dfbf9d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:39.514478 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511b10c-3e4c-4f48-b71a-8e5096dfbf9d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:39.516205 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511b10c-3e4c-4f48-b71a-8e5096dfbf9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:39.518018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511b10c-3e4c-4f48-b71a-8e5096dfbf9d None admin] RBAC: Adding query filter params (group.id=80d3225599fd4914837c49dc6f92d39e, role.id=66d9c5a190d544b3b3588bbdadf2cf39, scope.project.id=3643e64d3f194dc5bef838b26b6bb808) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:39.521569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511b10c-3e4c-4f48-b71a-8e5096dfbf9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:39.523252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511b10c-3e4c-4f48-b71a-8e5096dfbf9d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:39.535361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 216/426] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jul 5 12:41:39 2022] GET /identity/v3/role_assignments?group.id=80d3225599fd4914837c49dc6f92d39e&scope.project.id=3643e64d3f194dc5bef838b26b6bb808&role.id=66d9c5a190d544b3b3588bbdadf2cf39 => generated 611 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:39.552337 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:39.564258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c88dec-15f7-4a7c-86c1-8dbb21d984ef None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:39.617999 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09247608-1620-4a52-8ae6-d2e965909a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:39.619039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09247608-1620-4a52-8ae6-d2e965909a63 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:39.619545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09247608-1620-4a52-8ae6-d2e965909a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:39.620038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09247608-1620-4a52-8ae6-d2e965909a63 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:39.621100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09247608-1620-4a52-8ae6-d2e965909a63 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:39.621617 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09247608-1620-4a52-8ae6-d2e965909a63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:39.623231 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09247608-1620-4a52-8ae6-d2e965909a63 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:39.638842 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 211/427] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:41:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:39.645041 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511b10c-3e4c-4f48-b71a-8e5096dfbf9d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:39.765394 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511b10c-3e4c-4f48-b71a-8e5096dfbf9d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:39.768386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:39.801809 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b9320-6e3f-41b6-9345-246e23457c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:39.803037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b9320-6e3f-41b6-9345-246e23457c5b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:39.803320 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b9320-6e3f-41b6-9345-246e23457c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:39.803601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b9320-6e3f-41b6-9345-246e23457c5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:39.880617 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b9320-6e3f-41b6-9345-246e23457c5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:39.882142 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b9320-6e3f-41b6-9345-246e23457c5b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:39.968472 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbe3f0-05dd-48a8-8478-4e3c8322aa06 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:39.968472 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbe3f0-05dd-48a8-8478-4e3c8322aa06 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:39.968472 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbe3f0-05dd-48a8-8478-4e3c8322aa06 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:39.969184 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 212/428] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:39.974395 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bac84-094e-4eab-b7d8-24c7052b43bf None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:39.974947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bac84-094e-4eab-b7d8-24c7052b43bf None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:39.975230 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bac84-094e-4eab-b7d8-24c7052b43bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:39.993016 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c06bac84-094e-4eab-b7d8-24c7052b43bf None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:39.994537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c06bac84-094e-4eab-b7d8-24c7052b43bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:40.008230 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 217/429] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:40.014308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b9320-6e3f-41b6-9345-246e23457c5b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:40.018279 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:40.077252 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 213/430] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:41:40.101866 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bac84-094e-4eab-b7d8-24c7052b43bf None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:40.145220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b9320-6e3f-41b6-9345-246e23457c5b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:40.189826 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c870a71-b933-4cd1-8f6b-d8efd086bb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:40.191283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c870a71-b933-4cd1-8f6b-d8efd086bb7f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:40.191578 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c870a71-b933-4cd1-8f6b-d8efd086bb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:40.191858 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c870a71-b933-4cd1-8f6b-d8efd086bb7f None admin] PATH_INFO: `/v3/projects/3643e64d3f194dc5bef838b26b6bb808` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:40.193678 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c870a71-b933-4cd1-8f6b-d8efd086bb7f None admin] RBAC: Authorizing `identity:get_project(project_id=3643e64d3f194dc5bef838b26b6bb808)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:40.196056 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c870a71-b933-4cd1-8f6b-d8efd086bb7f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:40.198405 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 218/431] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:40 2022] GET /identity/v3/projects/3643e64d3f194dc5bef838b26b6bb808 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:40.199072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:40.203646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c870a71-b933-4cd1-8f6b-d8efd086bb7f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:40.225375 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bac84-094e-4eab-b7d8-24c7052b43bf None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:40.273668 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20511cf-a69d-4bfa-85ff-eca62ba8da4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:40.275127 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20511cf-a69d-4bfa-85ff-eca62ba8da4f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:40.276283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20511cf-a69d-4bfa-85ff-eca62ba8da4f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:40.276801 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20511cf-a69d-4bfa-85ff-eca62ba8da4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:40.292157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20511cf-a69d-4bfa-85ff-eca62ba8da4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:40.301759 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:40.303890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-c20511cf-a69d-4bfa-85ff-eca62ba8da4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:40.303890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:40.303890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:40.303890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:40.303890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:40.303890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:40.303890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:40.303890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:40.303890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:40.303890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:40.303890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:40.303890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:40.303890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:40.303890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:40.303890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:40.303890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:40.304806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:40.304806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:40.304806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:40.304806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:40.304806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:40.304806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:40.304806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:40.304806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:40.304806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:40.304806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:40.304806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:40.304806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:40.304806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:40.304806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:40.304806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:40.304806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:40.305602 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:40.305602 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:40.305602 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:40.305602 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:40.305602 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:40.305602 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:40.305602 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:40.305602 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:40.305602 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:40.305602 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:40.305602 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 12:41:40.305602 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:40.308852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 214/432] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:41:40.314807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20511cf-a69d-4bfa-85ff-eca62ba8da4f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:40.347502 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c870a71-b933-4cd1-8f6b-d8efd086bb7f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:40.385565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79511c-2a7a-4b37-afcc-f66874cc6110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:40.386463 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79511c-2a7a-4b37-afcc-f66874cc6110 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:40.387081 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79511c-2a7a-4b37-afcc-f66874cc6110 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:40.387189 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79511c-2a7a-4b37-afcc-f66874cc6110 None admin] PATH_INFO: `/v3/groups/80d3225599fd4914837c49dc6f92d39e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:40.388288 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79511c-2a7a-4b37-afcc-f66874cc6110 None admin] RBAC: Authorizing `identity:get_group(group_id=80d3225599fd4914837c49dc6f92d39e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:40.389844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79511c-2a7a-4b37-afcc-f66874cc6110 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:40.391818 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 219/433] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jul 5 12:41:40 2022] GET /identity/v3/groups/80d3225599fd4914837c49dc6f92d39e => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:40.397623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79511c-2a7a-4b37-afcc-f66874cc6110 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:40.441670 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20511cf-a69d-4bfa-85ff-eca62ba8da4f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:40.483209 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cab32-90fd-4a99-9a93-96b5a6295215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:40.483936 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cab32-90fd-4a99-9a93-96b5a6295215 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:40.484198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cab32-90fd-4a99-9a93-96b5a6295215 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:40.484479 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cab32-90fd-4a99-9a93-96b5a6295215 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:40.485275 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651cab32-90fd-4a99-9a93-96b5a6295215 None admin] RBAC: Adding query filter params (name=member) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:40.485590 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651cab32-90fd-4a99-9a93-96b5a6295215 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:40.487031 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651cab32-90fd-4a99-9a93-96b5a6295215 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:40.499758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 215/434] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:41:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:40.499758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d8106-d277-46de-895f-fa92d7ae5706 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:40.499758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d8106-d277-46de-895f-fa92d7ae5706 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:40.499758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d8106-d277-46de-895f-fa92d7ae5706 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:40.499758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 216/435] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:40.501597 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d8106-d277-46de-895f-fa92d7ae5706 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:40.505011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:40.525584 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79511c-2a7a-4b37-afcc-f66874cc6110 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:40.564281 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c272b8-51ee-42e9-a1d9-c974c40d1776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:40.565836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c272b8-51ee-42e9-a1d9-c974c40d1776 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:40.566326 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c272b8-51ee-42e9-a1d9-c974c40d1776 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:40.566950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c272b8-51ee-42e9-a1d9-c974c40d1776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:40.568564 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c272b8-51ee-42e9-a1d9-c974c40d1776 None admin] RBAC: Adding query filter params (group.id=80d3225599fd4914837c49dc6f92d39e, role.id=5ea7d4a868fb49b8992c3adb30476789, scope.project.id=3643e64d3f194dc5bef838b26b6bb808) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:40.569088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c272b8-51ee-42e9-a1d9-c974c40d1776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:40.570704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c272b8-51ee-42e9-a1d9-c974c40d1776 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:40.578858 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 220/436] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jul 5 12:41:40 2022] GET /identity/v3/role_assignments?group.id=80d3225599fd4914837c49dc6f92d39e&scope.project.id=3643e64d3f194dc5bef838b26b6bb808&role.id=5ea7d4a868fb49b8992c3adb30476789 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:40.580351 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0b13-02bf-4030-bd83-bc0d1815297e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:40.581231 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0b13-02bf-4030-bd83-bc0d1815297e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:40.581703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0b13-02bf-4030-bd83-bc0d1815297e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:40.595051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:40.610214 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-2fac0b13-02bf-4030-bd83-bc0d1815297e None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:40.616194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d8106-d277-46de-895f-fa92d7ae5706 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:40.616350 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2fac0b13-02bf-4030-bd83-bc0d1815297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:40.655533 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669cb3f9-0ac2-4056-9e95-6ddcd882ec3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:40.656305 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cb3f9-0ac2-4056-9e95-6ddcd882ec3f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:40.656644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cb3f9-0ac2-4056-9e95-6ddcd882ec3f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:40.656934 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cb3f9-0ac2-4056-9e95-6ddcd882ec3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:40.712756 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 221/437] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:40.741654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac0b13-02bf-4030-bd83-bc0d1815297e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:40.752332 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669cb3f9-0ac2-4056-9e95-6ddcd882ec3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:40.755101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669cb3f9-0ac2-4056-9e95-6ddcd882ec3f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:40.757820 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:40.872555 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac0b13-02bf-4030-bd83-bc0d1815297e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:40.895259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 217/438] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:40.902430 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669cb3f9-0ac2-4056-9e95-6ddcd882ec3f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:40.932776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea4eaf-32d9-4f24-829d-e97068b2fd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:40.933951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea4eaf-32d9-4f24-829d-e97068b2fd76 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:40.934454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea4eaf-32d9-4f24-829d-e97068b2fd76 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:40.934781 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea4eaf-32d9-4f24-829d-e97068b2fd76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:40.936936 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:40.953598 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea4eaf-32d9-4f24-829d-e97068b2fd76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:40.962965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-c0ea4eaf-32d9-4f24-829d-e97068b2fd76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:40.962965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:40.962965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:40.962965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:40.962965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:40.962965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:40.962965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:40.962965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:40.962965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:40.962965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:40.962965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:40.962965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:40.962965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:40.962965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:40.962965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:40.962965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:40.963882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:40.963882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:40.963882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:40.963882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:40.963882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:40.963882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:40.963882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:40.963882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:40.963882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:40.963882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:40.963882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:40.963882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:40.963882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:40.963882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:40.963882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:40.963882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:40.964701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:40.964701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:40.964701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:40.964701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:40.964701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:40.964701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:40.964701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:40.964701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:40.964701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:40.964701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:40.964701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:40.964701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:40.964701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 222/439] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jul 5 12:41:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:40.975435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea4eaf-32d9-4f24-829d-e97068b2fd76 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:41.039087 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669cb3f9-0ac2-4056-9e95-6ddcd882ec3f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:41.041010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:41.087068 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f0824-d218-45a8-86be-b0caafc09ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:41.087963 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f0824-d218-45a8-86be-b0caafc09ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:41.088381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f0824-d218-45a8-86be-b0caafc09ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:41.088486 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f0824-d218-45a8-86be-b0caafc09ae9 None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:41.089778 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f0824-d218-45a8-86be-b0caafc09ae9 None admin] RBAC: Authorizing `identity:get_project(project_id=769c25d7cd5442f3a9359fa294a9befe)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:41.094194 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea4eaf-32d9-4f24-829d-e97068b2fd76 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:41.097162 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f0824-d218-45a8-86be-b0caafc09ae9 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:41.100978 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 218/440] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:40 2022] GET /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:41.105095 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f0824-d218-45a8-86be-b0caafc09ae9 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:41.130603 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb840ce-39d6-47b8-81ba-64d0074beeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:41.131265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb840ce-39d6-47b8-81ba-64d0074beeb2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:41.131544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb840ce-39d6-47b8-81ba-64d0074beeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:41.131973 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb840ce-39d6-47b8-81ba-64d0074beeb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:41.132622 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb840ce-39d6-47b8-81ba-64d0074beeb2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:41.132916 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb840ce-39d6-47b8-81ba-64d0074beeb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:41.134288 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb840ce-39d6-47b8-81ba-64d0074beeb2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:41.143140 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 223/441] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:41:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:41.149070 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb840ce-39d6-47b8-81ba-64d0074beeb2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:41.207969 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:41.226114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f0824-d218-45a8-86be-b0caafc09ae9 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:41.258679 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb840ce-39d6-47b8-81ba-64d0074beeb2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:41.261932 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fb8e0-f436-4e5a-a393-3fb5c3168774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:41.262947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fb8e0-f436-4e5a-a393-3fb5c3168774 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:41.263237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fb8e0-f436-4e5a-a393-3fb5c3168774 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:41.263516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fb8e0-f436-4e5a-a393-3fb5c3168774 None admin] PATH_INFO: `/v3/groups/80d3225599fd4914837c49dc6f92d39e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:41.264771 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fb8e0-f436-4e5a-a393-3fb5c3168774 None admin] RBAC: Authorizing `identity:get_group(group_id=80d3225599fd4914837c49dc6f92d39e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:41.266225 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fb8e0-f436-4e5a-a393-3fb5c3168774 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:41.268077 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 219/442] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jul 5 12:41:41 2022] GET /identity/v3/groups/80d3225599fd4914837c49dc6f92d39e => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:41.275046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fb8e0-f436-4e5a-a393-3fb5c3168774 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:41.297920 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d77994-4063-4ca4-bce8-73ed97867619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:41.298505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d77994-4063-4ca4-bce8-73ed97867619 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:41.298792 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d77994-4063-4ca4-bce8-73ed97867619 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:41.299069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d77994-4063-4ca4-bce8-73ed97867619 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:41.320173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:41.371165 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d77994-4063-4ca4-bce8-73ed97867619 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:41.373072 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d77994-4063-4ca4-bce8-73ed97867619 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:41.384125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fb8e0-f436-4e5a-a393-3fb5c3168774 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:41.419833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c9513-6b8d-47de-ad3a-22b231b450a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:41.420497 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c9513-6b8d-47de-ad3a-22b231b450a8 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:41.421221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c9513-6b8d-47de-ad3a-22b231b450a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:41.421522 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c9513-6b8d-47de-ad3a-22b231b450a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:41.422367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c9513-6b8d-47de-ad3a-22b231b450a8 None admin] RBAC: Adding query filter params (group.id=80d3225599fd4914837c49dc6f92d39e, role.id=66d9c5a190d544b3b3588bbdadf2cf39, scope.project.id=769c25d7cd5442f3a9359fa294a9befe) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:41.423031 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c9513-6b8d-47de-ad3a-22b231b450a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:41.424969 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c9513-6b8d-47de-ad3a-22b231b450a8 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:41.431178 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 220/443] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jul 5 12:41:41 2022] GET /identity/v3/role_assignments?group.id=80d3225599fd4914837c49dc6f92d39e&scope.project.id=769c25d7cd5442f3a9359fa294a9befe&role.id=66d9c5a190d544b3b3588bbdadf2cf39 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:41.438821 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:41.495449 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 224/444] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 12:41:41.497217 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c9513-6b8d-47de-ad3a-22b231b450a8 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:41.573124 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443d86c-d198-48d3-8e4f-efd4e9ccb44b None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:41.573434 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443d86c-d198-48d3-8e4f-efd4e9ccb44b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:41.573681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443d86c-d198-48d3-8e4f-efd4e9ccb44b None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:41.575050 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 225/445] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:41.580132 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58255a5-ad4f-4a90-93d8-7e63d12ba473 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:41.580417 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58255a5-ad4f-4a90-93d8-7e63d12ba473 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:41.580731 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58255a5-ad4f-4a90-93d8-7e63d12ba473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:41.599314 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a58255a5-ad4f-4a90-93d8-7e63d12ba473 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:41.600978 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a58255a5-ad4f-4a90-93d8-7e63d12ba473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:41.608155 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c9513-6b8d-47de-ad3a-22b231b450a8 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:41.609993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:41.657250 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784d501-91ec-418f-9a63-212576f757a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:41.658697 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784d501-91ec-418f-9a63-212576f757a7 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:41.658984 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784d501-91ec-418f-9a63-212576f757a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:41.659256 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784d501-91ec-418f-9a63-212576f757a7 None admin] PATH_INFO: `/v3/projects/769c25d7cd5442f3a9359fa294a9befe` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:41.660523 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784d501-91ec-418f-9a63-212576f757a7 None admin] RBAC: Authorizing `identity:get_project(project_id=769c25d7cd5442f3a9359fa294a9befe)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:41.662544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784d501-91ec-418f-9a63-212576f757a7 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:41.664407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 221/446] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:41 2022] GET /identity/v3/projects/769c25d7cd5442f3a9359fa294a9befe => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:41.669629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784d501-91ec-418f-9a63-212576f757a7 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:41.689230 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 226/447] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:41:41.714153 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58255a5-ad4f-4a90-93d8-7e63d12ba473 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:41.794585 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784d501-91ec-418f-9a63-212576f757a7 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:41.812940 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:41.827199 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58255a5-ad4f-4a90-93d8-7e63d12ba473 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:41.828886 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77846c-1de5-4af8-bb33-0de0f9a28fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:41.829761 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77846c-1de5-4af8-bb33-0de0f9a28fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:41.830046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77846c-1de5-4af8-bb33-0de0f9a28fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:41.830327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77846c-1de5-4af8-bb33-0de0f9a28fd6 None admin] PATH_INFO: `/v3/groups/80d3225599fd4914837c49dc6f92d39e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:41.831511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77846c-1de5-4af8-bb33-0de0f9a28fd6 None admin] RBAC: Authorizing `identity:get_group(group_id=80d3225599fd4914837c49dc6f92d39e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:41.833008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77846c-1de5-4af8-bb33-0de0f9a28fd6 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:41.834793 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 222/448] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jul 5 12:41:41 2022] GET /identity/v3/groups/80d3225599fd4914837c49dc6f92d39e => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:41.840449 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77846c-1de5-4af8-bb33-0de0f9a28fd6 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:41.862166 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33875f5c-d3a5-4f38-8631-a75bd58c8aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:41.862958 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33875f5c-d3a5-4f38-8631-a75bd58c8aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:41.863242 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33875f5c-d3a5-4f38-8631-a75bd58c8aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:41.863519 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33875f5c-d3a5-4f38-8631-a75bd58c8aa4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:41.874090 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33875f5c-d3a5-4f38-8631-a75bd58c8aa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:41.880633 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:41.881700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-33875f5c-d3a5-4f38-8631-a75bd58c8aa4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:41:41.881700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:41.881700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:41.881700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:41.881700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:41.881700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:41.881700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:41.881700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:41.881700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:41.881700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:41.881700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:41.881700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:41.881700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:41.881700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:41.881700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:41.881700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:41.882619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:41.882619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:41.882619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:41.882619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:41.882619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:41.882619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:41.882619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:41.882619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:41.882619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:41.882619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:41.882619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:41.882619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:41.882619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:41.882619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:41.882619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:41.882619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:41.883409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:41.883409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:41.883409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:41.883409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:41.883409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:41.883409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:41.883409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:41.883409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:41.883409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:41.883409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:41.883409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:41:41.883409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:41.883409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 227/449] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:41:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:41:41.888404 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33875f5c-d3a5-4f38-8631-a75bd58c8aa4 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:41.941682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77846c-1de5-4af8-bb33-0de0f9a28fd6 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:41.977067 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e03d62-81d1-4905-936e-a796bbbbee9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:41.977713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e03d62-81d1-4905-936e-a796bbbbee9d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:41.977999 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e03d62-81d1-4905-936e-a796bbbbee9d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:41.978279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e03d62-81d1-4905-936e-a796bbbbee9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:41.979166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e03d62-81d1-4905-936e-a796bbbbee9d None admin] RBAC: Adding query filter params (group.id=80d3225599fd4914837c49dc6f92d39e, role.id=5ea7d4a868fb49b8992c3adb30476789, scope.project.id=769c25d7cd5442f3a9359fa294a9befe) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:41.979486 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e03d62-81d1-4905-936e-a796bbbbee9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:41.980952 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e03d62-81d1-4905-936e-a796bbbbee9d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:41.986674 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 223/450] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jul 5 12:41:41 2022] GET /identity/v3/role_assignments?group.id=80d3225599fd4914837c49dc6f92d39e&scope.project.id=769c25d7cd5442f3a9359fa294a9befe&role.id=5ea7d4a868fb49b8992c3adb30476789 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:41.988105 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33875f5c-d3a5-4f38-8631-a75bd58c8aa4 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:42.023763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7601b6f-be9f-4e0c-9a86-af86c5a836a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:42.024442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7601b6f-be9f-4e0c-9a86-af86c5a836a5 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:42.024752 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7601b6f-be9f-4e0c-9a86-af86c5a836a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:42.025030 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7601b6f-be9f-4e0c-9a86-af86c5a836a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:42.025786 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7601b6f-be9f-4e0c-9a86-af86c5a836a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:42.026092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7601b6f-be9f-4e0c-9a86-af86c5a836a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:42.027485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7601b6f-be9f-4e0c-9a86-af86c5a836a5 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:42.037663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 228/451] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:42.043492 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e03d62-81d1-4905-936e-a796bbbbee9d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:42.149258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e03d62-81d1-4905-936e-a796bbbbee9d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:42.150859 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:42.184817 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f7914-b960-42a0-99f5-785a1e0050ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:42.185468 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f7914-b960-42a0-99f5-785a1e0050ac None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:42.185810 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f7914-b960-42a0-99f5-785a1e0050ac None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:42.186084 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f7914-b960-42a0-99f5-785a1e0050ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:42.253977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f7914-b960-42a0-99f5-785a1e0050ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:42.256005 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f7914-b960-42a0-99f5-785a1e0050ac None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:42.353820 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 224/452] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 12:41:42.359340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7601b6f-be9f-4e0c-9a86-af86c5a836a5 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:42.370885 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:42.454886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7601b6f-be9f-4e0c-9a86-af86c5a836a5 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:42.486918 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f45c3-8964-4e3e-b786-7edeae4a0bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:42.487757 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f45c3-8964-4e3e-b786-7edeae4a0bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:42.488036 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f45c3-8964-4e3e-b786-7edeae4a0bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:42.488307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f45c3-8964-4e3e-b786-7edeae4a0bd3 None admin] PATH_INFO: `/v3/projects/b34caad9134a4665ac2d8976c95be2ac` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:42.490052 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f45c3-8964-4e3e-b786-7edeae4a0bd3 None admin] RBAC: Authorizing `identity:get_project(project_id=b34caad9134a4665ac2d8976c95be2ac)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:42.491520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f45c3-8964-4e3e-b786-7edeae4a0bd3 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:42.493197 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 229/453] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:41:42 2022] GET /identity/v3/projects/b34caad9134a4665ac2d8976c95be2ac => generated 344 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:42.498543 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f7914-b960-42a0-99f5-785a1e0050ac None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:42.500712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:42.595508 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f7914-b960-42a0-99f5-785a1e0050ac None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:42.628615 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1104478-0826-42f8-8dd3-d9ccf529712d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:42.629416 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1104478-0826-42f8-8dd3-d9ccf529712d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:42.629703 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1104478-0826-42f8-8dd3-d9ccf529712d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:42.630006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1104478-0826-42f8-8dd3-d9ccf529712d None admin] PATH_INFO: `/v3/groups/fc06ca99addd44f3a366211f96f1014f` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:42.631165 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1104478-0826-42f8-8dd3-d9ccf529712d None admin] RBAC: Authorizing `identity:get_group(group_id=fc06ca99addd44f3a366211f96f1014f)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:42.632625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1104478-0826-42f8-8dd3-d9ccf529712d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:42.634208 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 225/454] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jul 5 12:41:42 2022] GET /identity/v3/groups/fc06ca99addd44f3a366211f96f1014f => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:42.639764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f45c3-8964-4e3e-b786-7edeae4a0bd3 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:42.713983 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:42.736487 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f45c3-8964-4e3e-b786-7edeae4a0bd3 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:42.769088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26098ba1-41a0-4b6a-ad0b-639d0e23458c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:42.769724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26098ba1-41a0-4b6a-ad0b-639d0e23458c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:42.770003 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26098ba1-41a0-4b6a-ad0b-639d0e23458c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:42.770276 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26098ba1-41a0-4b6a-ad0b-639d0e23458c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:42.771615 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26098ba1-41a0-4b6a-ad0b-639d0e23458c None admin] RBAC: Adding query filter params (group.id=fc06ca99addd44f3a366211f96f1014f, role.id=868c7a356c674ded875dd079f5a9f5e0, scope.project.id=b34caad9134a4665ac2d8976c95be2ac) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:42.771925 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26098ba1-41a0-4b6a-ad0b-639d0e23458c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:42.773395 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26098ba1-41a0-4b6a-ad0b-639d0e23458c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:42.779014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 230/455] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jul 5 12:41:42 2022] GET /identity/v3/role_assignments?group.id=fc06ca99addd44f3a366211f96f1014f&scope.project.id=b34caad9134a4665ac2d8976c95be2ac&role.id=868c7a356c674ded875dd079f5a9f5e0 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:45.151776 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb272cb2-f798-490c-bf54-dc64fef44d4b None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:45.152329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb272cb2-f798-490c-bf54-dc64fef44d4b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:45.152329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb272cb2-f798-490c-bf54-dc64fef44d4b None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:45.153860 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 226/456] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:45.159227 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f0710-67d0-4229-a76d-7109a9e409c7 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:45.159621 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f0710-67d0-4229-a76d-7109a9e409c7 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:45.159771 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f0710-67d0-4229-a76d-7109a9e409c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:45.183061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-835f0710-67d0-4229-a76d-7109a9e409c7 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:45.184686 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-835f0710-67d0-4229-a76d-7109a9e409c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:45.287213 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 231/457] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:45.321380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb272cb2-f798-490c-bf54-dc64fef44d4b None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:45.409067 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:45.454214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb272cb2-f798-490c-bf54-dc64fef44d4b None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:45.500207 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ca525-85b0-4ba6-aa06-d39327e9d5d3 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:45.500763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ca525-85b0-4ba6-aa06-d39327e9d5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:45.501187 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ca525-85b0-4ba6-aa06-d39327e9d5d3 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:45.501370 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f7e94-44db-46c7-8552-98cc23056b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:45.502177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f7e94-44db-46c7-8552-98cc23056b0a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:45.502461 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f7e94-44db-46c7-8552-98cc23056b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:45.502738 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f7e94-44db-46c7-8552-98cc23056b0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:45.507829 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 232/458] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:45.509553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c28ae-61ac-476e-97bf-e1bc31ad2996 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:45.509995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c28ae-61ac-476e-97bf-e1bc31ad2996 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:45.510448 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c28ae-61ac-476e-97bf-e1bc31ad2996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:45.523692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f7e94-44db-46c7-8552-98cc23056b0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:45.525199 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f7e94-44db-46c7-8552-98cc23056b0a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:45.540965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-966c28ae-61ac-476e-97bf-e1bc31ad2996 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:45.542368 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-966c28ae-61ac-476e-97bf-e1bc31ad2996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:45.554008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-4d5f7e94-44db-46c7-8552-98cc23056b0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:45.554008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:45.554008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:45.554008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:45.554008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:45.554008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:45.554008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:45.554008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:45.554008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:45.554008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:45.554008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:45.554008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:45.554008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:45.554008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:45.554008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:45.554943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:45.554943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:45.554943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:45.554943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:45.554943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:45.554943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:45.554943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:45.554943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:45.554943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:45.554943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:45.554943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:45.554943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:45.554943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:45.554943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:45.554943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:45.554943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:45.554943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:45.555777 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:45.555777 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:45.555777 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:45.555777 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:45.561152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 227/459] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:45.566277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f7e94-44db-46c7-8552-98cc23056b0a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:45.621613 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:45.626983 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 233/460] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:41:45.671517 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c28ae-61ac-476e-97bf-e1bc31ad2996 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:45.715291 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f7e94-44db-46c7-8552-98cc23056b0a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:45.744225 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:45.759772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd62cf4-a8f3-48e5-9be3-266016c6d13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:45.761748 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd62cf4-a8f3-48e5-9be3-266016c6d13d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:45.762215 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd62cf4-a8f3-48e5-9be3-266016c6d13d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:45.762717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd62cf4-a8f3-48e5-9be3-266016c6d13d None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:45.763651 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd62cf4-a8f3-48e5-9be3-266016c6d13d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:45.764127 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd62cf4-a8f3-48e5-9be3-266016c6d13d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:45.766505 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd62cf4-a8f3-48e5-9be3-266016c6d13d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:45.787336 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 228/461] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:45.788942 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c4ac-ad25-4de8-bd1a-7f2b47fe24a6 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:45.789234 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c4ac-ad25-4de8-bd1a-7f2b47fe24a6 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:45.789514 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c4ac-ad25-4de8-bd1a-7f2b47fe24a6 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:45.791299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 229/462] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:45.792000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3c4ac-ad25-4de8-bd1a-7f2b47fe24a6 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:45.793557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c28ae-61ac-476e-97bf-e1bc31ad2996 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:45.837107 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e8657-962f-4490-85d8-917b24ad229d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:45.837909 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e8657-962f-4490-85d8-917b24ad229d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:45.838193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e8657-962f-4490-85d8-917b24ad229d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:45.838473 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e8657-962f-4490-85d8-917b24ad229d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:45.852100 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e8657-962f-4490-85d8-917b24ad229d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:45.853629 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e8657-962f-4490-85d8-917b24ad229d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:45.878466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-7f8e8657-962f-4490-85d8-917b24ad229d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:45.878466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:45.878466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:45.878466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:45.878466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:45.878466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:45.878466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:45.878466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:45.878466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:45.878466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:45.878466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:45.878466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:45.878466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:45.878466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:45.878466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:45.879364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:45.879364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:45.879364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:45.879364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:45.879364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:45.879364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:45.879364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:45.879364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:45.879364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:45.879364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:45.879364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:45.879364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:45.879364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:45.879364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:45.879364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:45.879364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:45.879364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:45.881165 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:45.881165 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:45.881165 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:45.881165 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:45.881165 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 234/463] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:41:45.884650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deca0a-8eaf-4db8-a57d-bd77e1ced7e1 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:45.884650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deca0a-8eaf-4db8-a57d-bd77e1ced7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:45.884650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deca0a-8eaf-4db8-a57d-bd77e1ced7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:45.902650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-87deca0a-8eaf-4db8-a57d-bd77e1ced7e1 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:45.903857 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-87deca0a-8eaf-4db8-a57d-bd77e1ced7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:45.909296 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3c4ac-ad25-4de8-bd1a-7f2b47fe24a6 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:45.948885 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cb92d-2590-429a-be07-0c55c7dd57d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:45.949730 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cb92d-2590-429a-be07-0c55c7dd57d6 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:45.950012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cb92d-2590-429a-be07-0c55c7dd57d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:45.950307 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cb92d-2590-429a-be07-0c55c7dd57d6 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:45.951325 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cb92d-2590-429a-be07-0c55c7dd57d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:45.953028 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cb92d-2590-429a-be07-0c55c7dd57d6 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:45.956857 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:45.976531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 235/464] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:45.977490 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87deca0a-8eaf-4db8-a57d-bd77e1ced7e1 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:46.083863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87deca0a-8eaf-4db8-a57d-bd77e1ced7e1 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:46.101782 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 230/465] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jul 5 12:41:45 2022] POST /identity/v3/users => generated 246 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:41:46.103177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a788d7-f2e4-461f-89c7-f7846eb18414 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:46.103470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a788d7-f2e4-461f-89c7-f7846eb18414 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:46.103749 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a788d7-f2e4-461f-89c7-f7846eb18414 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:46.108661 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 231/466] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:46.108661 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a788d7-f2e4-461f-89c7-f7846eb18414 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:46.136375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9765ab1-411e-4c0f-8926-70da6a2fd096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:46.137075 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9765ab1-411e-4c0f-8926-70da6a2fd096 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:46.137360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9765ab1-411e-4c0f-8926-70da6a2fd096 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:46.137641 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9765ab1-411e-4c0f-8926-70da6a2fd096 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:46.138397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9765ab1-411e-4c0f-8926-70da6a2fd096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:46.138712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9765ab1-411e-4c0f-8926-70da6a2fd096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:46.141023 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9765ab1-411e-4c0f-8926-70da6a2fd096 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:46.159833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 236/467] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:46.162908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc49549-46f8-4ebf-97a9-3b11e87e2d64 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:46.162908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc49549-46f8-4ebf-97a9-3b11e87e2d64 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:46.162908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc49549-46f8-4ebf-97a9-3b11e87e2d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:46.168812 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:46.181820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-fcc49549-46f8-4ebf-97a9-3b11e87e2d64 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:46.183294 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-fcc49549-46f8-4ebf-97a9-3b11e87e2d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:46.222400 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:46.246706 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a788d7-f2e4-461f-89c7-f7846eb18414 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:46.260681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 237/468] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:46.260681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc49549-46f8-4ebf-97a9-3b11e87e2d64 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:46.310571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98adaa-1de4-41ca-8a13-c04f0c6056df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:46.311360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98adaa-1de4-41ca-8a13-c04f0c6056df None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:46.311649 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98adaa-1de4-41ca-8a13-c04f0c6056df None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:46.311935 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98adaa-1de4-41ca-8a13-c04f0c6056df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:46.324775 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98adaa-1de4-41ca-8a13-c04f0c6056df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:46.326228 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98adaa-1de4-41ca-8a13-c04f0c6056df None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:46.346417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-ae98adaa-1de4-41ca-8a13-c04f0c6056df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:46.346417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:46.346417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:46.346417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:46.346417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:46.346417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:46.346417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:46.346417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:46.346417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:46.346417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:46.346417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:46.346417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:46.346417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:46.346417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:46.346417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:46.347314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:46.347314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:46.347314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:46.347314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:46.347314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:46.347314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:46.347314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:46.347314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:46.347314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:46.347314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:46.347314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:46.347314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:46.347314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:46.347314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:46.347314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:46.347314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:46.347314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:46.348146 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:46.348146 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:46.348146 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:46.348146 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:46.348146 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 232/469] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:46.349440 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98adaa-1de4-41ca-8a13-c04f0c6056df None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:46.390228 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc49549-46f8-4ebf-97a9-3b11e87e2d64 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:46.435168 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9835f-e09a-4982-a1e7-65a9f01aeef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:46.435854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9835f-e09a-4982-a1e7-65a9f01aeef6 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:46.436187 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9835f-e09a-4982-a1e7-65a9f01aeef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:46.436569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9835f-e09a-4982-a1e7-65a9f01aeef6 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:46.437456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9835f-e09a-4982-a1e7-65a9f01aeef6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:46.438934 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9835f-e09a-4982-a1e7-65a9f01aeef6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:46.460891 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:46.470409 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98adaa-1de4-41ca-8a13-c04f0c6056df None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:46.504521 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13103fa2-f4e7-4f76-a248-de9490809a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:46.505423 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13103fa2-f4e7-4f76-a248-de9490809a6c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:46.505716 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13103fa2-f4e7-4f76-a248-de9490809a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:46.505994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13103fa2-f4e7-4f76-a248-de9490809a6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:46.517827 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13103fa2-f4e7-4f76-a248-de9490809a6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:46.519363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13103fa2-f4e7-4f76-a248-de9490809a6c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:46.524760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 238/470] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jul 5 12:41:46 2022] POST /identity/v3/users => generated 248 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:41:46.525928 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9835f-e09a-4982-a1e7-65a9f01aeef6 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:46.545072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-13103fa2-f4e7-4f76-a248-de9490809a6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:46.545072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:46.545072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:46.545072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:46.545072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:46.545072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:46.545072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:46.545072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:46.545072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:46.545072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:46.545072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:46.545072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:46.545072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:46.545072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:46.545072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:46.546074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:46.546074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:46.546074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:46.546074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:46.546074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:46.546074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:46.546074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:46.546074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:46.546074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:46.546074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:46.546074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:46.546074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:46.546074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:46.546074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:46.546074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:46.546074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:46.546074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:46.547158 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:46.547158 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:46.547158 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:46.547158 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:46.549146 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 233/471] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:46.554719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13103fa2-f4e7-4f76-a248-de9490809a6c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:46.596881 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:46.738552 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9835f-e09a-4982-a1e7-65a9f01aeef6 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:46.749899 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13103fa2-f4e7-4f76-a248-de9490809a6c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:46.780435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157549d-6355-4fe0-bd04-52f591b2b13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:46.781133 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157549d-6355-4fe0-bd04-52f591b2b13e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:46.781416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157549d-6355-4fe0-bd04-52f591b2b13e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:46.781700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157549d-6355-4fe0-bd04-52f591b2b13e None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:46.782426 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157549d-6355-4fe0-bd04-52f591b2b13e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:46.782731 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157549d-6355-4fe0-bd04-52f591b2b13e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:46.784126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157549d-6355-4fe0-bd04-52f591b2b13e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:46.797317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 239/472] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:46.798715 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27661ac-d195-473c-a5df-e5cd903eabfc None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:46.799010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27661ac-d195-473c-a5df-e5cd903eabfc None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:46.799298 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27661ac-d195-473c-a5df-e5cd903eabfc None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:46.800820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 240/473] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:46.803727 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27661ac-d195-473c-a5df-e5cd903eabfc None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:46.832786 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b92bb8-d953-4610-89bc-d38a0b184bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:46.834151 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b92bb8-d953-4610-89bc-d38a0b184bbc None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:46.834151 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b92bb8-d953-4610-89bc-d38a0b184bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:46.834151 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b92bb8-d953-4610-89bc-d38a0b184bbc None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:46.834738 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b92bb8-d953-4610-89bc-d38a0b184bbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:46.835375 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b92bb8-d953-4610-89bc-d38a0b184bbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:46.837094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b92bb8-d953-4610-89bc-d38a0b184bbc None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:46.850750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 234/474] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:46.851903 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cddf08-1386-4b18-915c-9f48c8792e97 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:46.852870 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cddf08-1386-4b18-915c-9f48c8792e97 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:46.852870 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cddf08-1386-4b18-915c-9f48c8792e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:46.857430 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:46.870323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-20cddf08-1386-4b18-915c-9f48c8792e97 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:46.872126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-20cddf08-1386-4b18-915c-9f48c8792e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:46.930231 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:46.944522 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27661ac-d195-473c-a5df-e5cd903eabfc None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:46.948461 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 235/475] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:46.949791 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cddf08-1386-4b18-915c-9f48c8792e97 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:47.003472 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b1f30-a8ad-45b5-aacd-8505150a914f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:47.004074 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b1f30-a8ad-45b5-aacd-8505150a914f None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:47.004354 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b1f30-a8ad-45b5-aacd-8505150a914f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:47.004654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b1f30-a8ad-45b5-aacd-8505150a914f None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:47.005399 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b1f30-a8ad-45b5-aacd-8505150a914f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:47.006913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b1f30-a8ad-45b5-aacd-8505150a914f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:47.075381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cddf08-1386-4b18-915c-9f48c8792e97 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:47.109020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 241/476] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jul 5 12:41:46 2022] POST /identity/v3/users => generated 248 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:41:47.110529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b1f30-a8ad-45b5-aacd-8505150a914f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:47.119810 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:47.133048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b573b-4244-4507-ba17-69f7875d6377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:47.133746 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b573b-4244-4507-ba17-69f7875d6377 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:47.134035 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b573b-4244-4507-ba17-69f7875d6377 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:47.134306 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b573b-4244-4507-ba17-69f7875d6377 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:47.136945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b573b-4244-4507-ba17-69f7875d6377 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:47.139920 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b573b-4244-4507-ba17-69f7875d6377 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:47.239369 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 236/477] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jul 5 12:41:46 2022] POST /identity/v3/users => generated 249 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:41:47.261031 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b1f30-a8ad-45b5-aacd-8505150a914f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:47.305172 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185559a-82bf-4960-a8c2-3141db3734a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:47.306199 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185559a-82bf-4960-a8c2-3141db3734a7 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:47.306687 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185559a-82bf-4960-a8c2-3141db3734a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:47.307160 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185559a-82bf-4960-a8c2-3141db3734a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:47.308183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185559a-82bf-4960-a8c2-3141db3734a7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:47.309931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185559a-82bf-4960-a8c2-3141db3734a7 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:47.351548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.sql.core [None req-4185559a-82bf-4960-a8c2-3141db3734a7 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 12:41:47.351548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 05 12:41:47.351548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [parameters: {'id': 'd797148d0cb946a792d8f6117c05b6c2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 05 12:41:47.351548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80375) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 12:41:47.369385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-4185559a-82bf-4960-a8c2-3141db3734a7 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 05 12:41:47.369385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:47.369385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 12:41:47.369385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 12:41:47.369385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 12:41:47.369385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 12:41:47.369385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 12:41:47.369385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 12:41:47.369385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 12:41:47.369385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application conn.query(q) Jul 05 12:41:47.369385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 12:41:47.369385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 12:41:47.369385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 12:41:47.369385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application result.read() Jul 05 12:41:47.369385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 12:41:47.370763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 12:41:47.370763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 12:41:47.370763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 12:41:47.370763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 12:41:47.370763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 12:41:47.370763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 12:41:47.370763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 12:41:47.370763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 12:41:47.370763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:47.370763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 12:41:47.370763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:47.370763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:47.370763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 12:41:47.370763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 12:41:47.370763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 05 12:41:47.370763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return ref.to_dict() Jul 05 12:41:47.370763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 12:41:47.370763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application next(self.gen) Jul 05 12:41:47.371654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 12:41:47.371654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application yield resource Jul 05 12:41:47.371654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 12:41:47.371654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application next(self.gen) Jul 05 12:41:47.371654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 12:41:47.371654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 12:41:47.371654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 12:41:47.371654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 12:41:47.371654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 12:41:47.371654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise self.value Jul 05 12:41:47.371654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 12:41:47.371654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 12:41:47.371654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 12:41:47.371654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application session.commit() Jul 05 12:41:47.371654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 12:41:47.371654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 12:41:47.371654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 12:41:47.372497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 12:41:47.372497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 12:41:47.372497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.session.flush() Jul 05 12:41:47.372497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 12:41:47.372497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 12:41:47.372497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 12:41:47.372497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 12:41:47.372497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 12:41:47.372497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application compat.raise_( Jul 05 12:41:47.372497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 12:41:47.372497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception Jul 05 12:41:47.372497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 12:41:47.372497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 12:41:47.372497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 12:41:47.372497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 12:41:47.372497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 12:41:47.372497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 12:41:47.373397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 12:41:47.373397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 12:41:47.373397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 05 12:41:47.373397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 05 12:41:47.373397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 12:41:47.373397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 12:41:47.373397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 12:41:47.373397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 12:41:47.373397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 12:41:47.373397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 12:41:47.373397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 12:41:47.373397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 12:41:47.373397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 12:41:47.373397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 12:41:47.373397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 12:41:47.373397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception Jul 05 12:41:47.374283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 12:41:47.374283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 12:41:47.374283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 12:41:47.374283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 12:41:47.374283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 12:41:47.374283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 12:41:47.374283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 12:41:47.374283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application conn.query(q) Jul 05 12:41:47.374283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 12:41:47.374283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 12:41:47.374283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 12:41:47.374283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application result.read() Jul 05 12:41:47.374283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 12:41:47.374283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 12:41:47.374283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 12:41:47.374283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 12:41:47.375064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 12:41:47.375064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 12:41:47.375064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 12:41:47.375064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 12:41:47.375064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 12:41:47.375064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 05 12:41:47.375064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [parameters: {'id': 'd797148d0cb946a792d8f6117c05b6c2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 05 12:41:47.375064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 12:41:47.375064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:47.375064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:41:47.375064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:47.375064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:47.375064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:47.375064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:47.375064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:47.375064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:47.375956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:47.375956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:47.375956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:47.375956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:47.375956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:47.375956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:47.375956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 05 12:41:47.375956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 05 12:41:47.375956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:47.375956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:47.375956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 05 12:41:47.375956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 05 12:41:47.375956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 12:41:47.375956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 12:41:47.375956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 05 12:41:47.375956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:47.382024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 242/478] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Jul 5 12:41:47 2022] POST /identity/v3/roles => generated 144 bytes in 262 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:47.383173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b573b-4244-4507-ba17-69f7875d6377 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:47.505787 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b573b-4244-4507-ba17-69f7875d6377 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:47.543397 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a812980-f54f-460d-9f75-959e57ddd336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:47.544225 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a812980-f54f-460d-9f75-959e57ddd336 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:47.544513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a812980-f54f-460d-9f75-959e57ddd336 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:47.544827 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a812980-f54f-460d-9f75-959e57ddd336 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:47.556889 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a812980-f54f-460d-9f75-959e57ddd336 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:47.564998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-9a812980-f54f-460d-9f75-959e57ddd336 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:47.564998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:47.564998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:47.564998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:47.564998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:47.564998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:47.564998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:47.564998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:47.564998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:47.564998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:47.564998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:47.564998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:47.564998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:47.564998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:47.564998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:47.564998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:47.565864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:47.565864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:47.565864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:47.565864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:47.565864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:47.565864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:47.565864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:47.565864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:47.565864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:47.565864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:47.565864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:47.565864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:47.565864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:47.565864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:47.565864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:47.565864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:47.566658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:47.566658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:47.566658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:47.566658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:47.566658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:47.566658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:47.566658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:47.566658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:47.566658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:47.566658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:47.566658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 12:41:47.566658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:47.566658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 237/479] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jul 5 12:41:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:47.572233 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185559a-82bf-4960-a8c2-3141db3734a7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:47.585231 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:47.678845 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185559a-82bf-4960-a8c2-3141db3734a7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:47.715481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b3eb2-2f83-47df-a352-8b4d2c75fc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:47.716168 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b3eb2-2f83-47df-a352-8b4d2c75fc0f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:47.716447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b3eb2-2f83-47df-a352-8b4d2c75fc0f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:47.716741 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b3eb2-2f83-47df-a352-8b4d2c75fc0f None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:47.717498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b3eb2-2f83-47df-a352-8b4d2c75fc0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:47.717796 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b3eb2-2f83-47df-a352-8b4d2c75fc0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:47.719185 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b3eb2-2f83-47df-a352-8b4d2c75fc0f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:47.728413 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 243/480] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:41:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:48.491570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ad37d-a60c-45c7-8388-506e9e0866fe None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:48.492080 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ad37d-a60c-45c7-8388-506e9e0866fe None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:48.492080 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ad37d-a60c-45c7-8388-506e9e0866fe None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:48.493445 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 238/481] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:48.498593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621c045-3abd-4adc-9599-6c0bd708d503 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:48.498998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621c045-3abd-4adc-9599-6c0bd708d503 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:48.499201 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621c045-3abd-4adc-9599-6c0bd708d503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:48.516289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-3621c045-3abd-4adc-9599-6c0bd708d503 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:48.517519 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3621c045-3abd-4adc-9599-6c0bd708d503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:48.602890 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:48.607352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 244/482] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:48.642249 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ad37d-a60c-45c7-8388-506e9e0866fe None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:48.706461 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:48.778387 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ad37d-a60c-45c7-8388-506e9e0866fe None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:48.827189 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6a0d4-d0bd-42a7-a4f0-9fb389799516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:48.828364 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6a0d4-d0bd-42a7-a4f0-9fb389799516 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:48.828900 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6a0d4-d0bd-42a7-a4f0-9fb389799516 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:48.829389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6a0d4-d0bd-42a7-a4f0-9fb389799516 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:48.845421 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6a0d4-d0bd-42a7-a4f0-9fb389799516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:48.854000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-ffe6a0d4-d0bd-42a7-a4f0-9fb389799516 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:41:48.854000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:48.854000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:48.854000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:48.854000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:48.854000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:48.854000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:48.854000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:48.854000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:48.854000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:48.854000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:48.854000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:48.854000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:48.854000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:48.854000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:48.854000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:48.854871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:48.854871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:48.854871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:48.854871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:48.854871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:48.854871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:48.854871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:48.854871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:48.854871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:48.854871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:48.854871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:48.854871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:48.854871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:48.854871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:48.854871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:48.854871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:48.855662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:48.855662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:48.855662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:48.855662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:48.855662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:48.855662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:48.855662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:48.855662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:48.855662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:48.855662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:48.855662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:41:48.855662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:48.855662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 239/483] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:41:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:48.861012 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621c045-3abd-4adc-9599-6c0bd708d503 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:48.925832 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdda0b5-fe7f-4a2a-aa30-0027bf58d7b2 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:48.926150 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdda0b5-fe7f-4a2a-aa30-0027bf58d7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:48.926415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdda0b5-fe7f-4a2a-aa30-0027bf58d7b2 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:48.928071 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 240/484] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:48.935498 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405238d-652a-4358-83d2-0793aa5c5ac1 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:48.935786 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405238d-652a-4358-83d2-0793aa5c5ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:48.936065 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405238d-652a-4358-83d2-0793aa5c5ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:48.964209 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2405238d-652a-4358-83d2-0793aa5c5ac1 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:48.965454 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2405238d-652a-4358-83d2-0793aa5c5ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:48.993047 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621c045-3abd-4adc-9599-6c0bd708d503 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:49.037123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87009878-77f1-411b-8762-e8d8e17e3639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:49.037716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87009878-77f1-411b-8762-e8d8e17e3639 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:49.037997 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87009878-77f1-411b-8762-e8d8e17e3639 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:49.038273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87009878-77f1-411b-8762-e8d8e17e3639 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:49.039022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87009878-77f1-411b-8762-e8d8e17e3639 None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:49.039326 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87009878-77f1-411b-8762-e8d8e17e3639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:49.040737 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87009878-77f1-411b-8762-e8d8e17e3639 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:49.061942 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 245/485] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jul 5 12:41:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:49.072695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87009878-77f1-411b-8762-e8d8e17e3639 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:49.093343 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 241/486] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:49.137845 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405238d-652a-4358-83d2-0793aa5c5ac1 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:49.176885 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:49.215476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:49.220997 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87009878-77f1-411b-8762-e8d8e17e3639 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:49.275051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0433a-de9d-40e5-baeb-6c40e6a278be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:49.275856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0433a-de9d-40e5-baeb-6c40e6a278be None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:49.276144 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0433a-de9d-40e5-baeb-6c40e6a278be None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:49.276424 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0433a-de9d-40e5-baeb-6c40e6a278be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:49.294294 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0433a-de9d-40e5-baeb-6c40e6a278be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:49.295690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0433a-de9d-40e5-baeb-6c40e6a278be None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:49.315130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-98f0433a-de9d-40e5-baeb-6c40e6a278be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:49.315130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:49.315130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:49.315130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:49.315130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:49.315130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:49.315130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:49.315130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:49.315130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:49.315130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:49.315130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:49.315130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:49.315130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:49.315130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:49.315130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:49.316014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:49.316014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:49.316014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:49.316014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:49.316014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:49.316014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:49.316014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:49.316014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:49.316014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:49.316014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:49.316014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:49.316014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:49.316014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:49.316014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:49.316014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:49.316014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:49.316014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:49.318358 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:49.318358 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:49.318358 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:49.318358 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:49.318358 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 246/487] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:49.322995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0433a-de9d-40e5-baeb-6c40e6a278be None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:49.366722 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405238d-652a-4358-83d2-0793aa5c5ac1 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:49.440421 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4124f6-8a2e-4342-bcfc-9979b8c367cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:49.441269 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4124f6-8a2e-4342-bcfc-9979b8c367cc None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:49.441557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4124f6-8a2e-4342-bcfc-9979b8c367cc None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:49.441838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4124f6-8a2e-4342-bcfc-9979b8c367cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:49.446689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0433a-de9d-40e5-baeb-6c40e6a278be None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:49.452722 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4124f6-8a2e-4342-bcfc-9979b8c367cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:49.461392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-1f4124f6-8a2e-4342-bcfc-9979b8c367cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:41:49.461392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:49.461392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:49.461392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:49.461392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:49.461392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:49.461392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:49.461392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:49.461392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:49.461392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:49.461392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:49.461392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:49.461392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:49.461392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:49.461392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:49.461392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:49.463367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:49.463367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:49.463367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:49.463367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:49.463367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:49.463367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:49.463367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:49.463367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:49.463367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:49.463367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:49.463367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:49.463367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:49.463367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:49.463367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:49.463367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:49.463367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:49.464816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:49.464816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:49.464816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:49.464816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:49.464816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:49.464816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:49.464816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:49.464816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:49.464816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:49.464816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:49.464816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:41:49.464816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:49.464816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 242/488] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:41:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:41:49.475587 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:49.475836 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4124f6-8a2e-4342-bcfc-9979b8c367cc None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:49.503018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00403e0e-fb6f-4092-b1b7-75553ff0c817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:49.503677 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00403e0e-fb6f-4092-b1b7-75553ff0c817 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:49.503948 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00403e0e-fb6f-4092-b1b7-75553ff0c817 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:49.504226 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00403e0e-fb6f-4092-b1b7-75553ff0c817 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:49.505590 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00403e0e-fb6f-4092-b1b7-75553ff0c817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:49.505895 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00403e0e-fb6f-4092-b1b7-75553ff0c817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:49.507277 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00403e0e-fb6f-4092-b1b7-75553ff0c817 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:49.529983 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 247/489] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:49.535844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00403e0e-fb6f-4092-b1b7-75553ff0c817 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:49.634529 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:49.639072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4124f6-8a2e-4342-bcfc-9979b8c367cc None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:49.647110 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00403e0e-fb6f-4092-b1b7-75553ff0c817 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:49.677352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e6856-5e51-4cc6-837b-e0bd7986e046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:49.678126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e6856-5e51-4cc6-837b-e0bd7986e046 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:49.678417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e6856-5e51-4cc6-837b-e0bd7986e046 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:49.678699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e6856-5e51-4cc6-837b-e0bd7986e046 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:49.679454 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e6856-5e51-4cc6-837b-e0bd7986e046 None admin] RBAC: Adding query filter params (name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:49.679760 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e6856-5e51-4cc6-837b-e0bd7986e046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:49.681166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e6856-5e51-4cc6-837b-e0bd7986e046 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:49.682729 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e7b3a-70b2-458c-bcba-cb34157d9045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:49.683521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e7b3a-70b2-458c-bcba-cb34157d9045 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:49.683800 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e7b3a-70b2-458c-bcba-cb34157d9045 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:49.684074 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e7b3a-70b2-458c-bcba-cb34157d9045 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:49.689935 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 243/490] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jul 5 12:41:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:49.696029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e6856-5e51-4cc6-837b-e0bd7986e046 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:49.699928 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e7b3a-70b2-458c-bcba-cb34157d9045 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:49.705501 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e7b3a-70b2-458c-bcba-cb34157d9045 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:49.732561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-852e7b3a-70b2-458c-bcba-cb34157d9045 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:41:49.732561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:49.732561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:49.732561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:49.732561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:49.732561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:49.732561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:49.732561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:49.732561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:49.732561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:49.732561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:49.732561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:49.732561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:41:49.732561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:41:49.732561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:41:49.732561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:41:49.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:49.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:49.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:41:49.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:41:49.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:41:49.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:41:49.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:49.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:49.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:49.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:49.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:49.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:49.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:49.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:49.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:49.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:49.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:49.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:49.737184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:49.737184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:49.737184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:41:49.737184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:41:49.737184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:41:49.737184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:41:49.737184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:41:49.737184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:41:49.737184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:41:49.737184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:49.737184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 248/491] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jul 5 12:41:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:49.745537 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e7b3a-70b2-458c-bcba-cb34157d9045 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:49.801153 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:49.807331 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e6856-5e51-4cc6-837b-e0bd7986e046 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:49.841680 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8294b-4aa6-4595-8666-58c36bcf41a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:49.842958 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8294b-4aa6-4595-8666-58c36bcf41a7 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:49.843339 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8294b-4aa6-4595-8666-58c36bcf41a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:49.843726 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8294b-4aa6-4595-8666-58c36bcf41a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:49.858217 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8294b-4aa6-4595-8666-58c36bcf41a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:49.859914 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8294b-4aa6-4595-8666-58c36bcf41a7 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:49.866674 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e7b3a-70b2-458c-bcba-cb34157d9045 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:49.881526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-47c8294b-4aa6-4595-8666-58c36bcf41a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:49.881526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:49.881526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:49.881526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:49.881526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:49.881526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:49.881526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:49.881526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:49.881526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:49.881526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:49.881526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:49.881526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:49.881526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:49.881526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:49.881526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:49.882382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:49.882382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:49.882382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:49.882382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:49.882382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:49.882382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:49.882382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:49.882382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:49.882382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:49.882382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:49.882382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:49.882382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:49.882382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:49.882382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:49.882382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:49.882382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:49.882382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:49.883827 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:49.883827 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:49.883827 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:49.883827 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:49.883827 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 244/492] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:49.884239 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc6361-0673-40e2-a6b7-31e74af6b216 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:49.884523 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc6361-0673-40e2-a6b7-31e74af6b216 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:49.884878 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc6361-0673-40e2-a6b7-31e74af6b216 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:49.886347 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 245/493] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:49.890965 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc6361-0673-40e2-a6b7-31e74af6b216 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:49.907334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19950561-9365-40fa-aaf6-83ecd03879be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:49.908366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19950561-9365-40fa-aaf6-83ecd03879be None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:49.908891 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19950561-9365-40fa-aaf6-83ecd03879be None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:49.909368 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19950561-9365-40fa-aaf6-83ecd03879be None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:49.910425 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19950561-9365-40fa-aaf6-83ecd03879be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:49.911478 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19950561-9365-40fa-aaf6-83ecd03879be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:49.913207 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19950561-9365-40fa-aaf6-83ecd03879be None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:49.920986 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:49.966138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 249/494] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jul 5 12:41:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:49.968268 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e512ffa-e8c0-4f30-b5c0-8e9aea2e9ec8 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:49.968791 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e512ffa-e8c0-4f30-b5c0-8e9aea2e9ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:49.969294 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e512ffa-e8c0-4f30-b5c0-8e9aea2e9ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:49.992332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-4e512ffa-e8c0-4f30-b5c0-8e9aea2e9ec8 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:49.994241 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4e512ffa-e8c0-4f30-b5c0-8e9aea2e9ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:49.994569 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc6361-0673-40e2-a6b7-31e74af6b216 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:50.030058 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad973b78-7842-4348-992e-ea410f542919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:50.031140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad973b78-7842-4348-992e-ea410f542919 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:50.031567 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad973b78-7842-4348-992e-ea410f542919 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:50.032060 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad973b78-7842-4348-992e-ea410f542919 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:50.032953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad973b78-7842-4348-992e-ea410f542919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:50.033437 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad973b78-7842-4348-992e-ea410f542919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:50.034961 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad973b78-7842-4348-992e-ea410f542919 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:50.048804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 246/495] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:50.049965 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad973b78-7842-4348-992e-ea410f542919 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:50.089165 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 250/496] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:50.090028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e512ffa-e8c0-4f30-b5c0-8e9aea2e9ec8 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:50.120754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:50.134813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:50.165610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad973b78-7842-4348-992e-ea410f542919 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:50.200335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878bd2b-4b5b-4aa7-b249-7a6bf17ba6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:50.201002 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878bd2b-4b5b-4aa7-b249-7a6bf17ba6ef None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:50.201290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878bd2b-4b5b-4aa7-b249-7a6bf17ba6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:50.201569 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878bd2b-4b5b-4aa7-b249-7a6bf17ba6ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:50.205483 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e512ffa-e8c0-4f30-b5c0-8e9aea2e9ec8 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:50.240940 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95e8d3-61f5-4c75-9bdf-8b76a74f09fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:50.241744 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95e8d3-61f5-4c75-9bdf-8b76a74f09fd None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:50.242028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95e8d3-61f5-4c75-9bdf-8b76a74f09fd None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:50.242305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95e8d3-61f5-4c75-9bdf-8b76a74f09fd None admin] PATH_INFO: `/v3/users/glance` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:50.249927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95e8d3-61f5-4c75-9bdf-8b76a74f09fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:50.251569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95e8d3-61f5-4c75-9bdf-8b76a74f09fd None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:50.266044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-ce95e8d3-61f5-4c75-9bdf-8b76a74f09fd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 12:41:50.266044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:50.266044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:50.266044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:50.266044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:50.266044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:50.266044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:50.266044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:50.266044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:50.266044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:50.266044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:50.266044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:50.266044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:41:50.266044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:41:50.266044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:41:50.266044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:41:50.266944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:50.266944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:50.266944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:41:50.266944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:41:50.266944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:41:50.266944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:41:50.266944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:50.266944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:50.266944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:50.266944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:50.266944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:50.266944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:50.266944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:50.266944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:50.266944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:50.266944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:50.266944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:50.266944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:50.268553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:50.268553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:50.268553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:41:50.268553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:41:50.268553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:41:50.268553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:41:50.268553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:41:50.268553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:41:50.268553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 12:41:50.268553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:50.268553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 251/497] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:50.273304 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878bd2b-4b5b-4aa7-b249-7a6bf17ba6ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:50.273419 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6668e-5ecf-481d-81bc-1ccc88df6b9d None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:50.273674 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6668e-5ecf-481d-81bc-1ccc88df6b9d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:50.273950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6668e-5ecf-481d-81bc-1ccc88df6b9d None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:50.274762 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878bd2b-4b5b-4aa7-b249-7a6bf17ba6ef None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:50.276714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 252/498] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:50.276714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6668e-5ecf-481d-81bc-1ccc88df6b9d None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:50.345257 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:50.363603 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:50.376911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 247/499] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:50.377859 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878bd2b-4b5b-4aa7-b249-7a6bf17ba6ef None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:50.388814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6668e-5ecf-481d-81bc-1ccc88df6b9d None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:50.423870 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681cdc8-6803-439a-9ee0-0e80f2aed435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:50.424599 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681cdc8-6803-439a-9ee0-0e80f2aed435 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:50.424893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681cdc8-6803-439a-9ee0-0e80f2aed435 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:50.425170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681cdc8-6803-439a-9ee0-0e80f2aed435 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:50.437650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681cdc8-6803-439a-9ee0-0e80f2aed435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:50.445930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-9681cdc8-6803-439a-9ee0-0e80f2aed435 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:41:50.445930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:50.445930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:50.445930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:50.445930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:50.445930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:50.445930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:50.445930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:50.445930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:50.445930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:50.445930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:50.445930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:50.445930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:50.445930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:50.445930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:50.445930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:50.446815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:50.446815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:50.446815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:50.446815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:50.446815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:50.446815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:50.446815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:50.446815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:50.446815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:50.446815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:50.446815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:50.446815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:50.446815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:50.446815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:50.446815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:50.446815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:50.447608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:50.447608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:50.447608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:50.447608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:50.447608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:50.447608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:50.447608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:50.447608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:50.447608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:50.447608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:50.447608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:41:50.447608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:50.447608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 253/500] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:41:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:50.448865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d389585-7c19-422a-a3ca-07c68b9ffe26 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:50.448865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d389585-7c19-422a-a3ca-07c68b9ffe26 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:50.449019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d389585-7c19-422a-a3ca-07c68b9ffe26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:50.466081 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-9d389585-7c19-422a-a3ca-07c68b9ffe26 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:50.467311 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9d389585-7c19-422a-a3ca-07c68b9ffe26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:50.487308 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878bd2b-4b5b-4aa7-b249-7a6bf17ba6ef None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:50.524425 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16664fe6-bb6c-4c77-8edd-768a086692a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:50.525222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16664fe6-bb6c-4c77-8edd-768a086692a2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:50.525511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16664fe6-bb6c-4c77-8edd-768a086692a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:50.525794 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16664fe6-bb6c-4c77-8edd-768a086692a2 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:50.526626 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16664fe6-bb6c-4c77-8edd-768a086692a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:50.526939 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16664fe6-bb6c-4c77-8edd-768a086692a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:50.528385 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16664fe6-bb6c-4c77-8edd-768a086692a2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:50.535219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 254/501] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:50.537272 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d389585-7c19-422a-a3ca-07c68b9ffe26 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:50.571519 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 248/502] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jul 5 12:41:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:50.572723 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16664fe6-bb6c-4c77-8edd-768a086692a2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:50.602761 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:50.617912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:50.645696 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d389585-7c19-422a-a3ca-07c68b9ffe26 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:50.670899 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16664fe6-bb6c-4c77-8edd-768a086692a2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:50.679427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9b693-4dbb-4a78-93d6-f24c2e7c896d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:50.680155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9b693-4dbb-4a78-93d6-f24c2e7c896d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:50.680436 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9b693-4dbb-4a78-93d6-f24c2e7c896d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:50.680765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9b693-4dbb-4a78-93d6-f24c2e7c896d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:50.691263 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9b693-4dbb-4a78-93d6-f24c2e7c896d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:50.692805 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9b693-4dbb-4a78-93d6-f24c2e7c896d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:50.704598 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbb640-6cf6-4e46-89df-866b71c505d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:50.705259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbb640-6cf6-4e46-89df-866b71c505d5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:50.705542 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbb640-6cf6-4e46-89df-866b71c505d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:50.705817 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbb640-6cf6-4e46-89df-866b71c505d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:50.706556 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbb640-6cf6-4e46-89df-866b71c505d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:50.706862 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbb640-6cf6-4e46-89df-866b71c505d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:50.708273 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbb640-6cf6-4e46-89df-866b71c505d5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:50.709685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-e8f9b693-4dbb-4a78-93d6-f24c2e7c896d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:50.709685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:50.709685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:50.709685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:50.709685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:50.709685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:50.709685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:50.709685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:50.709685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:50.709685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:50.709685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:50.709685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:50.709685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:50.709685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:50.709685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:50.710591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:50.710591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:50.710591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:50.710591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:50.710591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:50.710591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:50.710591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:50.710591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:50.710591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:50.710591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:50.710591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:50.710591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:50.710591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:50.710591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:50.710591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:50.710591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:50.710591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:50.711420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:50.711420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:50.711420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:50.711420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:50.711420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 255/503] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:50.712080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdb647-7878-4354-a8ea-52d81583594e None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:50.712308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdb647-7878-4354-a8ea-52d81583594e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:50.712579 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdb647-7878-4354-a8ea-52d81583594e None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:50.713846 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 256/504] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:50.714529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdb647-7878-4354-a8ea-52d81583594e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:50.718953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 249/505] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jul 5 12:41:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:50.719946 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbb640-6cf6-4e46-89df-866b71c505d5 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:50.812148 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:50.817088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdb647-7878-4354-a8ea-52d81583594e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:50.820791 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbb640-6cf6-4e46-89df-866b71c505d5 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:50.840125 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:50.851367 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773a943-cf60-4410-a1e2-535612dc8a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:50.852159 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773a943-cf60-4410-a1e2-535612dc8a70 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:50.852439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773a943-cf60-4410-a1e2-535612dc8a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:50.852745 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773a943-cf60-4410-a1e2-535612dc8a70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:50.854880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d3d82-a235-4cb0-aa11-662ef94639e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:50.855516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d3d82-a235-4cb0-aa11-662ef94639e5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:50.855797 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d3d82-a235-4cb0-aa11-662ef94639e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:50.856071 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d3d82-a235-4cb0-aa11-662ef94639e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:50.862511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773a943-cf60-4410-a1e2-535612dc8a70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:50.870683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-b773a943-cf60-4410-a1e2-535612dc8a70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:41:50.870683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:50.870683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:50.870683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:50.870683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:50.870683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:50.870683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:50.870683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:50.870683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:50.870683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:50.870683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:50.870683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:50.870683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:50.870683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:50.870683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:50.870683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:50.871577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:50.871577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:50.871577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:50.871577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:50.871577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:50.871577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:50.871577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:50.871577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:50.871577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:50.871577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:50.871577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:50.871577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:50.871577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:50.871577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:50.871577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:50.871577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:50.872340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:50.872340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:50.872340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:50.872340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:50.872340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:50.872340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:50.872340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:50.872340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:50.872340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:50.872340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:50.872340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:41:50.872340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:50.872340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 257/506] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:41:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:50.873065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773a943-cf60-4410-a1e2-535612dc8a70 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:50.925849 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d3d82-a235-4cb0-aa11-662ef94639e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:50.927360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d3d82-a235-4cb0-aa11-662ef94639e5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:50.973917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773a943-cf60-4410-a1e2-535612dc8a70 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:51.007601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aceaef-4520-4348-921a-b21ef2e2629d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:51.008256 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aceaef-4520-4348-921a-b21ef2e2629d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:51.008540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aceaef-4520-4348-921a-b21ef2e2629d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:51.008847 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aceaef-4520-4348-921a-b21ef2e2629d None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:51.009569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aceaef-4520-4348-921a-b21ef2e2629d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:51.009879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aceaef-4520-4348-921a-b21ef2e2629d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:51.011266 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aceaef-4520-4348-921a-b21ef2e2629d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:51.016625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:51.022199 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 258/507] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:51.023372 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163f6cf-42a0-4311-a0ca-d871f439c735 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:51.023661 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163f6cf-42a0-4311-a0ca-d871f439c735 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:51.027370 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163f6cf-42a0-4311-a0ca-d871f439c735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:51.027484 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 250/508] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:51.027484 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d3d82-a235-4cb0-aa11-662ef94639e5 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:51.042975 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-5163f6cf-42a0-4311-a0ca-d871f439c735 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:51.044173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5163f6cf-42a0-4311-a0ca-d871f439c735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:51.086126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:51.111637 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 259/509] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:51.112452 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163f6cf-42a0-4311-a0ca-d871f439c735 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:51.130109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d3d82-a235-4cb0-aa11-662ef94639e5 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:51.175877 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fac0c-7263-483a-a80d-7fd1889779cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:51.176715 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fac0c-7263-483a-a80d-7fd1889779cd None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:51.177000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fac0c-7263-483a-a80d-7fd1889779cd None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:51.177271 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fac0c-7263-483a-a80d-7fd1889779cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:51.186993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fac0c-7263-483a-a80d-7fd1889779cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:51.188438 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fac0c-7263-483a-a80d-7fd1889779cd None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:51.205328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-831fac0c-7263-483a-a80d-7fd1889779cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:51.205328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:51.205328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:51.205328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:51.205328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:51.205328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:51.205328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:51.205328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:51.205328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:51.205328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:51.205328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:51.205328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:51.205328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:51.205328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:51.205328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:51.206173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:51.206173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:51.206173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:51.206173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:51.206173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:51.206173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:51.206173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:51.206173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:51.206173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:51.206173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:51.206173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:51.206173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:51.206173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:51.206173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:51.206173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:51.206173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:51.206173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:51.206999 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:51.206999 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:51.206999 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:51.206999 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:51.206999 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 251/510] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:51.207268 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fac0c-7263-483a-a80d-7fd1889779cd None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:51.217214 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163f6cf-42a0-4311-a0ca-d871f439c735 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:51.251544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a349fb-147f-4eb7-a2b3-9e13591188dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:51.252465 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a349fb-147f-4eb7-a2b3-9e13591188dd None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:51.252782 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a349fb-147f-4eb7-a2b3-9e13591188dd None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:51.253064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a349fb-147f-4eb7-a2b3-9e13591188dd None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:51.253810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a349fb-147f-4eb7-a2b3-9e13591188dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:51.254118 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a349fb-147f-4eb7-a2b3-9e13591188dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:51.254237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:51.256025 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a349fb-147f-4eb7-a2b3-9e13591188dd None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:51.263807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 260/511] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jul 5 12:41:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:51.267989 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a349fb-147f-4eb7-a2b3-9e13591188dd None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:51.299262 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:51.308684 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fac0c-7263-483a-a80d-7fd1889779cd None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:51.342625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39515bed-fde6-48eb-9556-81e31434df28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:51.343403 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39515bed-fde6-48eb-9556-81e31434df28 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:51.343682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39515bed-fde6-48eb-9556-81e31434df28 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:51.343955 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39515bed-fde6-48eb-9556-81e31434df28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:51.350709 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39515bed-fde6-48eb-9556-81e31434df28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:51.352140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39515bed-fde6-48eb-9556-81e31434df28 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:51.362282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a349fb-147f-4eb7-a2b3-9e13591188dd None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:51.366537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-39515bed-fde6-48eb-9556-81e31434df28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:41:51.366537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:51.366537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:51.366537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:51.366537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:51.366537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:51.366537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:51.366537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:51.366537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:51.366537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:51.366537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:51.366537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:51.366537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:41:51.366537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:41:51.366537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:41:51.367376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:41:51.367376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:51.367376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:51.367376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:51.367376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:51.367376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:51.367376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:51.367376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:51.367376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:51.367376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:51.367376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:51.367376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:51.367376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:51.367376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:51.367376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:51.367376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:51.367376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:51.368223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:41:51.368223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:41:51.368223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:41:51.368223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:41:51.368223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:41:51.368223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:41:51.368223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:41:51.368223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:51.368223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 252/512] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:41:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:51.369161 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39515bed-fde6-48eb-9556-81e31434df28 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:51.399655 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6aeedb-a722-4a68-930a-bd5955faa17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:51.400442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6aeedb-a722-4a68-930a-bd5955faa17f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:51.400759 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6aeedb-a722-4a68-930a-bd5955faa17f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:51.401036 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6aeedb-a722-4a68-930a-bd5955faa17f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:51.410777 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6aeedb-a722-4a68-930a-bd5955faa17f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:51.412803 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6aeedb-a722-4a68-930a-bd5955faa17f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:51.430024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-4b6aeedb-a722-4a68-930a-bd5955faa17f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:51.430024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:51.430024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:51.430024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:51.430024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:51.430024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:51.430024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:51.430024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:51.430024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:51.430024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:51.430024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:51.430024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:51.430024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:51.430024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:51.430024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:51.431020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:51.431020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:51.431020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:51.431020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:51.431020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:51.431020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:51.431020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:51.431020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:51.431020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:51.431020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:51.431020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:51.431020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:51.431020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:51.431020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:51.431020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:51.431020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:51.431020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:51.432065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:51.432065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:51.432065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:51.432065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:51.432065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 261/513] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:51.432065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6aeedb-a722-4a68-930a-bd5955faa17f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:51.468538 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39515bed-fde6-48eb-9556-81e31434df28 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:51.470931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:51.503687 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48953c-8032-46b2-9230-90a866e4b5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:51.504635 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48953c-8032-46b2-9230-90a866e4b5cc None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:51.504993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48953c-8032-46b2-9230-90a866e4b5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:51.505339 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48953c-8032-46b2-9230-90a866e4b5cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:51.515261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48953c-8032-46b2-9230-90a866e4b5cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:51.516294 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:51.516748 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48953c-8032-46b2-9230-90a866e4b5cc None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:51.527694 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6aeedb-a722-4a68-930a-bd5955faa17f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:51.533807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-fc48953c-8032-46b2-9230-90a866e4b5cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:51.533807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:51.533807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:51.533807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:51.533807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:51.533807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:51.533807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:51.533807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:51.533807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:51.533807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:51.533807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:51.533807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:51.533807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:51.533807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:51.533807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:51.534657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:51.534657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:51.534657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:51.534657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:51.534657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:51.534657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:51.534657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:51.534657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:51.534657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:51.534657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:51.534657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:51.534657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:51.534657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:51.534657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:51.534657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:51.534657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:51.534657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:51.535495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:51.535495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:51.535495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:51.535495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:51.535495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 253/514] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:51.536727 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48953c-8032-46b2-9230-90a866e4b5cc None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:51.563170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6b1a6-eb4b-43b9-9f24-880fc3a6b48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:51.563853 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6b1a6-eb4b-43b9-9f24-880fc3a6b48f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:51.564137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6b1a6-eb4b-43b9-9f24-880fc3a6b48f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:51.564420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6b1a6-eb4b-43b9-9f24-880fc3a6b48f None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:51.565196 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6b1a6-eb4b-43b9-9f24-880fc3a6b48f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:51.565516 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6b1a6-eb4b-43b9-9f24-880fc3a6b48f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:51.566931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6b1a6-eb4b-43b9-9f24-880fc3a6b48f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:51.577953 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 262/515] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:51.578746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6b1a6-eb4b-43b9-9f24-880fc3a6b48f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:51.639972 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48953c-8032-46b2-9230-90a866e4b5cc None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:51.673800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe1c61-8c33-4670-8305-f5209c533ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:51.674575 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe1c61-8c33-4670-8305-f5209c533ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:51.674854 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe1c61-8c33-4670-8305-f5209c533ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:51.675128 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe1c61-8c33-4670-8305-f5209c533ec0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:51.676511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6b1a6-eb4b-43b9-9f24-880fc3a6b48f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:51.685005 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe1c61-8c33-4670-8305-f5209c533ec0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:51.686446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe1c61-8c33-4670-8305-f5209c533ec0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:51.704055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-01fe1c61-8c33-4670-8305-f5209c533ec0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:51.704055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:51.704055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:51.704055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:51.704055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:51.704055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:51.704055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:51.704055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:51.704055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:51.704055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:51.704055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:51.704055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:51.704055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:51.704055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:51.704055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:51.705124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:51.705124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:51.705124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:51.705124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:51.705124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:51.705124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:51.705124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:51.705124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:51.705124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:51.705124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:51.705124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:51.705124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:51.705124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:51.705124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:51.705124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:51.705124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:51.705124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:51.705994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:51.705994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:51.705994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:51.705994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:51.705994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 254/516] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:51.705994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe1c61-8c33-4670-8305-f5209c533ec0 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:51.711931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32082377-95bb-4bc4-a700-03d9adfe7bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:51.712613 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32082377-95bb-4bc4-a700-03d9adfe7bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:51.712910 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32082377-95bb-4bc4-a700-03d9adfe7bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:51.713189 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32082377-95bb-4bc4-a700-03d9adfe7bd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:51.713976 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32082377-95bb-4bc4-a700-03d9adfe7bd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:51.714325 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32082377-95bb-4bc4-a700-03d9adfe7bd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:51.715774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32082377-95bb-4bc4-a700-03d9adfe7bd6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:51.716679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:51.733355 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 263/517] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:41:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:51.734157 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32082377-95bb-4bc4-a700-03d9adfe7bd6 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:51.747001 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:51.802085 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe1c61-8c33-4670-8305-f5209c533ec0 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:51.835911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32082377-95bb-4bc4-a700-03d9adfe7bd6 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:51.836846 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41626736-ccb9-4039-8a32-6d93f80f70e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:51.837499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41626736-ccb9-4039-8a32-6d93f80f70e1 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:51.837780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41626736-ccb9-4039-8a32-6d93f80f70e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:51.838056 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41626736-ccb9-4039-8a32-6d93f80f70e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:51.838768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41626736-ccb9-4039-8a32-6d93f80f70e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:51.839071 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41626736-ccb9-4039-8a32-6d93f80f70e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:51.840429 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41626736-ccb9-4039-8a32-6d93f80f70e1 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:51.851905 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 255/518] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:51.856417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41626736-ccb9-4039-8a32-6d93f80f70e1 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:51.870719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724b205-9327-414a-9acd-1541bcf080f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:51.871382 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724b205-9327-414a-9acd-1541bcf080f5 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:51.871665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724b205-9327-414a-9acd-1541bcf080f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:51.871942 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724b205-9327-414a-9acd-1541bcf080f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:51.872688 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724b205-9327-414a-9acd-1541bcf080f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:51.872994 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724b205-9327-414a-9acd-1541bcf080f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:51.874365 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724b205-9327-414a-9acd-1541bcf080f5 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:51.886002 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 264/519] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:51.886724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724b205-9327-414a-9acd-1541bcf080f5 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:51.918487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:51.950484 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:51.950962 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41626736-ccb9-4039-8a32-6d93f80f70e1 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:51.983485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724b205-9327-414a-9acd-1541bcf080f5 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:51.984039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcde17-9491-431d-8ee1-52aa8764d378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:51.984863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcde17-9491-431d-8ee1-52aa8764d378 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:51.985146 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcde17-9491-431d-8ee1-52aa8764d378 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:51.985417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcde17-9491-431d-8ee1-52aa8764d378 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:51.993325 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcde17-9491-431d-8ee1-52aa8764d378 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:51.994765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcde17-9491-431d-8ee1-52aa8764d378 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:52.010436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-24fcde17-9491-431d-8ee1-52aa8764d378 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 12:41:52.010436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:52.010436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:52.010436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:52.010436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:52.010436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:52.010436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:52.010436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:52.010436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:52.010436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:52.010436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:52.010436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:52.010436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:41:52.010436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:41:52.010436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:41:52.010436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:41:52.011382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:52.011382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:52.011382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:41:52.011382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:41:52.011382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:41:52.011382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:41:52.011382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:52.011382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:52.011382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:52.011382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:52.011382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:52.011382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:52.011382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:52.011382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:52.011382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:52.011382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:52.011382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:52.011382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:52.012273 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:52.012273 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:52.012273 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:41:52.012273 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:41:52.012273 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:41:52.012273 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:41:52.012273 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:41:52.012273 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:41:52.012273 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 12:41:52.012273 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:52.012273 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 256/520] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:52.013020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcde17-9491-431d-8ee1-52aa8764d378 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:52.021486 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e1975-af8f-41f6-8062-09bc62e08b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:52.022147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e1975-af8f-41f6-8062-09bc62e08b5e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:52.022430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e1975-af8f-41f6-8062-09bc62e08b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:52.022709 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e1975-af8f-41f6-8062-09bc62e08b5e None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:52.023437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e1975-af8f-41f6-8062-09bc62e08b5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:52.023745 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e1975-af8f-41f6-8062-09bc62e08b5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:52.025153 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e1975-af8f-41f6-8062-09bc62e08b5e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:52.037185 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 265/521] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:52.037961 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e1975-af8f-41f6-8062-09bc62e08b5e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:52.116603 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcde17-9491-431d-8ee1-52aa8764d378 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:52.138339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e1975-af8f-41f6-8062-09bc62e08b5e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:52.141978 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:52.149590 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ace4b4-a2cd-47b5-9347-fa6f795d09f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:52.161505 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ace4b4-a2cd-47b5-9347-fa6f795d09f6 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:52.161505 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ace4b4-a2cd-47b5-9347-fa6f795d09f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:52.161505 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ace4b4-a2cd-47b5-9347-fa6f795d09f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:52.161505 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ace4b4-a2cd-47b5-9347-fa6f795d09f6 None admin] RBAC: Adding query filter params (role.id=fb140b8a852547a5b8f339dce8d3440e, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=cdf37a42279a466b85906b23751f9c22) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:52.161505 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ace4b4-a2cd-47b5-9347-fa6f795d09f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:52.161505 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ace4b4-a2cd-47b5-9347-fa6f795d09f6 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:52.161925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 257/522] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:41:52 2022] GET /identity/v3/role_assignments?user.id=cdf37a42279a466b85906b23751f9c22&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=fb140b8a852547a5b8f339dce8d3440e => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:52.161925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ace4b4-a2cd-47b5-9347-fa6f795d09f6 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:52.170984 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:52.179781 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14614d59-49aa-44f8-8744-170dd0d40fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:52.180788 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14614d59-49aa-44f8-8744-170dd0d40fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:52.180895 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14614d59-49aa-44f8-8744-170dd0d40fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:52.181092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14614d59-49aa-44f8-8744-170dd0d40fd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:52.188846 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14614d59-49aa-44f8-8744-170dd0d40fd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:52.190370 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14614d59-49aa-44f8-8744-170dd0d40fd2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:52.209083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-14614d59-49aa-44f8-8744-170dd0d40fd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:41:52.209083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:52.209083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:52.209083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:52.209083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:52.209083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:52.209083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:52.209083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:52.209083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:52.209083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:52.209083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:52.209083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:52.209083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:41:52.209083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:41:52.209083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:41:52.209992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:41:52.209992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:52.209992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:52.209992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:52.209992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:52.209992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:52.209992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:52.209992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:52.209992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:52.209992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:52.209992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:52.209992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:52.209992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:52.209992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:52.209992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:52.209992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:52.209992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:52.210837 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:41:52.210837 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:41:52.210837 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:41:52.210837 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:41:52.210837 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:41:52.210837 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:41:52.210837 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:41:52.210837 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:52.210837 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 266/523] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:41:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:52.211402 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14614d59-49aa-44f8-8744-170dd0d40fd2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:52.275620 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ace4b4-a2cd-47b5-9347-fa6f795d09f6 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:52.313129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36d9fd-8dfe-49a1-a916-00bd1475b45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:52.313798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36d9fd-8dfe-49a1-a916-00bd1475b45f None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:52.314081 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36d9fd-8dfe-49a1-a916-00bd1475b45f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:52.314362 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36d9fd-8dfe-49a1-a916-00bd1475b45f None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:52.315814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36d9fd-8dfe-49a1-a916-00bd1475b45f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:52.316532 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36d9fd-8dfe-49a1-a916-00bd1475b45f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:52.323477 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14614d59-49aa-44f8-8744-170dd0d40fd2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:52.358197 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3d325-3207-4844-b63d-dbe2a8629e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:52.358873 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3d325-3207-4844-b63d-dbe2a8629e33 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:52.359157 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3d325-3207-4844-b63d-dbe2a8629e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:52.359432 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3d325-3207-4844-b63d-dbe2a8629e33 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:52.360267 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3d325-3207-4844-b63d-dbe2a8629e33 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:52.360577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3d325-3207-4844-b63d-dbe2a8629e33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:52.362047 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3d325-3207-4844-b63d-dbe2a8629e33 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:52.378841 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 267/524] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jul 5 12:41:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:52.380170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3d325-3207-4844-b63d-dbe2a8629e33 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:52.419783 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 258/525] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jul 5 12:41:52 2022] POST /identity/v3/users => generated 247 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:41:52.420862 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36d9fd-8dfe-49a1-a916-00bd1475b45f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:52.438698 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:52.486593 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:52.507996 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3d325-3207-4844-b63d-dbe2a8629e33 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:52.543990 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36d9fd-8dfe-49a1-a916-00bd1475b45f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:52.547281 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25ad29-34f3-45f6-9975-ee7b52d3dfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:52.548334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25ad29-34f3-45f6-9975-ee7b52d3dfb6 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:52.548884 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25ad29-34f3-45f6-9975-ee7b52d3dfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:52.549342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25ad29-34f3-45f6-9975-ee7b52d3dfb6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:52.561566 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25ad29-34f3-45f6-9975-ee7b52d3dfb6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:52.567800 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25ad29-34f3-45f6-9975-ee7b52d3dfb6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:52.580938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-aa25ad29-34f3-45f6-9975-ee7b52d3dfb6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 12:41:52.580938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:52.580938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:52.580938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:52.580938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:52.580938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:52.580938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:52.580938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:52.580938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:52.580938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:52.580938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:52.580938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:52.580938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:41:52.580938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:41:52.580938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:41:52.580938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:41:52.582037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:52.582037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:52.582037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:41:52.582037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:41:52.582037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:41:52.582037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:41:52.582037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:52.582037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:52.582037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:52.582037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:52.582037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:52.582037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:52.582037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:52.582037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:52.582037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:52.582037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:52.582037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:52.582037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:52.582977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:52.582977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:52.582977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:41:52.582977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:41:52.582977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:41:52.582977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:41:52.582977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:41:52.582977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:41:52.582977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 12:41:52.582977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:52.586871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 268/526] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:41:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:52.587594 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9e032-686c-4638-81a2-f0c011b2c730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:52.588129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25ad29-34f3-45f6-9975-ee7b52d3dfb6 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:52.588405 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9e032-686c-4638-81a2-f0c011b2c730 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:52.588785 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9e032-686c-4638-81a2-f0c011b2c730 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:52.589126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9e032-686c-4638-81a2-f0c011b2c730 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:52.590004 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9e032-686c-4638-81a2-f0c011b2c730 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:52.590381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9e032-686c-4638-81a2-f0c011b2c730 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:52.591999 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9e032-686c-4638-81a2-f0c011b2c730 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:52.616989 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 259/527] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:41:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:52.617865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9e032-686c-4638-81a2-f0c011b2c730 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:52.717474 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25ad29-34f3-45f6-9975-ee7b52d3dfb6 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:52.727308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:52.739992 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9e032-686c-4638-81a2-f0c011b2c730 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:52.752839 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:52.765118 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bf4e1-01db-4814-b4eb-699300a5995e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:52.765899 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bf4e1-01db-4814-b4eb-699300a5995e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:52.766268 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bf4e1-01db-4814-b4eb-699300a5995e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:52.766547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bf4e1-01db-4814-b4eb-699300a5995e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:52.783476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dba187-3270-4bab-a6ea-17a36ea8e59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:52.784562 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dba187-3270-4bab-a6ea-17a36ea8e59c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:52.784877 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dba187-3270-4bab-a6ea-17a36ea8e59c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:52.785442 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dba187-3270-4bab-a6ea-17a36ea8e59c None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:52.786836 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dba187-3270-4bab-a6ea-17a36ea8e59c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:52.787150 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dba187-3270-4bab-a6ea-17a36ea8e59c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:52.789345 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dba187-3270-4bab-a6ea-17a36ea8e59c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:52.814156 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 260/528] 10.222.0.36 () {56 vars in 1139 bytes} [Tue Jul 5 12:41:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:52.815101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dba187-3270-4bab-a6ea-17a36ea8e59c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:52.857833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9bf4e1-01db-4814-b4eb-699300a5995e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:52.859484 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9bf4e1-01db-4814-b4eb-699300a5995e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:52.942213 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dba187-3270-4bab-a6ea-17a36ea8e59c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:52.985914 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee8152-e8ec-4ac6-a46a-1a98c844dd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:52.986845 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee8152-e8ec-4ac6-a46a-1a98c844dd58 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:52.987131 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee8152-e8ec-4ac6-a46a-1a98c844dd58 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:52.987409 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee8152-e8ec-4ac6-a46a-1a98c844dd58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:52.988726 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee8152-e8ec-4ac6-a46a-1a98c844dd58 None admin] RBAC: Adding query filter params (role.id=fb140b8a852547a5b8f339dce8d3440e, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=7e7c4b0bd50c474996a21b69bde4e227) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:52.989598 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee8152-e8ec-4ac6-a46a-1a98c844dd58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:52.991307 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee8152-e8ec-4ac6-a46a-1a98c844dd58 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:52.992433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 269/529] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:52.993908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bf4e1-01db-4814-b4eb-699300a5995e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:52.999131 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 261/530] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:41:52 2022] GET /identity/v3/role_assignments?user.id=7e7c4b0bd50c474996a21b69bde4e227&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=fb140b8a852547a5b8f339dce8d3440e => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:53.003305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:53.005538 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee8152-e8ec-4ac6-a46a-1a98c844dd58 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:53.080349 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:53.195687 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bf4e1-01db-4814-b4eb-699300a5995e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:53.210975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee8152-e8ec-4ac6-a46a-1a98c844dd58 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:53.233801 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bfad9-7c99-4b16-a717-5c388f11630e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:53.234508 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bfad9-7c99-4b16-a717-5c388f11630e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:53.235114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bfad9-7c99-4b16-a717-5c388f11630e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:53.235114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bfad9-7c99-4b16-a717-5c388f11630e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:53.250059 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8235996-5ea2-4d8a-a9a7-d793d0a8374c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:53.251451 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8235996-5ea2-4d8a-a9a7-d793d0a8374c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:53.251910 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8235996-5ea2-4d8a-a9a7-d793d0a8374c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:53.252372 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8235996-5ea2-4d8a-a9a7-d793d0a8374c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:53.265105 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8235996-5ea2-4d8a-a9a7-d793d0a8374c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:53.267436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8235996-5ea2-4d8a-a9a7-d793d0a8374c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:53.287937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-a8235996-5ea2-4d8a-a9a7-d793d0a8374c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:53.287937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:53.287937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:53.287937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:53.287937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:53.287937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:53.287937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:53.287937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:53.287937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:53.287937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:53.287937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:53.287937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:53.287937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:53.287937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:53.287937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:53.288872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:53.288872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:53.288872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:53.288872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:53.288872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:53.288872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:53.288872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:53.288872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:53.288872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:53.288872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:53.288872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:53.288872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:53.288872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:53.288872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:53.288872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:53.288872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:53.288872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:53.289708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:53.289708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:53.289708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:53.289708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:53.291891 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 262/531] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:53.297597 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8235996-5ea2-4d8a-a9a7-d793d0a8374c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:53.320113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179bfad9-7c99-4b16-a717-5c388f11630e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:53.321648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179bfad9-7c99-4b16-a717-5c388f11630e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:53.334004 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:53.398054 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:53.431036 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8235996-5ea2-4d8a-a9a7-d793d0a8374c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:53.451707 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 270/532] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:53.457444 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bfad9-7c99-4b16-a717-5c388f11630e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:53.496884 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da070a54-f256-4d68-98ef-6b1ca510ce47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:53.497820 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da070a54-f256-4d68-98ef-6b1ca510ce47 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:53.498278 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da070a54-f256-4d68-98ef-6b1ca510ce47 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:53.498844 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da070a54-f256-4d68-98ef-6b1ca510ce47 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:53.500678 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da070a54-f256-4d68-98ef-6b1ca510ce47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:53.501318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da070a54-f256-4d68-98ef-6b1ca510ce47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:53.503932 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da070a54-f256-4d68-98ef-6b1ca510ce47 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:53.525526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 263/533] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:53.527808 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da070a54-f256-4d68-98ef-6b1ca510ce47 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:53.642812 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bfad9-7c99-4b16-a717-5c388f11630e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:53.656934 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:53.707034 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f59ee0-c2cc-492c-a430-57fe0f58d387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:53.708462 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f59ee0-c2cc-492c-a430-57fe0f58d387 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:53.708765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f59ee0-c2cc-492c-a430-57fe0f58d387 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:53.709040 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f59ee0-c2cc-492c-a430-57fe0f58d387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:53.721409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f59ee0-c2cc-492c-a430-57fe0f58d387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:53.723295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f59ee0-c2cc-492c-a430-57fe0f58d387 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:53.727488 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da070a54-f256-4d68-98ef-6b1ca510ce47 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:53.743609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-f7f59ee0-c2cc-492c-a430-57fe0f58d387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:53.743609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:53.743609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:53.743609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:53.743609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:53.743609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:53.743609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:53.743609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:53.743609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:53.743609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:53.743609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:53.743609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:53.743609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:53.743609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:53.743609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:53.744498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:53.744498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:53.744498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:53.744498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:53.744498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:53.744498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:53.744498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:53.744498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:53.744498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:53.744498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:53.744498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:53.744498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:53.744498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:53.744498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:53.744498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:53.744498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:53.744498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:53.745374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:53.745374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:53.745374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:53.745374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:53.745374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 271/534] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:53.757670 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f59ee0-c2cc-492c-a430-57fe0f58d387 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:53.779637 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74d08d-82c2-4bab-bf0f-c6ecea88b02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:53.781049 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74d08d-82c2-4bab-bf0f-c6ecea88b02e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:53.781487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74d08d-82c2-4bab-bf0f-c6ecea88b02e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:53.782009 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74d08d-82c2-4bab-bf0f-c6ecea88b02e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:53.790232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74d08d-82c2-4bab-bf0f-c6ecea88b02e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:53.791886 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74d08d-82c2-4bab-bf0f-c6ecea88b02e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:53.806717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-4a74d08d-82c2-4bab-bf0f-c6ecea88b02e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:41:53.806717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:53.806717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:53.806717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:53.806717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:53.806717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:53.806717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:53.806717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:53.806717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:53.806717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:53.806717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:53.806717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:53.806717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:41:53.806717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:41:53.806717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:41:53.807610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:41:53.807610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:53.807610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:53.807610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:53.807610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:53.807610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:53.807610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:53.807610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:53.807610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:53.807610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:53.807610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:53.807610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:53.807610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:53.807610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:53.807610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:53.807610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:53.807610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:53.808447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:41:53.808447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:41:53.808447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:41:53.808447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:41:53.808447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:41:53.808447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:41:53.808447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:41:53.808447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:53.810903 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 264/535] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:41:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:41:53.816740 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74d08d-82c2-4bab-bf0f-c6ecea88b02e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:53.820318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:53.896147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f59ee0-c2cc-492c-a430-57fe0f58d387 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:53.940286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24505d66-52f6-493a-8794-32ae12d558b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:53.941193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24505d66-52f6-493a-8794-32ae12d558b7 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:53.941474 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24505d66-52f6-493a-8794-32ae12d558b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:53.941748 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24505d66-52f6-493a-8794-32ae12d558b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:53.943028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24505d66-52f6-493a-8794-32ae12d558b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:53.943331 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24505d66-52f6-493a-8794-32ae12d558b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:53.944750 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24505d66-52f6-493a-8794-32ae12d558b7 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:53.957801 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 272/536] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:53.962891 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24505d66-52f6-493a-8794-32ae12d558b7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:54.000955 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:54.071787 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24505d66-52f6-493a-8794-32ae12d558b7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:54.110511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959c1a5-3ce3-4acb-a240-e90aac6ab31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:54.111442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959c1a5-3ce3-4acb-a240-e90aac6ab31f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:54.111733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959c1a5-3ce3-4acb-a240-e90aac6ab31f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:54.112013 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959c1a5-3ce3-4acb-a240-e90aac6ab31f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:54.118861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959c1a5-3ce3-4acb-a240-e90aac6ab31f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:54.120746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959c1a5-3ce3-4acb-a240-e90aac6ab31f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:54.123507 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74d08d-82c2-4bab-bf0f-c6ecea88b02e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:54.134987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-a959c1a5-3ce3-4acb-a240-e90aac6ab31f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:41:54.134987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:54.134987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:54.134987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:54.134987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:54.134987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:54.134987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:54.134987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:54.134987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:54.134987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:54.134987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:54.134987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:54.134987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:41:54.134987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:41:54.134987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:41:54.135854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:41:54.135854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:54.135854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:54.135854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:54.135854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:54.135854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:54.135854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:54.135854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:54.135854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:54.135854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:54.135854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:54.135854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:54.135854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:54.135854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:54.135854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:54.135854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:54.135854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:54.136718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:41:54.136718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:41:54.136718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:41:54.136718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:41:54.136718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:41:54.136718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:41:54.136718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:41:54.136718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:54.136718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 273/537] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:41:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:54.141999 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959c1a5-3ce3-4acb-a240-e90aac6ab31f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:54.198248 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28940256-0b9d-4da0-b880-e631912ae87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:54.198921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28940256-0b9d-4da0-b880-e631912ae87c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:54.199206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28940256-0b9d-4da0-b880-e631912ae87c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:54.199488 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28940256-0b9d-4da0-b880-e631912ae87c None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:54.200285 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28940256-0b9d-4da0-b880-e631912ae87c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:54.200616 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28940256-0b9d-4da0-b880-e631912ae87c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:54.202061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28940256-0b9d-4da0-b880-e631912ae87c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:54.215526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 265/538] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:41:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:54.221154 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28940256-0b9d-4da0-b880-e631912ae87c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:54.245349 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:54.249355 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959c1a5-3ce3-4acb-a240-e90aac6ab31f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:54.304540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb2c8c-47c5-45b1-b5e2-a7673b8b9f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:54.305245 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb2c8c-47c5-45b1-b5e2-a7673b8b9f9e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:54.305526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb2c8c-47c5-45b1-b5e2-a7673b8b9f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:54.305803 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb2c8c-47c5-45b1-b5e2-a7673b8b9f9e None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:54.306795 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb2c8c-47c5-45b1-b5e2-a7673b8b9f9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:54.307134 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb2c8c-47c5-45b1-b5e2-a7673b8b9f9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:54.308577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb2c8c-47c5-45b1-b5e2-a7673b8b9f9e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:54.321906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 274/539] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:41:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:54.327980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb2c8c-47c5-45b1-b5e2-a7673b8b9f9e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:54.358310 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:54.444183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb2c8c-47c5-45b1-b5e2-a7673b8b9f9e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:54.448467 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28940256-0b9d-4da0-b880-e631912ae87c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:54.491996 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2d32a-ebfd-4922-8552-809b02b1cba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:54.492576 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2d32a-ebfd-4922-8552-809b02b1cba4 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:54.492887 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2d32a-ebfd-4922-8552-809b02b1cba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:54.493189 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2d32a-ebfd-4922-8552-809b02b1cba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:54.494004 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2d32a-ebfd-4922-8552-809b02b1cba4 None admin] RBAC: Adding query filter params (role.id=fb140b8a852547a5b8f339dce8d3440e, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=4bb924cdb5aa48ba9dfcc7be7e912991) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:54.494319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2d32a-ebfd-4922-8552-809b02b1cba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:54.495757 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2d32a-ebfd-4922-8552-809b02b1cba4 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:54.496618 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099542c-be21-41c1-b909-aab6fca055b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:54.497612 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099542c-be21-41c1-b909-aab6fca055b5 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:54.498088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099542c-be21-41c1-b909-aab6fca055b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:54.498657 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099542c-be21-41c1-b909-aab6fca055b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:54.499684 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099542c-be21-41c1-b909-aab6fca055b5 None admin] RBAC: Adding query filter params (role.id=fb140b8a852547a5b8f339dce8d3440e, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=07ab8f60c4ff4969a277b33dca05e685) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:54.500200 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099542c-be21-41c1-b909-aab6fca055b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:54.501846 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099542c-be21-41c1-b909-aab6fca055b5 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:54.501961 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 266/540] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:41:54 2022] GET /identity/v3/role_assignments?user.id=4bb924cdb5aa48ba9dfcc7be7e912991&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=fb140b8a852547a5b8f339dce8d3440e => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:54.509823 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3932d7-10d5-4a60-9f22-76ec22748c8b None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:54.510630 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3932d7-10d5-4a60-9f22-76ec22748c8b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:54.510630 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3932d7-10d5-4a60-9f22-76ec22748c8b None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:54.516340 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 267/541] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:41:54.518150 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc27e4-65e3-4a07-b41f-5f98c15694ae None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:54.518512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc27e4-65e3-4a07-b41f-5f98c15694ae None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:54.518866 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc27e4-65e3-4a07-b41f-5f98c15694ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:54.520817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 275/542] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:41:54 2022] GET /identity/v3/role_assignments?user.id=07ab8f60c4ff4969a277b33dca05e685&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=fb140b8a852547a5b8f339dce8d3440e => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:54.538271 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-7bdc27e4-65e3-4a07-b41f-5f98c15694ae None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:54.539653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7bdc27e4-65e3-4a07-b41f-5f98c15694ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:54.618803 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 268/543] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:54.654658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099542c-be21-41c1-b909-aab6fca055b5 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:54.658452 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:54.791902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099542c-be21-41c1-b909-aab6fca055b5 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:54.813534 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bdfcf-362a-4c55-b95f-45acc7955e68 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:54.814042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bdfcf-362a-4c55-b95f-45acc7955e68 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:54.814116 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bdfcf-362a-4c55-b95f-45acc7955e68 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:54.816551 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 269/544] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:54.821497 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba98bc-b1dc-45cf-afd2-280febe7c217 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:54.821790 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba98bc-b1dc-45cf-afd2-280febe7c217 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:54.822072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba98bc-b1dc-45cf-afd2-280febe7c217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:54.835280 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac83aa8-c971-44d9-a9d7-66a2a4fd22ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:54.836421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac83aa8-c971-44d9-a9d7-66a2a4fd22ea None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:54.836959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac83aa8-c971-44d9-a9d7-66a2a4fd22ea None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:54.837437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac83aa8-c971-44d9-a9d7-66a2a4fd22ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:54.845659 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-7fba98bc-b1dc-45cf-afd2-280febe7c217 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:54.846878 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7fba98bc-b1dc-45cf-afd2-280febe7c217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:54.849407 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac83aa8-c971-44d9-a9d7-66a2a4fd22ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:54.857862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-bac83aa8-c971-44d9-a9d7-66a2a4fd22ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:41:54.857862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:54.857862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:54.857862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:54.857862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:54.857862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:54.857862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:54.857862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:54.857862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:54.857862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:54.857862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:54.857862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:54.857862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:54.857862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:54.857862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:54.857862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:54.858755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:54.858755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:54.858755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:54.858755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:54.858755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:54.858755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:54.858755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:54.858755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:54.858755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:54.858755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:54.858755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:54.858755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:54.858755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:54.858755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:54.858755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:54.858755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:54.859550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:54.859550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:54.859550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:54.859550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:54.859550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:54.859550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:54.859550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:54.859550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:54.859550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:54.859550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:54.859550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:41:54.859550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:54.862186 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 276/545] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:41:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:54.884511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac83aa8-c971-44d9-a9d7-66a2a4fd22ea None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:54.952838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:54.954053 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:54.995215 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac83aa8-c971-44d9-a9d7-66a2a4fd22ea None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:54.999062 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 270/546] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:55.055924 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b56fdd-1cbc-430d-bd33-cd6145f15346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:55.056987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b56fdd-1cbc-430d-bd33-cd6145f15346 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:55.057170 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba98bc-b1dc-45cf-afd2-280febe7c217 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:55.057691 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b56fdd-1cbc-430d-bd33-cd6145f15346 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:55.058171 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b56fdd-1cbc-430d-bd33-cd6145f15346 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:55.059147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b56fdd-1cbc-430d-bd33-cd6145f15346 None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:55.059607 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b56fdd-1cbc-430d-bd33-cd6145f15346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:55.061219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b56fdd-1cbc-430d-bd33-cd6145f15346 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:55.076636 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 277/547] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jul 5 12:41:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:41:55.081933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b56fdd-1cbc-430d-bd33-cd6145f15346 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:55.258540 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba98bc-b1dc-45cf-afd2-280febe7c217 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:55.259744 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b56fdd-1cbc-430d-bd33-cd6145f15346 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:55.288423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:55.309246 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ea20f-7c3b-4784-906f-61703d36f3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:55.309246 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ea20f-7c3b-4784-906f-61703d36f3ac None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:55.309246 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ea20f-7c3b-4784-906f-61703d36f3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:55.309246 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ea20f-7c3b-4784-906f-61703d36f3ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:55.330893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ea20f-7c3b-4784-906f-61703d36f3ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:55.332388 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ea20f-7c3b-4784-906f-61703d36f3ac None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:55.337983 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63192a4-a233-47a7-ac64-64ef696f670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:55.338793 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63192a4-a233-47a7-ac64-64ef696f670a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:55.339077 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63192a4-a233-47a7-ac64-64ef696f670a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:55.339354 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63192a4-a233-47a7-ac64-64ef696f670a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:55.362257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-432ea20f-7c3b-4784-906f-61703d36f3ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:55.362257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:55.362257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:55.362257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:55.362257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:55.362257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:55.362257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:55.362257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:55.362257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:55.362257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:55.362257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:55.362257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:55.362257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:55.362257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:55.362257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:55.363156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:55.363156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:55.363156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:55.363156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:55.363156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:55.363156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:55.363156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:55.363156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:55.363156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:55.363156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:55.363156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:55.363156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:55.363156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:55.363156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:55.363156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:55.363156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:55.363156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:55.364572 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:55.364572 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:55.364572 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:55.364572 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:55.364572 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 278/548] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:55.369597 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63192a4-a233-47a7-ac64-64ef696f670a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:55.377506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-b63192a4-a233-47a7-ac64-64ef696f670a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:41:55.377506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:55.377506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:55.377506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:55.377506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:55.377506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:55.377506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:55.377506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:55.377506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:55.377506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:55.377506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:55.377506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:55.377506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:55.377506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:55.377506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:55.377506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:55.380007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:55.380007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:55.380007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:55.380007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:55.380007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:55.380007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:55.380007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:55.380007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:55.380007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:55.380007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:55.380007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:55.380007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:55.380007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:55.380007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:55.380007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:55.380007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:55.382202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:55.382202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:55.382202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:55.382202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:55.382202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:55.382202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:55.382202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:55.382202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:55.382202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:55.382202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:55.382202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:41:55.382202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:55.383897 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ea20f-7c3b-4784-906f-61703d36f3ac None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:55.384109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 271/549] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:41:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:55.389151 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63192a4-a233-47a7-ac64-64ef696f670a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:55.470214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:55.524775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ea20f-7c3b-4784-906f-61703d36f3ac None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:55.526108 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63192a4-a233-47a7-ac64-64ef696f670a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:55.560961 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcea6ed-c7a1-4a21-b407-c5bc9e34344e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:55.561303 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b37c79-6fa1-470c-bad1-8ad210121be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:55.561582 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcea6ed-c7a1-4a21-b407-c5bc9e34344e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:55.561804 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b37c79-6fa1-470c-bad1-8ad210121be3 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:55.561968 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcea6ed-c7a1-4a21-b407-c5bc9e34344e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:55.562131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b37c79-6fa1-470c-bad1-8ad210121be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:55.562277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcea6ed-c7a1-4a21-b407-c5bc9e34344e None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:55.562420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b37c79-6fa1-470c-bad1-8ad210121be3 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:55.562886 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcea6ed-c7a1-4a21-b407-c5bc9e34344e None admin] RBAC: Adding query filter params (name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:55.563049 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b37c79-6fa1-470c-bad1-8ad210121be3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:55.563206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcea6ed-c7a1-4a21-b407-c5bc9e34344e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:55.563361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b37c79-6fa1-470c-bad1-8ad210121be3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:55.564572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcea6ed-c7a1-4a21-b407-c5bc9e34344e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:55.564770 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b37c79-6fa1-470c-bad1-8ad210121be3 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:55.573345 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 272/550] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jul 5 12:41:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:55.574678 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e0b0f-6adc-40c9-aa4b-d70fb16ef7cf None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:55.574954 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e0b0f-6adc-40c9-aa4b-d70fb16ef7cf None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:55.575242 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e0b0f-6adc-40c9-aa4b-d70fb16ef7cf None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:55.576755 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 273/551] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:55.578193 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e0b0f-6adc-40c9-aa4b-d70fb16ef7cf None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:55.586184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 279/552] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:55.591506 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b37c79-6fa1-470c-bad1-8ad210121be3 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:55.628849 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:55.685064 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e0b0f-6adc-40c9-aa4b-d70fb16ef7cf None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:55.694165 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:55.697900 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b37c79-6fa1-470c-bad1-8ad210121be3 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:55.720541 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bacfa9-bf8f-4388-b88d-101a64145689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:55.721618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bacfa9-bf8f-4388-b88d-101a64145689 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:55.722269 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bacfa9-bf8f-4388-b88d-101a64145689 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:55.722931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bacfa9-bf8f-4388-b88d-101a64145689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:55.734422 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0d892-2f50-49f0-96f6-1d60bce37b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:55.738145 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0d892-2f50-49f0-96f6-1d60bce37b87 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:55.738145 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0d892-2f50-49f0-96f6-1d60bce37b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:55.738145 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0d892-2f50-49f0-96f6-1d60bce37b87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:55.738591 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bacfa9-bf8f-4388-b88d-101a64145689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:55.739522 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bacfa9-bf8f-4388-b88d-101a64145689 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:55.743468 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0d892-2f50-49f0-96f6-1d60bce37b87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:55.744948 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0d892-2f50-49f0-96f6-1d60bce37b87 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:55.758838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-26bacfa9-bf8f-4388-b88d-101a64145689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:55.758838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:55.758838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:55.758838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:55.758838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:55.758838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:55.758838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:55.758838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:55.758838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:55.758838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:55.758838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:55.758838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:55.758838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:55.758838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:55.758838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:55.760875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:55.760875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:55.760875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:55.760875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:55.760875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:55.760875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:55.760875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:55.760875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:55.760875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:55.760875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:55.760875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:55.760875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:55.760875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:55.760875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:55.760875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:55.760875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:55.760875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:55.763027 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:55.763027 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:55.763027 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:55.763027 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:55.763027 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 274/553] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:55.763027 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4034693-fd5d-42d4-b672-6340aa75a2ea None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:55.763027 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4034693-fd5d-42d4-b672-6340aa75a2ea None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:55.763027 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4034693-fd5d-42d4-b672-6340aa75a2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:55.768631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-c9f0d892-2f50-49f0-96f6-1d60bce37b87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:41:55.768631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:55.768631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:55.768631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:55.768631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:55.768631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:55.768631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:55.768631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:55.768631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:55.768631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:55.768631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:55.768631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:55.768631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:41:55.768631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:41:55.768631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:41:55.768631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:41:55.769666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:55.769666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:55.769666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:41:55.769666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:41:55.769666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:41:55.769666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:41:55.769666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:55.769666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:55.769666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:55.769666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:55.769666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:55.769666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:55.769666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:55.769666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:55.769666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:55.769666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:55.769666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:55.769666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:55.771548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:55.771548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:55.771548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:41:55.771548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:41:55.771548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:41:55.771548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:41:55.771548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:41:55.771548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:41:55.771548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:41:55.771548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:55.771548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 280/554] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jul 5 12:41:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:41:55.771548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0d892-2f50-49f0-96f6-1d60bce37b87 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:55.792616 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-a4034693-fd5d-42d4-b672-6340aa75a2ea None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:55.794597 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a4034693-fd5d-42d4-b672-6340aa75a2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:55.888703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0d892-2f50-49f0-96f6-1d60bce37b87 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:55.888891 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 275/555] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:55.889307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:55.889733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4034693-fd5d-42d4-b672-6340aa75a2ea None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:55.944474 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110399ee-9bc4-45d9-b0bb-ea984a1457c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:55.945185 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110399ee-9bc4-45d9-b0bb-ea984a1457c2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:55.945470 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110399ee-9bc4-45d9-b0bb-ea984a1457c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:55.945745 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110399ee-9bc4-45d9-b0bb-ea984a1457c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:55.946474 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110399ee-9bc4-45d9-b0bb-ea984a1457c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:55.946779 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110399ee-9bc4-45d9-b0bb-ea984a1457c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:55.948178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110399ee-9bc4-45d9-b0bb-ea984a1457c2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:55.961185 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 281/556] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:55.962007 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110399ee-9bc4-45d9-b0bb-ea984a1457c2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:56.019242 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:56.030577 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4034693-fd5d-42d4-b672-6340aa75a2ea None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:56.068961 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63041938-0b33-4cb9-a77b-bf0287ee6f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:56.070124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63041938-0b33-4cb9-a77b-bf0287ee6f9a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:56.070616 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63041938-0b33-4cb9-a77b-bf0287ee6f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:56.071100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63041938-0b33-4cb9-a77b-bf0287ee6f9a None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:56.072279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63041938-0b33-4cb9-a77b-bf0287ee6f9a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:56.072867 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63041938-0b33-4cb9-a77b-bf0287ee6f9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:56.074622 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63041938-0b33-4cb9-a77b-bf0287ee6f9a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:56.075857 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110399ee-9bc4-45d9-b0bb-ea984a1457c2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:56.094595 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 276/557] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jul 5 12:41:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:56.095840 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63041938-0b33-4cb9-a77b-bf0287ee6f9a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:56.115333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6cdfc-a7db-4b83-a7e9-54bd79ecb8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:56.116040 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6cdfc-a7db-4b83-a7e9-54bd79ecb8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:56.116321 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6cdfc-a7db-4b83-a7e9-54bd79ecb8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:56.116618 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6cdfc-a7db-4b83-a7e9-54bd79ecb8a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:56.126881 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6cdfc-a7db-4b83-a7e9-54bd79ecb8a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:56.135045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-52c6cdfc-a7db-4b83-a7e9-54bd79ecb8a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:41:56.135045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:56.135045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:56.135045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:56.135045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:56.135045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:56.135045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:56.135045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:56.135045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:56.135045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:56.135045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:56.135045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:56.135045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:56.135045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:56.135045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:56.135045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:56.137672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:56.137672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:56.137672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:56.137672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:56.137672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:56.137672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:56.137672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:56.137672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:56.137672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:56.137672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:56.137672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:56.137672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:56.137672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:56.137672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:56.137672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:56.137672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:56.138527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:56.138527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:56.138527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:56.138527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:56.138527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:56.138527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:56.138527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:56.138527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:56.138527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:56.138527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:56.138527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:41:56.138527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:56.138527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 282/558] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:41:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:56.138527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6cdfc-a7db-4b83-a7e9-54bd79ecb8a7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:56.156261 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:56.213747 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63041938-0b33-4cb9-a77b-bf0287ee6f9a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:56.238186 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6cdfc-a7db-4b83-a7e9-54bd79ecb8a7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:56.253434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea9959-8064-4e4d-a577-23deab7d745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:56.254596 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea9959-8064-4e4d-a577-23deab7d745d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:56.255096 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea9959-8064-4e4d-a577-23deab7d745d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:56.255666 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea9959-8064-4e4d-a577-23deab7d745d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:56.263887 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea9959-8064-4e4d-a577-23deab7d745d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:56.265899 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea9959-8064-4e4d-a577-23deab7d745d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:56.273522 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3497c35-6eef-4c5f-b48c-3a2a64ebda95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:56.274312 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3497c35-6eef-4c5f-b48c-3a2a64ebda95 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:56.274598 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3497c35-6eef-4c5f-b48c-3a2a64ebda95 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:56.274871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3497c35-6eef-4c5f-b48c-3a2a64ebda95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:56.283434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-08ea9959-8064-4e4d-a577-23deab7d745d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:41:56.283434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:56.283434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:56.283434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:56.283434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:56.283434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:56.283434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:56.283434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:56.283434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:56.283434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:56.283434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:56.283434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:56.283434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:41:56.283434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:41:56.283434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:41:56.283434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:41:56.284465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:56.284465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:56.284465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:41:56.284465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:41:56.284465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:41:56.284465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:41:56.284465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:56.284465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:56.284465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:56.284465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:56.284465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:56.284465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:56.284465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:56.284465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:56.284465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:56.284465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:56.284465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:56.284465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:56.285474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:56.285474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:56.285474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:41:56.285474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:41:56.285474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:41:56.285474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:41:56.285474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:41:56.285474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:41:56.285474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:41:56.285474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:56.286599 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3497c35-6eef-4c5f-b48c-3a2a64ebda95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:56.287471 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3497c35-6eef-4c5f-b48c-3a2a64ebda95 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:56.289170 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 277/559] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:41:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:56.290245 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea9959-8064-4e4d-a577-23deab7d745d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:56.302294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:56.309992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-d3497c35-6eef-4c5f-b48c-3a2a64ebda95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:56.309992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:56.309992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:56.309992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:56.309992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:56.309992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:56.309992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:56.309992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:56.309992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:56.309992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:56.309992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:56.309992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:56.309992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:56.309992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:56.309992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:56.316319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:56.316319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:56.316319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:56.316319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:56.316319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:56.316319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:56.316319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:56.316319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:56.316319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:56.316319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:56.316319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:56.316319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:56.316319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:56.316319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:56.316319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:56.316319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:56.316319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:56.317279 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:56.317279 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:56.317279 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:56.317279 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:56.317279 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 283/560] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:56.317279 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3497c35-6eef-4c5f-b48c-3a2a64ebda95 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:56.384787 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:56.405398 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea9959-8064-4e4d-a577-23deab7d745d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:56.418406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3497c35-6eef-4c5f-b48c-3a2a64ebda95 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:56.445770 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f8a03-a22a-4aa0-9a9e-9c3654e0173e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:56.447389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f8a03-a22a-4aa0-9a9e-9c3654e0173e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:56.448051 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f8a03-a22a-4aa0-9a9e-9c3654e0173e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:56.448507 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f8a03-a22a-4aa0-9a9e-9c3654e0173e None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:56.449618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f8a03-a22a-4aa0-9a9e-9c3654e0173e None admin] RBAC: Adding query filter params (name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:56.450120 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f8a03-a22a-4aa0-9a9e-9c3654e0173e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:56.452052 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f8a03-a22a-4aa0-9a9e-9c3654e0173e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:56.454985 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6393bbc-a892-4f69-80cb-b4432449604a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:56.456013 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6393bbc-a892-4f69-80cb-b4432449604a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:56.456309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6393bbc-a892-4f69-80cb-b4432449604a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:56.456613 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6393bbc-a892-4f69-80cb-b4432449604a None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:56.457481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6393bbc-a892-4f69-80cb-b4432449604a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:56.457788 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6393bbc-a892-4f69-80cb-b4432449604a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:56.459223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6393bbc-a892-4f69-80cb-b4432449604a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:56.466434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 278/561] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jul 5 12:41:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:56.467764 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f8a03-a22a-4aa0-9a9e-9c3654e0173e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:56.484659 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 284/562] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jul 5 12:41:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:56.486612 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6393bbc-a892-4f69-80cb-b4432449604a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:56.549864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:56.584963 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f8a03-a22a-4aa0-9a9e-9c3654e0173e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:56.622156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6393bbc-a892-4f69-80cb-b4432449604a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:56.626027 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84554c-f9fc-46c4-ae73-48f88d4d3d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:56.626694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84554c-f9fc-46c4-ae73-48f88d4d3d17 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:56.626980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84554c-f9fc-46c4-ae73-48f88d4d3d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:56.627312 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84554c-f9fc-46c4-ae73-48f88d4d3d17 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:56.628046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84554c-f9fc-46c4-ae73-48f88d4d3d17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:56.628355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84554c-f9fc-46c4-ae73-48f88d4d3d17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:56.629805 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84554c-f9fc-46c4-ae73-48f88d4d3d17 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:56.647264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 279/563] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:56.647264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84554c-f9fc-46c4-ae73-48f88d4d3d17 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:56.662248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:56.671998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c7f5f-0c19-4f6d-bb7e-a845f651554e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:56.673104 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c7f5f-0c19-4f6d-bb7e-a845f651554e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:56.673604 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c7f5f-0c19-4f6d-bb7e-a845f651554e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:56.674137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c7f5f-0c19-4f6d-bb7e-a845f651554e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:56.685556 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c7f5f-0c19-4f6d-bb7e-a845f651554e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:56.687436 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c7f5f-0c19-4f6d-bb7e-a845f651554e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:56.707179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-5d0c7f5f-0c19-4f6d-bb7e-a845f651554e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:56.707179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:56.707179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:56.707179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:56.707179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:56.707179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:56.707179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:56.707179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:56.707179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:56.707179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:56.707179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:56.707179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:56.707179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:56.707179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:56.707179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:56.709155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:56.709155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:56.709155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:56.709155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:56.709155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:56.709155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:56.709155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:56.709155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:56.709155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:56.709155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:56.709155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:56.709155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:56.709155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:56.709155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:56.709155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:56.709155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:56.709155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:56.710015 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:56.710015 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:56.710015 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:56.710015 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:56.712170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 285/564] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:56.713230 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c7f5f-0c19-4f6d-bb7e-a845f651554e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:56.760322 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84554c-f9fc-46c4-ae73-48f88d4d3d17 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:56.836748 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:56.842887 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91159223-6dc4-4994-998d-c9371acceabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:56.843541 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91159223-6dc4-4994-998d-c9371acceabc None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:56.843921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91159223-6dc4-4994-998d-c9371acceabc None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:56.844194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91159223-6dc4-4994-998d-c9371acceabc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:56.875457 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c7f5f-0c19-4f6d-bb7e-a845f651554e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:56.911873 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819aaaaf-59a5-4cf3-80b8-cc926bc2a438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:56.912695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aaaaf-59a5-4cf3-80b8-cc926bc2a438 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:56.912981 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aaaaf-59a5-4cf3-80b8-cc926bc2a438 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:56.913257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aaaaf-59a5-4cf3-80b8-cc926bc2a438 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:56.916733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91159223-6dc4-4994-998d-c9371acceabc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:56.918302 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91159223-6dc4-4994-998d-c9371acceabc None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:56.919827 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819aaaaf-59a5-4cf3-80b8-cc926bc2a438 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:56.921305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819aaaaf-59a5-4cf3-80b8-cc926bc2a438 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:56.935807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-819aaaaf-59a5-4cf3-80b8-cc926bc2a438 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:41:56.935807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:56.935807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:56.935807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:56.935807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:56.935807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:56.935807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:56.935807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:56.935807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:56.935807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:56.935807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:56.935807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:56.935807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:41:56.935807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:41:56.935807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:41:56.936880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:41:56.936880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:56.936880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:56.936880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:56.936880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:56.936880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:56.936880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:56.936880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:56.936880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:56.936880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:56.936880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:56.936880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:56.936880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:56.936880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:56.936880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:56.936880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:56.936880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:56.942985 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:41:56.942985 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:41:56.942985 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:41:56.942985 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:41:56.942985 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:41:56.942985 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:41:56.942985 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:41:56.942985 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:56.942985 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 286/565] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:41:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:56.942985 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819aaaaf-59a5-4cf3-80b8-cc926bc2a438 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:56.976690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:57.017769 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 280/566] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:41:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:41:57.019299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb61f88-304e-4da0-b140-fb76f3ce0bb6 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:57.019594 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb61f88-304e-4da0-b140-fb76f3ce0bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:57.019875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb61f88-304e-4da0-b140-fb76f3ce0bb6 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:57.021187 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 281/567] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:57.022392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1180a-8ee6-4e49-97d7-09ebde3b63d5 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:57.022681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1180a-8ee6-4e49-97d7-09ebde3b63d5 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:57.022961 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1180a-8ee6-4e49-97d7-09ebde3b63d5 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:57.024166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 282/568] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:57.025223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1180a-8ee6-4e49-97d7-09ebde3b63d5 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:57.042342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819aaaaf-59a5-4cf3-80b8-cc926bc2a438 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:57.055069 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:57.077549 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15579253-2766-4348-9afd-fb67d27c8eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:57.078225 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15579253-2766-4348-9afd-fb67d27c8eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:57.078516 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15579253-2766-4348-9afd-fb67d27c8eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:57.078796 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15579253-2766-4348-9afd-fb67d27c8eb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:57.079522 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15579253-2766-4348-9afd-fb67d27c8eb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:57.079830 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15579253-2766-4348-9afd-fb67d27c8eb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:57.081257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15579253-2766-4348-9afd-fb67d27c8eb2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:57.093012 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 287/569] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:57.093866 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15579253-2766-4348-9afd-fb67d27c8eb2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:57.138080 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1180a-8ee6-4e49-97d7-09ebde3b63d5 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:57.180998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6af2f0-b6e4-4c19-a0c9-366ebabb5de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:57.181670 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6af2f0-b6e4-4c19-a0c9-366ebabb5de5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:57.181953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6af2f0-b6e4-4c19-a0c9-366ebabb5de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:57.182230 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6af2f0-b6e4-4c19-a0c9-366ebabb5de5 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:57.183016 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6af2f0-b6e4-4c19-a0c9-366ebabb5de5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:57.183329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6af2f0-b6e4-4c19-a0c9-366ebabb5de5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:57.184797 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6af2f0-b6e4-4c19-a0c9-366ebabb5de5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:57.194477 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:57.197174 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 283/570] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:41:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:57.198375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15579253-2766-4348-9afd-fb67d27c8eb2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:57.198498 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3024d0b-3f40-4d08-b9f6-cf4f89e576fe None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:57.198686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3024d0b-3f40-4d08-b9f6-cf4f89e576fe None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:57.198970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3024d0b-3f40-4d08-b9f6-cf4f89e576fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:57.216295 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e3024d0b-3f40-4d08-b9f6-cf4f89e576fe None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:57.221382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e3024d0b-3f40-4d08-b9f6-cf4f89e576fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:57.231602 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94ae46-a2dc-4847-9441-1237996f8af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:57.232391 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94ae46-a2dc-4847-9441-1237996f8af7 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:57.232713 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94ae46-a2dc-4847-9441-1237996f8af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:57.232993 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94ae46-a2dc-4847-9441-1237996f8af7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:57.243269 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94ae46-a2dc-4847-9441-1237996f8af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:57.244752 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94ae46-a2dc-4847-9441-1237996f8af7 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:57.262945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-9f94ae46-a2dc-4847-9441-1237996f8af7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:57.262945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:57.262945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:57.262945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:57.262945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:57.262945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:57.262945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:57.262945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:57.262945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:57.262945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:57.262945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:57.262945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:57.262945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:57.262945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:57.262945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:57.263863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:57.263863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:57.263863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:57.263863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:57.263863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:57.263863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:57.263863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:57.263863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:57.263863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:57.263863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:57.263863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:57.263863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:57.263863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:57.263863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:57.263863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:57.263863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:57.263863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:57.264794 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:57.264794 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:57.264794 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:57.264794 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:57.264794 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 288/571] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:57.265482 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dd698-1165-4273-95f0-a42709dc7ce5 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:57.265768 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dd698-1165-4273-95f0-a42709dc7ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:57.266045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dd698-1165-4273-95f0-a42709dc7ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:57.282669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-702dd698-1165-4273-95f0-a42709dc7ce5 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:41:57.283860 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-702dd698-1165-4273-95f0-a42709dc7ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:41:57.286658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 284/572] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:57.287496 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3024d0b-3f40-4d08-b9f6-cf4f89e576fe None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:57.308465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:57.364299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 289/573] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:41:57.365150 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dd698-1165-4273-95f0-a42709dc7ce5 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:57.391737 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3024d0b-3f40-4d08-b9f6-cf4f89e576fe None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:57.425546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a6192-7861-410f-a22e-0826f801177c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:57.426367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a6192-7861-410f-a22e-0826f801177c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:57.426646 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a6192-7861-410f-a22e-0826f801177c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:57.426915 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a6192-7861-410f-a22e-0826f801177c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:57.434100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a6192-7861-410f-a22e-0826f801177c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:57.435526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a6192-7861-410f-a22e-0826f801177c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:57.443437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:57.450207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-f58a6192-7861-410f-a22e-0826f801177c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 12:41:57.450207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:57.450207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:57.450207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:57.450207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:57.450207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:57.450207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:57.450207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:57.450207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:57.450207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:57.450207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:57.450207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:57.450207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:41:57.450207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:41:57.450207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:41:57.450207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:41:57.451418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:57.451418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:57.451418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:41:57.451418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:41:57.451418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:41:57.451418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:41:57.451418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:57.451418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:57.451418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:57.451418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:57.451418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:57.451418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:57.451418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:57.451418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:57.451418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:57.451418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:57.451418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:57.451418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:57.460045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:57.460045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:57.460045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:41:57.460045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:41:57.460045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:41:57.460045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:41:57.460045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:41:57.460045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:41:57.460045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 12:41:57.460045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:57.460045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 285/574] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:57.460045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a6192-7861-410f-a22e-0826f801177c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:57.468675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dd698-1165-4273-95f0-a42709dc7ce5 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:57.502304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa335129-6b77-4604-8f10-d6c6b434e7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:57.503195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa335129-6b77-4604-8f10-d6c6b434e7a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:57.503479 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa335129-6b77-4604-8f10-d6c6b434e7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:57.503755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa335129-6b77-4604-8f10-d6c6b434e7a4 None admin] PATH_INFO: `/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/cdf37a42279a466b85906b23751f9c22/roles/fb140b8a852547a5b8f339dce8d3440e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:57.518758 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa335129-6b77-4604-8f10-d6c6b434e7a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4190347294b48c096d7aa9d3a479d12, user_id=cdf37a42279a466b85906b23751f9c22, role_id=fb140b8a852547a5b8f339dce8d3440e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:57.520265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa335129-6b77-4604-8f10-d6c6b434e7a4 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:57.532000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:57.550657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a6192-7861-410f-a22e-0826f801177c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:57.582956 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7188002-cfc2-425c-93dc-fe1c77205ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:57.583611 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7188002-cfc2-425c-93dc-fe1c77205ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:57.583907 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7188002-cfc2-425c-93dc-fe1c77205ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:57.584178 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7188002-cfc2-425c-93dc-fe1c77205ff4 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:57.584934 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7188002-cfc2-425c-93dc-fe1c77205ff4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:57.585241 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7188002-cfc2-425c-93dc-fe1c77205ff4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:57.586596 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7188002-cfc2-425c-93dc-fe1c77205ff4 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:57.590245 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 290/575] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:41:57 2022] PUT /identity/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/cdf37a42279a466b85906b23751f9c22/roles/fb140b8a852547a5b8f339dce8d3440e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:41:57.590852 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa335129-6b77-4604-8f10-d6c6b434e7a4 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:57.599299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 286/576] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:57.600446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7188002-cfc2-425c-93dc-fe1c77205ff4 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:57.712882 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7188002-cfc2-425c-93dc-fe1c77205ff4 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:57.730662 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa335129-6b77-4604-8f10-d6c6b434e7a4 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:57.758627 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ef64b-118a-4521-9b8c-43cdc99e5146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:57.759432 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ef64b-118a-4521-9b8c-43cdc99e5146 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:57.759720 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ef64b-118a-4521-9b8c-43cdc99e5146 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:57.759997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ef64b-118a-4521-9b8c-43cdc99e5146 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:57.766086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:57.770553 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:57.771638 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ef64b-118a-4521-9b8c-43cdc99e5146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:57.772344 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d332e4-a293-4944-96a8-859f8b8215f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:57.773229 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d332e4-a293-4944-96a8-859f8b8215f0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:57.773514 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d332e4-a293-4944-96a8-859f8b8215f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:57.773787 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d332e4-a293-4944-96a8-859f8b8215f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:57.779980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-de2ef64b-118a-4521-9b8c-43cdc99e5146 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:41:57.779980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:57.779980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:57.779980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:57.779980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:57.779980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:57.779980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:57.779980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:57.779980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:57.779980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:57.779980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:57.779980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:57.779980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:57.779980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:57.779980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:57.779980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:57.781039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:57.781039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:57.781039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:57.781039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:57.781039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:57.781039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:57.781039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:57.781039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:57.781039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:57.781039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:57.781039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:57.781039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:57.781039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:57.781039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:57.781039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:57.781039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:57.781892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:57.781892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:57.781892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:57.781892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:57.781892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:57.781892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:57.781892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:57.781892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:57.781892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:57.781892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:57.781892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:41:57.781892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:57.781892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 287/577] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:41:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:57.782579 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ef64b-118a-4521-9b8c-43cdc99e5146 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:57.788072 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d332e4-a293-4944-96a8-859f8b8215f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:41:57.792921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-22d332e4-a293-4944-96a8-859f8b8215f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:41:57.792921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:57.792921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:57.792921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:57.792921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:57.792921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:57.792921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:57.792921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:57.792921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:57.792921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:57.792921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:57.792921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:57.792921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:41:57.792921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:41:57.792921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:41:57.792921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:41:57.793908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:41:57.793908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:41:57.793908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:41:57.793908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:41:57.793908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:57.793908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:57.793908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:57.793908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:57.793908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:57.793908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:57.793908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:57.793908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:57.793908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:57.793908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:57.793908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:57.793908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:57.794755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:57.794755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:57.794755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:57.794755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:57.794755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:41:57.794755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:41:57.794755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:41:57.794755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:41:57.794755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:41:57.794755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:41:57.794755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:41:57.794755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:57.794755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 291/578] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:41:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:57.795430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d332e4-a293-4944-96a8-859f8b8215f0 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:57.895889 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ef64b-118a-4521-9b8c-43cdc99e5146 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:57.898801 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d332e4-a293-4944-96a8-859f8b8215f0 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:57.930362 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567e926-8d0f-4b56-b1bd-270d95317e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:57.931084 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567e926-8d0f-4b56-b1bd-270d95317e56 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:57.931323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567e926-8d0f-4b56-b1bd-270d95317e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:57.931600 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567e926-8d0f-4b56-b1bd-270d95317e56 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:57.932441 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567e926-8d0f-4b56-b1bd-270d95317e56 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:57.932782 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567e926-8d0f-4b56-b1bd-270d95317e56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:57.933628 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d6403-9877-4db6-b7ae-a896902db809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:57.934233 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567e926-8d0f-4b56-b1bd-270d95317e56 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:57.934431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d6403-9877-4db6-b7ae-a896902db809 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:57.934717 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d6403-9877-4db6-b7ae-a896902db809 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:57.934993 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d6403-9877-4db6-b7ae-a896902db809 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:57.942730 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d6403-9877-4db6-b7ae-a896902db809 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:57.944190 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d6403-9877-4db6-b7ae-a896902db809 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:57.952122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 288/579] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jul 5 12:41:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:57.953212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567e926-8d0f-4b56-b1bd-270d95317e56 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:57.959183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-629d6403-9877-4db6-b7ae-a896902db809 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:41:57.959183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:57.959183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:57.959183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:57.959183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:57.959183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:57.959183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:57.959183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:57.959183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:57.959183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:57.959183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:57.959183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:57.959183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:41:57.959183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:41:57.959183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:41:57.960055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:41:57.960055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:57.960055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:57.960055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:57.960055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:57.960055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:57.960055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:57.960055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:57.960055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:57.960055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:57.960055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:57.960055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:57.960055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:57.960055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:57.960055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:57.960055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:57.960055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:57.960959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:41:57.960959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:41:57.960959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:41:57.960959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:41:57.960959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:41:57.960959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:41:57.960959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:41:57.960959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:57.960959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 292/580] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:41:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:57.961934 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d6403-9877-4db6-b7ae-a896902db809 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:58.018350 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:58.025068 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:58.072608 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567e926-8d0f-4b56-b1bd-270d95317e56 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:58.075482 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d6403-9877-4db6-b7ae-a896902db809 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:58.108482 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82fd6f-14c0-4a7c-809d-e7bfaf8db963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:58.109192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82fd6f-14c0-4a7c-809d-e7bfaf8db963 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:58.109476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82fd6f-14c0-4a7c-809d-e7bfaf8db963 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:58.109761 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82fd6f-14c0-4a7c-809d-e7bfaf8db963 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:58.110500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82fd6f-14c0-4a7c-809d-e7bfaf8db963 None admin] RBAC: Adding query filter params (name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:58.110848 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82fd6f-14c0-4a7c-809d-e7bfaf8db963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:58.112107 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846e62a-61f0-4015-9e23-dfb0dff923e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:58.112236 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82fd6f-14c0-4a7c-809d-e7bfaf8db963 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:58.113087 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846e62a-61f0-4015-9e23-dfb0dff923e2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:58.113694 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846e62a-61f0-4015-9e23-dfb0dff923e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:58.114141 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846e62a-61f0-4015-9e23-dfb0dff923e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:58.115335 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846e62a-61f0-4015-9e23-dfb0dff923e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:58.115788 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846e62a-61f0-4015-9e23-dfb0dff923e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:58.117735 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846e62a-61f0-4015-9e23-dfb0dff923e2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:58.120453 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 289/581] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jul 5 12:41:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:58.121109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82fd6f-14c0-4a7c-809d-e7bfaf8db963 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:58.128685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 293/582] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jul 5 12:41:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:58.130206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846e62a-61f0-4015-9e23-dfb0dff923e2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:58.228455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82fd6f-14c0-4a7c-809d-e7bfaf8db963 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:58.238632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846e62a-61f0-4015-9e23-dfb0dff923e2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:58.248905 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:58.252208 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:58.264529 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cef92-b78c-4210-99ba-f04f208f2eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:58.270501 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cef92-b78c-4210-99ba-f04f208f2eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:58.270501 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cef92-b78c-4210-99ba-f04f208f2eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:58.270501 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cef92-b78c-4210-99ba-f04f208f2eb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:58.273097 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b3575-4794-44eb-b334-86eec4a0dda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:58.273770 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b3575-4794-44eb-b334-86eec4a0dda4 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:58.274055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b3575-4794-44eb-b334-86eec4a0dda4 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:58.274334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b3575-4794-44eb-b334-86eec4a0dda4 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:58.275142 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b3575-4794-44eb-b334-86eec4a0dda4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:58.275452 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b3575-4794-44eb-b334-86eec4a0dda4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:58.276926 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b3575-4794-44eb-b334-86eec4a0dda4 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:58.277217 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cef92-b78c-4210-99ba-f04f208f2eb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:58.278652 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cef92-b78c-4210-99ba-f04f208f2eb2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:58.289850 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 294/583] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:41:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:58.295121 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b3575-4794-44eb-b334-86eec4a0dda4 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:58.297063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-3c7cef92-b78c-4210-99ba-f04f208f2eb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:58.297063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:58.297063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:58.297063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:58.297063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:58.297063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:58.297063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:58.297063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:58.297063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:58.297063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:58.297063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:58.297063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:58.297063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:58.297063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:58.297063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:58.297919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:58.297919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:58.297919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:58.297919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:58.297919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:58.297919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:58.297919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:58.297919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:58.297919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:58.297919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:58.297919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:58.297919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:58.297919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:58.297919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:58.297919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:58.297919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:58.297919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:58.298803 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:58.298803 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:58.298803 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:58.298803 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:58.299618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 290/584] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:58.300436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cef92-b78c-4210-99ba-f04f208f2eb2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:58.404458 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b3575-4794-44eb-b334-86eec4a0dda4 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:58.407595 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cef92-b78c-4210-99ba-f04f208f2eb2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:58.439696 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9eb8e-4628-4bb4-99a9-a8f2a16e4224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:58.440623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9eb8e-4628-4bb4-99a9-a8f2a16e4224 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:58.441032 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9eb8e-4628-4bb4-99a9-a8f2a16e4224 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:58.441409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9eb8e-4628-4bb4-99a9-a8f2a16e4224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:58.442403 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f31e3-b492-4419-9b18-b38bb8ca9254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:58.443185 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f31e3-b492-4419-9b18-b38bb8ca9254 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:58.443475 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f31e3-b492-4419-9b18-b38bb8ca9254 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:58.443751 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f31e3-b492-4419-9b18-b38bb8ca9254 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:58.452360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9eb8e-4628-4bb4-99a9-a8f2a16e4224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:58.453941 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9eb8e-4628-4bb4-99a9-a8f2a16e4224 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:58.454449 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f31e3-b492-4419-9b18-b38bb8ca9254 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:58.455871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f31e3-b492-4419-9b18-b38bb8ca9254 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:58.472022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-68e9eb8e-4628-4bb4-99a9-a8f2a16e4224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:58.472022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:58.472022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:58.472022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:58.472022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:58.472022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:58.472022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:58.472022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:58.472022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:58.472022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:58.472022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:58.472022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:58.472022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:58.472022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:58.472022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:58.473289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:58.473289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:58.473289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:58.473289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:58.473289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:58.473289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:58.473289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:58.473289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:58.473289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:58.473289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:58.473289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:58.473289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:58.473289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:58.473289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:58.473289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:58.473289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:58.473289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:58.474376 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:58.474376 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:58.474376 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:58.474376 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:58.474875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-8b8f31e3-b492-4419-9b18-b38bb8ca9254 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:58.474875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:58.474875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:58.474875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:58.474875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:58.474875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:58.474875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:58.474875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:58.474875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:58.474875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:58.474875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:58.474875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:58.474875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:58.474875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:58.474875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:58.475644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:58.475644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:58.475644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:58.475644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:58.475644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:58.475644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:58.475644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:58.475644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:58.475644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:58.475644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:58.475644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:58.475644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:58.475644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:58.475644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:58.475644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:58.475644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:58.475644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:58.476848 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:58.476848 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:58.476848 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:58.476848 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:58.476848 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 291/585] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:58.476848 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f31e3-b492-4419-9b18-b38bb8ca9254 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:58.480635 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 295/586] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:58.481527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9eb8e-4628-4bb4-99a9-a8f2a16e4224 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:58.503828 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:58.511363 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:58.587133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f31e3-b492-4419-9b18-b38bb8ca9254 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:58.588218 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9eb8e-4628-4bb4-99a9-a8f2a16e4224 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:58.624622 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc70b5-2adf-41ca-a431-61f0d85a42fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:58.624923 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8899780-b1c4-4088-bc71-735e767ef82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:58.625303 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc70b5-2adf-41ca-a431-61f0d85a42fb None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:58.625494 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8899780-b1c4-4088-bc71-735e767ef82e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:58.625589 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc70b5-2adf-41ca-a431-61f0d85a42fb None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:58.625765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8899780-b1c4-4088-bc71-735e767ef82e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:58.625862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc70b5-2adf-41ca-a431-61f0d85a42fb None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:58.626039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8899780-b1c4-4088-bc71-735e767ef82e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:58.626563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc70b5-2adf-41ca-a431-61f0d85a42fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:58.626866 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8899780-b1c4-4088-bc71-735e767ef82e None admin] RBAC: Adding query filter params (role.id=fb140b8a852547a5b8f339dce8d3440e, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=1fb7db02f8e945a7af39cb30c3d606f8) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:58.626965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc70b5-2adf-41ca-a431-61f0d85a42fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:58.627177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8899780-b1c4-4088-bc71-735e767ef82e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:58.628282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc70b5-2adf-41ca-a431-61f0d85a42fb None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:58.628618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8899780-b1c4-4088-bc71-735e767ef82e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:58.644920 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 292/587] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:41:58 2022] GET /identity/v3/role_assignments?user.id=1fb7db02f8e945a7af39cb30c3d606f8&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=fb140b8a852547a5b8f339dce8d3440e => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:58.644920 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8899780-b1c4-4088-bc71-735e767ef82e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:58.652648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 296/588] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:58.655368 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc70b5-2adf-41ca-a431-61f0d85a42fb None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:58.750201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:58.759793 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:58.765921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8899780-b1c4-4088-bc71-735e767ef82e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:58.782707 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc70b5-2adf-41ca-a431-61f0d85a42fb None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:58.828191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75051441-a06a-464d-a4fb-5d73dd4dd1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:58.828907 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75051441-a06a-464d-a4fb-5d73dd4dd1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:58.829191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75051441-a06a-464d-a4fb-5d73dd4dd1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:58.829465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75051441-a06a-464d-a4fb-5d73dd4dd1f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:58.830296 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75051441-a06a-464d-a4fb-5d73dd4dd1f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:58.830604 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75051441-a06a-464d-a4fb-5d73dd4dd1f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:58.830904 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c6ea4-faa6-4663-9c91-f001b049c271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:58.831988 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75051441-a06a-464d-a4fb-5d73dd4dd1f7 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:58.832319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c6ea4-faa6-4663-9c91-f001b049c271 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:58.832882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c6ea4-faa6-4663-9c91-f001b049c271 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:58.833405 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c6ea4-faa6-4663-9c91-f001b049c271 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:58.834493 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c6ea4-faa6-4663-9c91-f001b049c271 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:58.835142 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c6ea4-faa6-4663-9c91-f001b049c271 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:58.836579 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c6ea4-faa6-4663-9c91-f001b049c271 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:58.845026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 293/589] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:58.846164 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75051441-a06a-464d-a4fb-5d73dd4dd1f7 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:58.854121 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 297/590] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:58.855028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c6ea4-faa6-4663-9c91-f001b049c271 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:58.958660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75051441-a06a-464d-a4fb-5d73dd4dd1f7 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:58.975322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c6ea4-faa6-4663-9c91-f001b049c271 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:59.005315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5ba6f-9b10-49bd-8c45-ade7a2cda99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:59.006740 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5ba6f-9b10-49bd-8c45-ade7a2cda99f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:59.007535 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5ba6f-9b10-49bd-8c45-ade7a2cda99f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:59.008313 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5ba6f-9b10-49bd-8c45-ade7a2cda99f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:59.011869 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70cc8b-abcc-4062-8fcc-2e2c00edd318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:59.012768 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70cc8b-abcc-4062-8fcc-2e2c00edd318 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:59.013117 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70cc8b-abcc-4062-8fcc-2e2c00edd318 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:59.013462 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70cc8b-abcc-4062-8fcc-2e2c00edd318 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:59.017778 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5ba6f-9b10-49bd-8c45-ade7a2cda99f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:59.019428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5ba6f-9b10-49bd-8c45-ade7a2cda99f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:59.022262 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70cc8b-abcc-4062-8fcc-2e2c00edd318 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:59.023676 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70cc8b-abcc-4062-8fcc-2e2c00edd318 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:59.036833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-1db5ba6f-9b10-49bd-8c45-ade7a2cda99f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:41:59.036833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:59.036833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:59.036833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:59.036833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:59.036833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:59.036833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:59.036833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:59.036833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:59.036833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:59.036833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:59.036833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:59.036833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:41:59.036833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:41:59.036833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:41:59.037804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:41:59.037804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:59.037804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:59.037804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:59.037804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:59.037804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:59.037804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:59.037804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:59.037804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:59.037804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:59.037804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:59.037804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:59.037804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:59.037804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:59.037804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:59.037804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:59.037804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:59.038708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:41:59.038708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:41:59.038708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:41:59.038708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:41:59.038708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:41:59.038708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:41:59.038708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:41:59.038708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:41:59.039130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-7e70cc8b-abcc-4062-8fcc-2e2c00edd318 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 12:41:59.039130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:59.039130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:59.039130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:59.039130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:59.039130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:59.039130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:59.039130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:59.039130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:59.039130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:59.039130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:59.039130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:59.039130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:41:59.039130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:41:59.039130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:41:59.039130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:41:59.039959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:59.039959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:59.039959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:41:59.039959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:41:59.039959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:41:59.039959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:41:59.039959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:59.039959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:59.039959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:59.039959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:59.039959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:59.039959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:59.039959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:59.039959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:59.039959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:59.039959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:59.039959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:59.039959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:59.040913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:59.040913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:59.040913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:41:59.040913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:41:59.040913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:41:59.040913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:41:59.040913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:41:59.040913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:41:59.040913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 12:41:59.040913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:59.040913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 298/591] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:41:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:59.040913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70cc8b-abcc-4062-8fcc-2e2c00edd318 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:59.048130 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 294/592] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:41:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:59.048130 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5ba6f-9b10-49bd-8c45-ade7a2cda99f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:59.050433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:59.068455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:59.189422 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5ba6f-9b10-49bd-8c45-ade7a2cda99f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:59.197741 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70cc8b-abcc-4062-8fcc-2e2c00edd318 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:59.240805 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de4e74-4c60-48c9-9d5f-29d500e55381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:59.241505 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de4e74-4c60-48c9-9d5f-29d500e55381 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:59.245245 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de4e74-4c60-48c9-9d5f-29d500e55381 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:59.245245 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de4e74-4c60-48c9-9d5f-29d500e55381 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:59.245245 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de4e74-4c60-48c9-9d5f-29d500e55381 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:59.245245 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de4e74-4c60-48c9-9d5f-29d500e55381 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:59.245245 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de4e74-4c60-48c9-9d5f-29d500e55381 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:59.247474 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698c6ec-8dbc-4b1f-9cc3-9148708929ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:59.249205 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698c6ec-8dbc-4b1f-9cc3-9148708929ac None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:59.249491 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698c6ec-8dbc-4b1f-9cc3-9148708929ac None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:59.249769 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698c6ec-8dbc-4b1f-9cc3-9148708929ac None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:59.259349 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698c6ec-8dbc-4b1f-9cc3-9148708929ac None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:59.260922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698c6ec-8dbc-4b1f-9cc3-9148708929ac None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:59.267932 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 295/593] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jul 5 12:41:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:59.269049 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de4e74-4c60-48c9-9d5f-29d500e55381 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:59.280702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-d698c6ec-8dbc-4b1f-9cc3-9148708929ac None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 12:41:59.280702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:59.280702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:59.280702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:59.280702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:59.280702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:59.280702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:59.280702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:59.280702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:59.280702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:59.280702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:59.280702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:59.280702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:41:59.280702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:41:59.280702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:41:59.280702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:41:59.281714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:59.281714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:59.281714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:41:59.281714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:41:59.281714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:41:59.281714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:41:59.281714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:59.281714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:59.281714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:59.281714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:59.281714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:59.281714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:59.281714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:59.281714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:59.281714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:59.281714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:59.281714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:59.281714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:59.282663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:59.282663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:59.282663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:41:59.282663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:41:59.282663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:41:59.282663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:41:59.282663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:41:59.282663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:41:59.282663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 12:41:59.282663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:59.282663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 299/594] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:41:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:59.283250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698c6ec-8dbc-4b1f-9cc3-9148708929ac None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:59.350669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:59.354250 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:59.392834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698c6ec-8dbc-4b1f-9cc3-9148708929ac None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:59.393054 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de4e74-4c60-48c9-9d5f-29d500e55381 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:59.432003 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36b0bf-a943-4e16-a0f3-02c1cc8d6f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:59.432217 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3c8cc-cfbc-4d48-8c5c-411ebbac46e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:59.432764 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3c8cc-cfbc-4d48-8c5c-411ebbac46e0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:59.433049 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3c8cc-cfbc-4d48-8c5c-411ebbac46e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:59.433323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3c8cc-cfbc-4d48-8c5c-411ebbac46e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:59.433848 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36b0bf-a943-4e16-a0f3-02c1cc8d6f15 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:59.434164 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3c8cc-cfbc-4d48-8c5c-411ebbac46e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:59.434478 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3c8cc-cfbc-4d48-8c5c-411ebbac46e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:59.434688 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36b0bf-a943-4e16-a0f3-02c1cc8d6f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:59.435141 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36b0bf-a943-4e16-a0f3-02c1cc8d6f15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:59.436021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3c8cc-cfbc-4d48-8c5c-411ebbac46e0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:59.448733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36b0bf-a943-4e16-a0f3-02c1cc8d6f15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:59.450517 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36b0bf-a943-4e16-a0f3-02c1cc8d6f15 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:59.455628 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 296/595] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:41:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:59.456574 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3c8cc-cfbc-4d48-8c5c-411ebbac46e0 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:59.471532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-6b36b0bf-a943-4e16-a0f3-02c1cc8d6f15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:59.471532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:59.471532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:59.471532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:59.471532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:59.471532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:59.471532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:59.471532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:59.471532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:59.471532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:59.471532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:59.471532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:59.471532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:59.471532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:59.471532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:59.472492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:59.472492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:59.472492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:59.472492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:59.472492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:59.472492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:59.472492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:59.472492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:59.472492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:59.472492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:59.472492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:59.472492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:59.472492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:59.472492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:59.472492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:59.472492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:59.472492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:59.473554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:59.473554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:59.473554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:59.473554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:59.480220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 300/596] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:59.481342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36b0bf-a943-4e16-a0f3-02c1cc8d6f15 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:59.571565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3c8cc-cfbc-4d48-8c5c-411ebbac46e0 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:59.592068 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36b0bf-a943-4e16-a0f3-02c1cc8d6f15 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:59.604826 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:59.610909 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:59.614955 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330902dc-c1a6-4a37-a695-374bd2d171c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:59.615630 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330902dc-c1a6-4a37-a695-374bd2d171c6 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:59.615910 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330902dc-c1a6-4a37-a695-374bd2d171c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:59.616182 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330902dc-c1a6-4a37-a695-374bd2d171c6 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:59.617870 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330902dc-c1a6-4a37-a695-374bd2d171c6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:59.617870 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330902dc-c1a6-4a37-a695-374bd2d171c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:59.618785 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330902dc-c1a6-4a37-a695-374bd2d171c6 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:59.632115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5847cd-4fd1-4896-a08f-38d77fec97d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:59.633447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5847cd-4fd1-4896-a08f-38d77fec97d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:59.633917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5847cd-4fd1-4896-a08f-38d77fec97d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:59.634355 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5847cd-4fd1-4896-a08f-38d77fec97d2 None admin] PATH_INFO: `/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/7e7c4b0bd50c474996a21b69bde4e227/roles/fb140b8a852547a5b8f339dce8d3440e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:59.639360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 297/597] 10.222.0.36 () {56 vars in 1139 bytes} [Tue Jul 5 12:41:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:59.640223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330902dc-c1a6-4a37-a695-374bd2d171c6 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:59.651659 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5847cd-4fd1-4896-a08f-38d77fec97d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4190347294b48c096d7aa9d3a479d12, user_id=7e7c4b0bd50c474996a21b69bde4e227, role_id=fb140b8a852547a5b8f339dce8d3440e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:59.653822 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5847cd-4fd1-4896-a08f-38d77fec97d2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:59.742531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 301/598] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:41:59 2022] PUT /identity/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/7e7c4b0bd50c474996a21b69bde4e227/roles/fb140b8a852547a5b8f339dce8d3440e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:41:59.743531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5847cd-4fd1-4896-a08f-38d77fec97d2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:59.758649 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330902dc-c1a6-4a37-a695-374bd2d171c6 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:59.815870 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5f75f-f29d-4209-9153-730c0ca5f68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:59.817634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5f75f-f29d-4209-9153-730c0ca5f68b None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:59.818614 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5f75f-f29d-4209-9153-730c0ca5f68b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:59.819155 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5f75f-f29d-4209-9153-730c0ca5f68b None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:59.820157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5f75f-f29d-4209-9153-730c0ca5f68b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:41:59.820709 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5f75f-f29d-4209-9153-730c0ca5f68b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:59.822451 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5f75f-f29d-4209-9153-730c0ca5f68b None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:59.845092 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 298/599] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:41:59.846328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc583e-34a4-4be2-abb3-45b0afbac7f1 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:59.846623 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc583e-34a4-4be2-abb3-45b0afbac7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:59.846905 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc583e-34a4-4be2-abb3-45b0afbac7f1 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:59.854281 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 299/600] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:41:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:41:59.855544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc583e-34a4-4be2-abb3-45b0afbac7f1 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:41:59.896063 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5847cd-4fd1-4896-a08f-38d77fec97d2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:41:59.926550 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:41:59.951077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b4cb0-f600-4625-a0a2-8ca65e4d0c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:41:59.952195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b4cb0-f600-4625-a0a2-8ca65e4d0c26 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:59.952489 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b4cb0-f600-4625-a0a2-8ca65e4d0c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:59.952800 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b4cb0-f600-4625-a0a2-8ca65e4d0c26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:41:59.967178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b4cb0-f600-4625-a0a2-8ca65e4d0c26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:41:59.968833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b4cb0-f600-4625-a0a2-8ca65e4d0c26 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:41:59.990863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-a70b4cb0-f600-4625-a0a2-8ca65e4d0c26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:59.990863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:41:59.990863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:41:59.990863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:41:59.990863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:41:59.990863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:41:59.990863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:41:59.990863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:41:59.990863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:41:59.990863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:41:59.990863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:41:59.990863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:41:59.990863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:41:59.990863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:41:59.990863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:41:59.993101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:41:59.993101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:41:59.993101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:41:59.993101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:41:59.993101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:41:59.993101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:41:59.993101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:41:59.993101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:41:59.993101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:41:59.993101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:41:59.993101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:41:59.993101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:41:59.993101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:41:59.993101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:41:59.993101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:41:59.993101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:41:59.993101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:41:59.994008 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:41:59.994008 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:41:59.994008 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:41:59.994008 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:41:59.994239 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 302/601] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:41:59.995513 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e227ff6-7888-4e61-9900-f9652b622d48 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:41:59.997244 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e227ff6-7888-4e61-9900-f9652b622d48 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:41:59.997730 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e227ff6-7888-4e61-9900-f9652b622d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:00.011020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc583e-34a4-4be2-abb3-45b0afbac7f1 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:00.020382 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-3e227ff6-7888-4e61-9900-f9652b622d48 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:00.022321 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3e227ff6-7888-4e61-9900-f9652b622d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:00.041075 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:00.047594 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f7a1f-af86-4356-b454-6156bde7c8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:00.048459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f7a1f-af86-4356-b454-6156bde7c8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:00.048822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f7a1f-af86-4356-b454-6156bde7c8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:00.049101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f7a1f-af86-4356-b454-6156bde7c8f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:00.057430 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f7a1f-af86-4356-b454-6156bde7c8f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:00.059019 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f7a1f-af86-4356-b454-6156bde7c8f8 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:00.075222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-7e8f7a1f-af86-4356-b454-6156bde7c8f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:00.075222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:00.075222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:00.075222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:00.075222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:00.075222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:00.075222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:00.075222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:00.075222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:00.075222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:00.075222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:00.075222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:00.075222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:00.075222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:00.075222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:00.076153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:00.076153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:00.076153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:00.076153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:00.076153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:00.076153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:00.076153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:00.076153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:00.076153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:00.076153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:00.076153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:00.076153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:00.076153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:00.076153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:00.076153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:00.076153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:00.076153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:00.077070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:00.077070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:00.077070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:00.077070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:00.077070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:00.077070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:00.077070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:00.077070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:00.077070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 300/602] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:41:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:00.077548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f7a1f-af86-4356-b454-6156bde7c8f8 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:00.112297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 303/603] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:42:00.117804 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e227ff6-7888-4e61-9900-f9652b622d48 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:00.202047 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f7a1f-af86-4356-b454-6156bde7c8f8 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:00.205262 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:00.237403 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad105e17-a586-445b-81b0-90168aada944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:00.238234 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad105e17-a586-445b-81b0-90168aada944 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:00.238370 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad105e17-a586-445b-81b0-90168aada944 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:00.239148 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad105e17-a586-445b-81b0-90168aada944 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:00.239893 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad105e17-a586-445b-81b0-90168aada944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:00.240188 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad105e17-a586-445b-81b0-90168aada944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:00.241671 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad105e17-a586-445b-81b0-90168aada944 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:00.249528 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e227ff6-7888-4e61-9900-f9652b622d48 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:00.254069 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 301/604] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:00.255495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad105e17-a586-445b-81b0-90168aada944 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:00.295252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b14472-11e3-494c-99cd-1d707c2a8fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:00.296301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b14472-11e3-494c-99cd-1d707c2a8fbc None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:00.296896 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b14472-11e3-494c-99cd-1d707c2a8fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:00.297318 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b14472-11e3-494c-99cd-1d707c2a8fbc None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:00.298680 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b14472-11e3-494c-99cd-1d707c2a8fbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:00.299141 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b14472-11e3-494c-99cd-1d707c2a8fbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:00.303082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b14472-11e3-494c-99cd-1d707c2a8fbc None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:00.316222 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 304/605] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:00.317177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b14472-11e3-494c-99cd-1d707c2a8fbc None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:00.332963 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:00.380728 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad105e17-a586-445b-81b0-90168aada944 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:00.421563 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e0bad-846f-4b11-ad19-44886fe39e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:00.422503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e0bad-846f-4b11-ad19-44886fe39e0d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:00.422795 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e0bad-846f-4b11-ad19-44886fe39e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:00.423074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e0bad-846f-4b11-ad19-44886fe39e0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:00.427588 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b14472-11e3-494c-99cd-1d707c2a8fbc None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:00.434939 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e0bad-846f-4b11-ad19-44886fe39e0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:00.443341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-319e0bad-846f-4b11-ad19-44886fe39e0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:00.443341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:00.443341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:00.443341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:00.443341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:00.443341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:00.443341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:00.443341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:00.443341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:00.443341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:00.443341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:00.443341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:00.443341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:00.443341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:00.443341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:00.443341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:00.444290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:00.444290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:00.444290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:00.444290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:00.444290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:00.444290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:00.444290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:00.444290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:00.444290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:00.444290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:00.444290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:00.444290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:00.444290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:00.444290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:00.444290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:00.444290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:00.445166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:00.445166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:00.445166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:00.445166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:00.445166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:00.445166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:00.445166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:00.445166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:00.445166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:00.445166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:00.445166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:00.445166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:00.448974 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 302/606] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:42:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:00.449906 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e0bad-846f-4b11-ad19-44886fe39e0d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:00.471227 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23198f-b88a-4678-bb5c-5086513b36f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:00.472706 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23198f-b88a-4678-bb5c-5086513b36f5 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:00.474074 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23198f-b88a-4678-bb5c-5086513b36f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:00.474790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23198f-b88a-4678-bb5c-5086513b36f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:00.481154 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:00.485721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23198f-b88a-4678-bb5c-5086513b36f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:00.487892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23198f-b88a-4678-bb5c-5086513b36f5 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:00.508971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-2c23198f-b88a-4678-bb5c-5086513b36f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:00.508971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:00.508971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:00.508971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:00.508971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:00.508971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:00.508971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:00.508971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:00.508971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:00.508971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:00.508971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:00.508971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:00.508971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:00.508971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:00.508971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:00.509871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:00.509871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:00.509871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:00.509871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:00.509871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:00.509871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:00.509871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:00.509871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:00.509871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:00.509871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:00.509871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:00.509871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:00.509871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:00.509871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:00.509871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:00.509871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:00.509871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:00.510750 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:00.510750 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:00.510750 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:00.510750 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:00.510750 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:00.510750 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:00.510750 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:00.510750 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:00.513215 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 305/607] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:00.514164 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23198f-b88a-4678-bb5c-5086513b36f5 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:00.579586 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e0bad-846f-4b11-ad19-44886fe39e0d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:00.596060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:00.616651 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a2a3b-3c0b-44b3-9317-6a8df975c866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:00.617449 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a2a3b-3c0b-44b3-9317-6a8df975c866 None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:00.617836 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a2a3b-3c0b-44b3-9317-6a8df975c866 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:00.618321 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a2a3b-3c0b-44b3-9317-6a8df975c866 None admin] PATH_INFO: `/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/4bb924cdb5aa48ba9dfcc7be7e912991/roles/fb140b8a852547a5b8f339dce8d3440e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:00.633222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a2a3b-3c0b-44b3-9317-6a8df975c866 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4190347294b48c096d7aa9d3a479d12, user_id=4bb924cdb5aa48ba9dfcc7be7e912991, role_id=fb140b8a852547a5b8f339dce8d3440e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:00.634862 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a2a3b-3c0b-44b3-9317-6a8df975c866 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:00.638756 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23198f-b88a-4678-bb5c-5086513b36f5 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:00.674371 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16753d8d-f11b-4bb0-bf1f-2aad682d5158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:00.675294 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16753d8d-f11b-4bb0-bf1f-2aad682d5158 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:00.675723 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16753d8d-f11b-4bb0-bf1f-2aad682d5158 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:00.676761 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16753d8d-f11b-4bb0-bf1f-2aad682d5158 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:00.677670 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16753d8d-f11b-4bb0-bf1f-2aad682d5158 None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:00.678136 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16753d8d-f11b-4bb0-bf1f-2aad682d5158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:00.679659 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16753d8d-f11b-4bb0-bf1f-2aad682d5158 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:00.688312 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 306/608] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jul 5 12:42:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:00.689374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16753d8d-f11b-4bb0-bf1f-2aad682d5158 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:00.797467 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 303/609] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:42:00 2022] PUT /identity/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/4bb924cdb5aa48ba9dfcc7be7e912991/roles/fb140b8a852547a5b8f339dce8d3440e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:42:00.799175 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a2a3b-3c0b-44b3-9317-6a8df975c866 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:00.815845 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16753d8d-f11b-4bb0-bf1f-2aad682d5158 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:00.875570 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:00.882869 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108fcad-ffce-4ea3-86e9-71dc7e3a0700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:00.883949 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108fcad-ffce-4ea3-86e9-71dc7e3a0700 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:00.884468 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108fcad-ffce-4ea3-86e9-71dc7e3a0700 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:00.884989 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108fcad-ffce-4ea3-86e9-71dc7e3a0700 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:00.886026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108fcad-ffce-4ea3-86e9-71dc7e3a0700 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:00.886556 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108fcad-ffce-4ea3-86e9-71dc7e3a0700 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:00.888377 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108fcad-ffce-4ea3-86e9-71dc7e3a0700 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:00.903548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 307/610] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:00.905869 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab9162-7070-4a1e-bd51-93965e1ca15e None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:00.906371 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab9162-7070-4a1e-bd51-93965e1ca15e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:00.906854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab9162-7070-4a1e-bd51-93965e1ca15e None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:00.908739 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 308/611] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:00.913640 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab9162-7070-4a1e-bd51-93965e1ca15e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:00.948983 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:00.956422 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a2a3b-3c0b-44b3-9317-6a8df975c866 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:01.005257 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf09c4-329d-4936-b60d-14ebc420902c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:01.006058 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf09c4-329d-4936-b60d-14ebc420902c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:01.006340 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf09c4-329d-4936-b60d-14ebc420902c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:01.006612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf09c4-329d-4936-b60d-14ebc420902c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:01.017869 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf09c4-329d-4936-b60d-14ebc420902c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:01.020460 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf09c4-329d-4936-b60d-14ebc420902c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:01.039222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-eecf09c4-329d-4936-b60d-14ebc420902c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:01.039222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:01.039222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:01.039222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:01.039222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:01.039222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:01.039222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:01.039222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:01.039222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:01.039222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:01.039222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:01.039222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:01.039222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:01.039222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:01.039222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:01.040355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:01.040355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:01.040355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:01.040355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:01.040355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:01.040355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:01.040355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:01.040355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:01.040355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:01.040355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:01.040355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:01.040355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:01.040355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:01.040355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:01.040355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:01.040355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:01.040355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:01.041511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:01.041511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:01.041511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:01.041511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:01.043116 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 304/612] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:01.044476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7999d-70ce-46bb-b655-f831e125b819 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:01.044954 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7999d-70ce-46bb-b655-f831e125b819 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:01.045417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7999d-70ce-46bb-b655-f831e125b819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:01.050957 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab9162-7070-4a1e-bd51-93965e1ca15e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:01.073682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-63f7999d-70ce-46bb-b655-f831e125b819 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:01.075187 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-63f7999d-70ce-46bb-b655-f831e125b819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:01.095763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1023c-21cb-4db1-b788-297c91843fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:01.097251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1023c-21cb-4db1-b788-297c91843fe6 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:01.098681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1023c-21cb-4db1-b788-297c91843fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:01.099137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1023c-21cb-4db1-b788-297c91843fe6 None admin] PATH_INFO: `/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/07ab8f60c4ff4969a277b33dca05e685/roles/fb140b8a852547a5b8f339dce8d3440e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:01.119335 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1023c-21cb-4db1-b788-297c91843fe6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4190347294b48c096d7aa9d3a479d12, user_id=07ab8f60c4ff4969a277b33dca05e685, role_id=fb140b8a852547a5b8f339dce8d3440e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:01.121097 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1023c-21cb-4db1-b788-297c91843fe6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:01.151537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 305/613] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:42:01.156679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7999d-70ce-46bb-b655-f831e125b819 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:01.200726 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 309/614] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:42:00 2022] PUT /identity/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/07ab8f60c4ff4969a277b33dca05e685/roles/fb140b8a852547a5b8f339dce8d3440e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:42:01.201849 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1023c-21cb-4db1-b788-297c91843fe6 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:01.241532 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:01.327967 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:01.328303 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7999d-70ce-46bb-b655-f831e125b819 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:01.387480 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3d722-49c9-4871-983e-2f101348075e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:01.388213 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3d722-49c9-4871-983e-2f101348075e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:01.388499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3d722-49c9-4871-983e-2f101348075e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:01.388918 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3d722-49c9-4871-983e-2f101348075e None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:01.389670 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3d722-49c9-4871-983e-2f101348075e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:01.389985 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3d722-49c9-4871-983e-2f101348075e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:01.391392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3d722-49c9-4871-983e-2f101348075e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:01.411195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 306/615] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:01.418555 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3d722-49c9-4871-983e-2f101348075e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:01.433458 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1023c-21cb-4db1-b788-297c91843fe6 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:01.468512 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eee516-740d-4d27-b316-cde99a0ed67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:01.469359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eee516-740d-4d27-b316-cde99a0ed67b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:01.469704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eee516-740d-4d27-b316-cde99a0ed67b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:01.469998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eee516-740d-4d27-b316-cde99a0ed67b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:01.481898 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eee516-740d-4d27-b316-cde99a0ed67b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:01.490540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-09eee516-740d-4d27-b316-cde99a0ed67b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:01.490540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:01.490540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:01.490540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:01.490540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:01.490540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:01.490540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:01.490540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:01.490540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:01.490540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:01.490540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:01.490540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:01.490540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:01.490540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:01.490540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:01.490540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:01.491547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:01.491547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:01.491547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:01.491547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:01.491547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:01.491547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:01.491547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:01.491547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:01.491547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:01.491547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:01.491547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:01.491547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:01.491547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:01.491547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:01.491547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:01.491547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:01.492434 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:01.492434 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:01.492434 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:01.492434 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:01.492434 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:01.492434 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:01.492434 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:01.492434 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:01.492434 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:01.492434 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:01.492434 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:01.492434 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:01.496752 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 310/616] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:42:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:01.498039 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eee516-740d-4d27-b316-cde99a0ed67b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:01.551710 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3d722-49c9-4871-983e-2f101348075e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:01.573636 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:01.612096 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8caddd-027f-4f7f-8cdf-7b7d67646e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:01.612897 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8caddd-027f-4f7f-8cdf-7b7d67646e87 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:01.613182 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8caddd-027f-4f7f-8cdf-7b7d67646e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:01.614023 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8caddd-027f-4f7f-8cdf-7b7d67646e87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:01.624914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eee516-740d-4d27-b316-cde99a0ed67b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:01.628079 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8caddd-027f-4f7f-8cdf-7b7d67646e87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:01.630167 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8caddd-027f-4f7f-8cdf-7b7d67646e87 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:01.653772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-7f8caddd-027f-4f7f-8cdf-7b7d67646e87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:42:01.653772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:01.653772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:01.653772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:01.653772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:01.653772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:01.653772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:01.653772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:01.653772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:01.653772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:01.653772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:01.653772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:01.653772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:01.653772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:01.653772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:01.653772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:01.654789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:01.654789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:01.654789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:01.654789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:01.654789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:01.654789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:01.654789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:01.654789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:01.654789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:01.654789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:01.654789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:01.654789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:01.654789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:01.654789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:01.654789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:01.654789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:01.654789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:01.654789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:01.655725 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:01.655725 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:01.655725 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:01.655725 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:01.655725 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:01.655725 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:01.655725 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:01.655725 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:01.655725 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:42:01.655725 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:01.658808 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 307/617] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jul 5 12:42:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:01.660976 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8caddd-027f-4f7f-8cdf-7b7d67646e87 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:01.722192 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea264462-afe5-4d9c-8328-d38ac761d82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:01.722937 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea264462-afe5-4d9c-8328-d38ac761d82d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:01.723221 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea264462-afe5-4d9c-8328-d38ac761d82d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:01.723497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea264462-afe5-4d9c-8328-d38ac761d82d None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:01.724254 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea264462-afe5-4d9c-8328-d38ac761d82d None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:01.724834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea264462-afe5-4d9c-8328-d38ac761d82d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:01.726241 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea264462-afe5-4d9c-8328-d38ac761d82d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:01.743934 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 311/618] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jul 5 12:42:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:01.750575 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea264462-afe5-4d9c-8328-d38ac761d82d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:01.791258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8caddd-027f-4f7f-8cdf-7b7d67646e87 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:01.814338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:01.842792 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35908d15-dc27-4397-a899-07425df0d147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:01.843477 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35908d15-dc27-4397-a899-07425df0d147 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:01.843764 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35908d15-dc27-4397-a899-07425df0d147 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:01.844044 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35908d15-dc27-4397-a899-07425df0d147 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:01.844923 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35908d15-dc27-4397-a899-07425df0d147 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:01.845234 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35908d15-dc27-4397-a899-07425df0d147 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:01.846717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35908d15-dc27-4397-a899-07425df0d147 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:01.881878 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 308/619] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jul 5 12:42:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:01.887566 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35908d15-dc27-4397-a899-07425df0d147 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:01.931235 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:01.959717 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea264462-afe5-4d9c-8328-d38ac761d82d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:01.999808 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f0593-b831-484c-9153-360bd1cf27c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:02.000837 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f0593-b831-484c-9153-360bd1cf27c9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:02.001211 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f0593-b831-484c-9153-360bd1cf27c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:02.001592 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f0593-b831-484c-9153-360bd1cf27c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:02.009736 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35908d15-dc27-4397-a899-07425df0d147 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:02.014240 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f0593-b831-484c-9153-360bd1cf27c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:02.015975 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f0593-b831-484c-9153-360bd1cf27c9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:02.035746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-b38f0593-b831-484c-9153-360bd1cf27c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:02.035746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:02.035746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:02.035746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:02.035746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:02.035746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:02.035746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:02.035746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:02.035746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:02.035746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:02.035746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:02.035746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:02.035746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:02.035746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:02.035746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:02.036764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:02.036764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:02.036764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:02.036764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:02.036764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:02.036764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:02.036764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:02.036764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:02.036764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:02.036764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:02.036764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:02.036764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:02.036764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:02.036764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:02.036764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:02.036764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:02.036764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:02.037669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:02.037669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:02.037669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:02.037669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:02.040150 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 312/620] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:02.042178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ac46d-1f21-4271-9a06-29b60eb04313 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:02.042733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ac46d-1f21-4271-9a06-29b60eb04313 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:02.043231 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ac46d-1f21-4271-9a06-29b60eb04313 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:02.045178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 313/621] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:02.046149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ac46d-1f21-4271-9a06-29b60eb04313 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:02.046899 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933847b-963e-454a-8029-3d76ad49499a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:02.053001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933847b-963e-454a-8029-3d76ad49499a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:02.053293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933847b-963e-454a-8029-3d76ad49499a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:02.053578 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933847b-963e-454a-8029-3d76ad49499a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:02.065715 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:02.147151 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933847b-963e-454a-8029-3d76ad49499a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:02.148715 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933847b-963e-454a-8029-3d76ad49499a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:02.183245 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ac46d-1f21-4271-9a06-29b60eb04313 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:02.190305 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:02.233686 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c0078-e645-404e-b19f-a6bd6458c675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:02.235491 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c0078-e645-404e-b19f-a6bd6458c675 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:02.235921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c0078-e645-404e-b19f-a6bd6458c675 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:02.236349 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c0078-e645-404e-b19f-a6bd6458c675 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:02.237314 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c0078-e645-404e-b19f-a6bd6458c675 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:02.237786 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c0078-e645-404e-b19f-a6bd6458c675 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:02.239407 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c0078-e645-404e-b19f-a6bd6458c675 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:02.256229 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 314/622] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:02.258537 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347361d-23a4-44ce-bfd9-db8adebf5d2e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:02.259038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347361d-23a4-44ce-bfd9-db8adebf5d2e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:02.259703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347361d-23a4-44ce-bfd9-db8adebf5d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:02.267188 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 309/623] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:42:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:42:02.268022 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933847b-963e-454a-8029-3d76ad49499a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:02.283016 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-e347361d-23a4-44ce-bfd9-db8adebf5d2e None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:02.284281 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e347361d-23a4-44ce-bfd9-db8adebf5d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:02.376864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 315/624] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:42:02.378185 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347361d-23a4-44ce-bfd9-db8adebf5d2e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:02.381823 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:02.390489 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933847b-963e-454a-8029-3d76ad49499a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:02.426836 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05de7b-da07-4abf-97ed-cc5e43d17ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:02.427569 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05de7b-da07-4abf-97ed-cc5e43d17ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:02.427919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05de7b-da07-4abf-97ed-cc5e43d17ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:02.428261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05de7b-da07-4abf-97ed-cc5e43d17ac0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:02.430684 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:02.436420 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05de7b-da07-4abf-97ed-cc5e43d17ac0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:02.437953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05de7b-da07-4abf-97ed-cc5e43d17ac0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:02.453993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-6e05de7b-da07-4abf-97ed-cc5e43d17ac0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:42:02.453993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:02.453993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:02.453993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:02.453993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:02.453993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:02.453993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:02.453993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:02.453993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:02.453993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:02.453993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:02.453993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:02.453993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:02.453993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:02.453993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:02.453993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:02.454994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:02.454994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:02.454994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:02.454994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:02.454994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:02.454994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:02.454994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:02.454994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:02.454994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:02.454994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:02.454994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:02.454994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:02.454994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:02.454994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:02.454994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:02.454994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:02.454994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:02.454994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:02.455960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:02.455960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:02.455960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:02.455960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:02.455960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:02.455960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:02.455960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:02.455960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:02.455960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:42:02.455960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:02.455960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 310/625] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:42:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:02.456561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05de7b-da07-4abf-97ed-cc5e43d17ac0 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:02.520301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347361d-23a4-44ce-bfd9-db8adebf5d2e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:02.558661 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfb5b0-9483-4229-8b1b-d63a232d44eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:02.559753 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfb5b0-9483-4229-8b1b-d63a232d44eb None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:02.560083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05de7b-da07-4abf-97ed-cc5e43d17ac0 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:02.560378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfb5b0-9483-4229-8b1b-d63a232d44eb None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:02.560852 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfb5b0-9483-4229-8b1b-d63a232d44eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:02.572795 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfb5b0-9483-4229-8b1b-d63a232d44eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:02.574503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfb5b0-9483-4229-8b1b-d63a232d44eb None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:02.594593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-b9bfb5b0-9483-4229-8b1b-d63a232d44eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:02.594593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:02.594593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:02.594593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:02.594593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:02.594593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:02.594593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:02.594593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:02.594593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:02.594593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:02.594593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:02.594593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:02.594593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:02.594593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:02.594593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:02.595744 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:02.595744 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:02.595744 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:02.595744 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:02.595744 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:02.595744 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:02.595744 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:02.595744 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:02.595744 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:02.595744 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:02.595744 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:02.595744 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:02.595744 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:02.595744 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:02.595744 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:02.595744 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:02.595744 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:02.596851 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:02.596851 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:02.596851 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:02.596851 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:02.599208 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 316/626] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:02.600027 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227df941-c155-416a-a220-520945288f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:02.600732 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfb5b0-9483-4229-8b1b-d63a232d44eb None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:02.601141 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227df941-c155-416a-a220-520945288f6e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:02.601489 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227df941-c155-416a-a220-520945288f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:02.601828 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227df941-c155-416a-a220-520945288f6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:02.614614 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227df941-c155-416a-a220-520945288f6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:02.622713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-227df941-c155-416a-a220-520945288f6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:02.622713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:02.622713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:02.622713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:02.622713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:02.622713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:02.622713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:02.622713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:02.622713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:02.622713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:02.622713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:02.622713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:02.622713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:02.622713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:02.622713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:02.622713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:02.623731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:02.623731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:02.623731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:02.623731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:02.623731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:02.623731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:02.623731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:02.623731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:02.623731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:02.623731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:02.623731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:02.623731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:02.623731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:02.623731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:02.623731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:02.623731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:02.624565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:02.624565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:02.624565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:02.624565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:02.624565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:02.624565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:02.624565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:02.624565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:02.624565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:02.624565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:02.624565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:02.624565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:02.624565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 311/627] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:42:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:02.630656 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227df941-c155-416a-a220-520945288f6e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:02.681252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:02.704929 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:02.734343 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfb5b0-9483-4229-8b1b-d63a232d44eb None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:02.773348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227df941-c155-416a-a220-520945288f6e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:02.774790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea42d4-afb1-4e77-bfc0-15c6f87121f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:02.775537 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea42d4-afb1-4e77-bfc0-15c6f87121f7 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:02.775885 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea42d4-afb1-4e77-bfc0-15c6f87121f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:02.776159 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea42d4-afb1-4e77-bfc0-15c6f87121f7 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:02.777160 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea42d4-afb1-4e77-bfc0-15c6f87121f7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:02.777698 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea42d4-afb1-4e77-bfc0-15c6f87121f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:02.779819 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea42d4-afb1-4e77-bfc0-15c6f87121f7 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:02.800699 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 317/628] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jul 5 12:42:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:02.802396 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea42d4-afb1-4e77-bfc0-15c6f87121f7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:02.838314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54b92c-389e-461e-bd21-1d088c0d30f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:02.839866 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54b92c-389e-461e-bd21-1d088c0d30f8 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:02.841225 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54b92c-389e-461e-bd21-1d088c0d30f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:02.841747 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54b92c-389e-461e-bd21-1d088c0d30f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:02.842672 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54b92c-389e-461e-bd21-1d088c0d30f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:02.843172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54b92c-389e-461e-bd21-1d088c0d30f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:02.845597 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54b92c-389e-461e-bd21-1d088c0d30f8 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:02.871398 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 312/629] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:02.873881 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54b92c-389e-461e-bd21-1d088c0d30f8 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:02.913353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea42d4-afb1-4e77-bfc0-15c6f87121f7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:02.932869 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:02.961697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8cad5-dd9a-412c-98a0-919bfedd0c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:02.963405 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8cad5-dd9a-412c-98a0-919bfedd0c64 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:02.963919 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8cad5-dd9a-412c-98a0-919bfedd0c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:02.964693 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8cad5-dd9a-412c-98a0-919bfedd0c64 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:02.965926 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8cad5-dd9a-412c-98a0-919bfedd0c64 None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:02.966333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8cad5-dd9a-412c-98a0-919bfedd0c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:02.967951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8cad5-dd9a-412c-98a0-919bfedd0c64 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:02.982478 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 318/630] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jul 5 12:42:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:02.982478 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8cad5-dd9a-412c-98a0-919bfedd0c64 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:03.006079 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54b92c-389e-461e-bd21-1d088c0d30f8 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:03.021518 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:03.041796 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cd5d8-9219-44c2-a277-6152be5b5f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:03.042596 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cd5d8-9219-44c2-a277-6152be5b5f5b None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:03.042882 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cd5d8-9219-44c2-a277-6152be5b5f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:03.043161 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cd5d8-9219-44c2-a277-6152be5b5f5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:03.056820 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cd5d8-9219-44c2-a277-6152be5b5f5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:03.058298 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cd5d8-9219-44c2-a277-6152be5b5f5b None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:03.076061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-c58cd5d8-9219-44c2-a277-6152be5b5f5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:03.076061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:03.076061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:03.076061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:03.076061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:03.076061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:03.076061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:03.076061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:03.076061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:03.076061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:03.076061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:03.076061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:03.076061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:03.076061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:03.076061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:03.077194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:03.077194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:03.077194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:03.077194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:03.077194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:03.077194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:03.077194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:03.077194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:03.077194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:03.077194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:03.077194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:03.077194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:03.077194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:03.077194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:03.077194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:03.077194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:03.077194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:03.078100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:03.078100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:03.078100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:03.078100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:03.078100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 313/631] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:03.078100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cd5d8-9219-44c2-a277-6152be5b5f5b None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:03.103408 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8cad5-dd9a-412c-98a0-919bfedd0c64 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:03.137088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad512f-7e6d-4095-8484-41c8d05d66d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:03.137890 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad512f-7e6d-4095-8484-41c8d05d66d6 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:03.138177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad512f-7e6d-4095-8484-41c8d05d66d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:03.138464 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad512f-7e6d-4095-8484-41c8d05d66d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:03.145774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad512f-7e6d-4095-8484-41c8d05d66d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:03.147239 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad512f-7e6d-4095-8484-41c8d05d66d6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:03.161690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-dfad512f-7e6d-4095-8484-41c8d05d66d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:03.161690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:03.161690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:03.161690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:03.161690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:03.161690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:03.161690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:03.161690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:03.161690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:03.161690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:03.161690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:03.161690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:03.161690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:03.161690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:03.161690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:03.162690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:03.162690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:03.162690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:03.162690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:03.162690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:03.162690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:03.162690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:03.162690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:03.162690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:03.162690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:03.162690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:03.162690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:03.162690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:03.162690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:03.162690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:03.162690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:03.162690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:03.163593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:03.163593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:03.163593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:03.163593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:03.163593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:03.163593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:03.163593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:03.163593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:03.163593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 319/632] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:03.164616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b257d-c6f7-41e8-82d0-b07584aa46b4 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:03.164836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b257d-c6f7-41e8-82d0-b07584aa46b4 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:03.165111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b257d-c6f7-41e8-82d0-b07584aa46b4 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:03.166556 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 320/633] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:03.167123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b257d-c6f7-41e8-82d0-b07584aa46b4 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:03.214587 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cd5d8-9219-44c2-a277-6152be5b5f5b None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:03.219193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:03.253083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6df3df-5603-48de-8ac4-a88f32b2e216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:03.254530 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6df3df-5603-48de-8ac4-a88f32b2e216 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:03.254825 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6df3df-5603-48de-8ac4-a88f32b2e216 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:03.255099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6df3df-5603-48de-8ac4-a88f32b2e216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:03.268256 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6df3df-5603-48de-8ac4-a88f32b2e216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:03.270704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6df3df-5603-48de-8ac4-a88f32b2e216 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:03.286798 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b257d-c6f7-41e8-82d0-b07584aa46b4 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:03.292078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-0d6df3df-5603-48de-8ac4-a88f32b2e216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:03.292078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:03.292078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:03.292078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:03.292078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:03.292078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:03.292078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:03.292078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:03.292078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:03.292078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:03.292078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:03.292078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:03.292078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:03.292078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:03.292078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:03.293192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:03.293192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:03.293192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:03.293192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:03.293192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:03.293192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:03.293192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:03.293192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:03.293192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:03.293192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:03.293192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:03.293192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:03.293192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:03.293192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:03.293192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:03.293192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:03.293192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:03.294671 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:03.294671 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:03.294671 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:03.294671 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:03.294671 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 314/634] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:03.294671 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6df3df-5603-48de-8ac4-a88f32b2e216 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:03.316121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:03.327015 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8414b37-45f2-4b9e-9f73-178d42632ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:03.327755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8414b37-45f2-4b9e-9f73-178d42632ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:03.334019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8414b37-45f2-4b9e-9f73-178d42632ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:03.334019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8414b37-45f2-4b9e-9f73-178d42632ca0 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:03.334019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8414b37-45f2-4b9e-9f73-178d42632ca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:03.334019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8414b37-45f2-4b9e-9f73-178d42632ca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:03.334019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8414b37-45f2-4b9e-9f73-178d42632ca0 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:03.349443 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 321/635] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:03.349443 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef2319-6aa6-4c59-ad7c-b5e93127d0a6 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:03.349443 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef2319-6aa6-4c59-ad7c-b5e93127d0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:03.349443 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef2319-6aa6-4c59-ad7c-b5e93127d0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:03.365552 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-d1ef2319-6aa6-4c59-ad7c-b5e93127d0a6 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:03.366748 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d1ef2319-6aa6-4c59-ad7c-b5e93127d0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:03.412092 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6df3df-5603-48de-8ac4-a88f32b2e216 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:03.442099 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 322/636] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:42:03.442943 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef2319-6aa6-4c59-ad7c-b5e93127d0a6 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:03.461139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa943a-d996-4ba5-879a-cebe55185278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:03.462121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa943a-d996-4ba5-879a-cebe55185278 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:03.462592 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa943a-d996-4ba5-879a-cebe55185278 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:03.463167 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa943a-d996-4ba5-879a-cebe55185278 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:03.463978 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa943a-d996-4ba5-879a-cebe55185278 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:03.464362 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa943a-d996-4ba5-879a-cebe55185278 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:03.466806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa943a-d996-4ba5-879a-cebe55185278 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:03.479927 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 315/637] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:03.481829 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa943a-d996-4ba5-879a-cebe55185278 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:03.482593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:03.560182 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef2319-6aa6-4c59-ad7c-b5e93127d0a6 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:03.564919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:03.586615 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa943a-d996-4ba5-879a-cebe55185278 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:03.593911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c256797-214c-4e68-a6f3-3d88b84184f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:03.594580 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c256797-214c-4e68-a6f3-3d88b84184f1 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:03.594864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c256797-214c-4e68-a6f3-3d88b84184f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:03.595143 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c256797-214c-4e68-a6f3-3d88b84184f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:03.595873 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c256797-214c-4e68-a6f3-3d88b84184f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:03.596181 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c256797-214c-4e68-a6f3-3d88b84184f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:03.597614 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c256797-214c-4e68-a6f3-3d88b84184f1 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:03.608859 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 323/638] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:03.609652 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c256797-214c-4e68-a6f3-3d88b84184f1 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:03.620387 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214537ae-1b93-4959-bdc4-1f269570b548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:03.621214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214537ae-1b93-4959-bdc4-1f269570b548 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:03.621498 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214537ae-1b93-4959-bdc4-1f269570b548 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:03.621777 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214537ae-1b93-4959-bdc4-1f269570b548 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:03.628790 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214537ae-1b93-4959-bdc4-1f269570b548 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:03.630751 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214537ae-1b93-4959-bdc4-1f269570b548 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:03.644752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-214537ae-1b93-4959-bdc4-1f269570b548 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:03.644752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:03.644752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:03.644752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:03.644752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:03.644752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:03.644752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:03.644752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:03.644752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:03.644752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:03.644752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:03.644752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:03.644752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:03.644752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:03.644752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:03.645679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:03.645679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:03.645679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:03.645679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:03.645679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:03.645679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:03.645679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:03.645679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:03.645679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:03.645679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:03.645679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:03.645679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:03.645679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:03.645679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:03.645679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:03.645679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:03.645679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:03.646561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:03.646561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:03.646561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:03.646561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:03.646561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:03.646561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:03.646561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:03.646561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:03.649874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 316/639] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:03.649874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214537ae-1b93-4959-bdc4-1f269570b548 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:03.692707 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:03.707747 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c256797-214c-4e68-a6f3-3d88b84184f1 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:03.742632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c76bd-311c-4dd6-b5e7-955f4c2236b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:03.743415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c76bd-311c-4dd6-b5e7-955f4c2236b0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:03.743709 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c76bd-311c-4dd6-b5e7-955f4c2236b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:03.743986 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c76bd-311c-4dd6-b5e7-955f4c2236b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:03.747055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214537ae-1b93-4959-bdc4-1f269570b548 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:03.753955 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c76bd-311c-4dd6-b5e7-955f4c2236b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:03.762173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-a89c76bd-311c-4dd6-b5e7-955f4c2236b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:03.762173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:03.762173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:03.762173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:03.762173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:03.762173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:03.762173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:03.762173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:03.762173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:03.762173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:03.762173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:03.762173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:03.762173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:03.762173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:03.762173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:03.762173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:03.763374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:03.763374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:03.763374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:03.763374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:03.763374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:03.763374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:03.763374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:03.763374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:03.763374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:03.763374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:03.763374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:03.763374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:03.763374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:03.763374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:03.763374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:03.763374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:03.769554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:03.769554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:03.769554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:03.769554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:03.769554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:03.769554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:03.769554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:03.769554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:03.769554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:03.769554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:03.769554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:03.769554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:03.769554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 324/640] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:42:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:03.769554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c76609-05fe-4c83-84b0-6c66cdc09ed3 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:03.770517 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c76609-05fe-4c83-84b0-6c66cdc09ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:03.770517 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c76609-05fe-4c83-84b0-6c66cdc09ed3 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:03.770517 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 325/641] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:03.770517 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c76609-05fe-4c83-84b0-6c66cdc09ed3 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:03.784730 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d53b7-477c-413f-be00-e0d93e1f3ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:03.785401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d53b7-477c-413f-be00-e0d93e1f3ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:03.785682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d53b7-477c-413f-be00-e0d93e1f3ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:03.785958 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d53b7-477c-413f-be00-e0d93e1f3ef4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:03.786779 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d53b7-477c-413f-be00-e0d93e1f3ef4 None admin] RBAC: Adding query filter params (role.id=fb140b8a852547a5b8f339dce8d3440e, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=cdf37a42279a466b85906b23751f9c22) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:03.787086 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d53b7-477c-413f-be00-e0d93e1f3ef4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:03.788505 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d53b7-477c-413f-be00-e0d93e1f3ef4 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:03.794542 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 317/642] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:42:03 2022] GET /identity/v3/role_assignments?user.id=cdf37a42279a466b85906b23751f9c22&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=fb140b8a852547a5b8f339dce8d3440e => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:03.795328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d53b7-477c-413f-be00-e0d93e1f3ef4 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:03.797741 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:03.882150 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c76609-05fe-4c83-84b0-6c66cdc09ed3 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:03.917381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d53b7-477c-413f-be00-e0d93e1f3ef4 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:03.919248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acee639-befa-462a-b2f5-cbfcedaa82dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:03.920074 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acee639-befa-462a-b2f5-cbfcedaa82dc None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:03.920353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acee639-befa-462a-b2f5-cbfcedaa82dc None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:03.920650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acee639-befa-462a-b2f5-cbfcedaa82dc None admin] PATH_INFO: `/v3/users/glance` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:03.929163 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acee639-befa-462a-b2f5-cbfcedaa82dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:03.930648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acee639-befa-462a-b2f5-cbfcedaa82dc None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:03.945922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-4acee639-befa-462a-b2f5-cbfcedaa82dc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 12:42:03.945922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:03.945922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:03.945922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:03.945922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:03.945922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:03.945922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:03.945922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:03.945922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:03.945922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:03.945922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:03.945922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:03.945922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:03.945922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:03.945922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:03.945922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:03.946950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:03.946950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:03.946950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:03.946950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:03.946950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:03.946950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:03.946950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:03.946950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:03.946950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:03.946950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:03.946950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:03.946950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:03.946950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:03.946950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:03.946950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:03.946950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:03.946950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:03.946950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:03.947950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:03.947950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:03.947950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:03.947950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:03.947950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:03.947950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:03.947950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:03.947950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:03.947950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 12:42:03.947950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:03.947950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 326/643] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:42:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:03.947950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acee639-befa-462a-b2f5-cbfcedaa82dc None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:03.957773 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b9573-252f-48a4-a5a6-e39acd23d64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:03.958767 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b9573-252f-48a4-a5a6-e39acd23d64d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:03.959050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b9573-252f-48a4-a5a6-e39acd23d64d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:03.959329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b9573-252f-48a4-a5a6-e39acd23d64d None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:03.959444 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:03.960559 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b9573-252f-48a4-a5a6-e39acd23d64d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:03.961660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b9573-252f-48a4-a5a6-e39acd23d64d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:03.965490 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b9573-252f-48a4-a5a6-e39acd23d64d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:03.977114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 318/644] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:03.978496 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f7731-47d5-43b0-b957-3be73fbf35e5 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:03.978786 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f7731-47d5-43b0-b957-3be73fbf35e5 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:03.979069 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f7731-47d5-43b0-b957-3be73fbf35e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:03.996435 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d80f7731-47d5-43b0-b957-3be73fbf35e5 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:03.998212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d80f7731-47d5-43b0-b957-3be73fbf35e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:04.061760 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:04.070685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acee639-befa-462a-b2f5-cbfcedaa82dc None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:04.076732 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 319/645] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:42:04.077819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f7731-47d5-43b0-b957-3be73fbf35e5 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:04.110014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359e875-c739-45bc-bc38-017b6ae776ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:04.110700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359e875-c739-45bc-bc38-017b6ae776ad None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:04.110988 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359e875-c739-45bc-bc38-017b6ae776ad None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:04.111268 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359e875-c739-45bc-bc38-017b6ae776ad None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:04.112021 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359e875-c739-45bc-bc38-017b6ae776ad None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:04.112322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359e875-c739-45bc-bc38-017b6ae776ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:04.113783 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359e875-c739-45bc-bc38-017b6ae776ad None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:04.122526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 327/646] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jul 5 12:42:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:04.123247 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359e875-c739-45bc-bc38-017b6ae776ad None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:04.194141 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:04.200420 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f7731-47d5-43b0-b957-3be73fbf35e5 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:04.227791 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359e875-c739-45bc-bc38-017b6ae776ad None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:04.237457 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faca67b-9dd2-45f1-901b-43919328c460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:04.238133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faca67b-9dd2-45f1-901b-43919328c460 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:04.238453 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faca67b-9dd2-45f1-901b-43919328c460 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:04.238740 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faca67b-9dd2-45f1-901b-43919328c460 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:04.239579 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faca67b-9dd2-45f1-901b-43919328c460 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:04.239894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faca67b-9dd2-45f1-901b-43919328c460 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:04.241449 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faca67b-9dd2-45f1-901b-43919328c460 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:04.260451 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 320/647] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jul 5 12:42:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:04.263131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816a627-27d3-4806-a288-bb5357330d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:04.264029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816a627-27d3-4806-a288-bb5357330d08 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:04.264325 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816a627-27d3-4806-a288-bb5357330d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:04.264763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816a627-27d3-4806-a288-bb5357330d08 None admin] PATH_INFO: `/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/1fb7db02f8e945a7af39cb30c3d606f8/roles/fb140b8a852547a5b8f339dce8d3440e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:04.265411 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faca67b-9dd2-45f1-901b-43919328c460 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:04.281715 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816a627-27d3-4806-a288-bb5357330d08 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4190347294b48c096d7aa9d3a479d12, user_id=1fb7db02f8e945a7af39cb30c3d606f8, role_id=fb140b8a852547a5b8f339dce8d3440e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:04.283178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816a627-27d3-4806-a288-bb5357330d08 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:04.316308 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:04.364812 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faca67b-9dd2-45f1-901b-43919328c460 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:04.398304 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542272c-bca6-4d3d-a5c8-73ac08006e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:04.399165 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542272c-bca6-4d3d-a5c8-73ac08006e55 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:04.399456 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542272c-bca6-4d3d-a5c8-73ac08006e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:04.399734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542272c-bca6-4d3d-a5c8-73ac08006e55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:04.412605 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 328/648] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:42:04 2022] PUT /identity/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/1fb7db02f8e945a7af39cb30c3d606f8/roles/fb140b8a852547a5b8f339dce8d3440e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:42:04.412605 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816a627-27d3-4806-a288-bb5357330d08 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:04.421127 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542272c-bca6-4d3d-a5c8-73ac08006e55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:04.429873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-1542272c-bca6-4d3d-a5c8-73ac08006e55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:04.429873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:04.429873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:04.429873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:04.429873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:04.429873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:04.429873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:04.429873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:04.429873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:04.429873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:04.429873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:04.429873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:04.429873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:04.429873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:04.429873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:04.429873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:04.430926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:04.430926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:04.430926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:04.430926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:04.430926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:04.430926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:04.430926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:04.430926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:04.430926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:04.430926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:04.430926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:04.430926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:04.430926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:04.430926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:04.430926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:04.430926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:04.431759 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:04.431759 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:04.431759 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:04.431759 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:04.431759 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:04.431759 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:04.431759 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:04.431759 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:04.431759 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:04.431759 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:04.431759 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:04.431759 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:04.431759 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 321/649] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:42:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:04.432461 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542272c-bca6-4d3d-a5c8-73ac08006e55 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:04.540216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816a627-27d3-4806-a288-bb5357330d08 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:04.560097 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542272c-bca6-4d3d-a5c8-73ac08006e55 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:04.561097 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:04.573380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:04.581514 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53379cd-7a0a-478d-b898-9274ad58e33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:04.582612 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53379cd-7a0a-478d-b898-9274ad58e33f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:04.582997 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53379cd-7a0a-478d-b898-9274ad58e33f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:04.583378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53379cd-7a0a-478d-b898-9274ad58e33f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:04.597314 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53379cd-7a0a-478d-b898-9274ad58e33f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:04.599939 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53379cd-7a0a-478d-b898-9274ad58e33f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:04.607597 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76d2ce-4f8a-4c20-a857-06b2a4372c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:04.608488 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76d2ce-4f8a-4c20-a857-06b2a4372c3c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:04.608806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76d2ce-4f8a-4c20-a857-06b2a4372c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:04.609083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76d2ce-4f8a-4c20-a857-06b2a4372c3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:04.625520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-d53379cd-7a0a-478d-b898-9274ad58e33f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:04.625520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:04.625520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:04.625520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:04.625520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:04.625520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:04.625520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:04.625520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:04.625520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:04.625520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:04.625520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:04.625520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:04.625520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:04.625520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:04.625520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:04.626450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:04.626450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:04.626450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:04.626450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:04.626450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:04.626450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:04.626450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:04.626450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:04.626450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:04.626450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:04.626450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:04.626450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:04.626450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:04.626450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:04.626450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:04.626450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:04.626450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:04.627785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:04.627785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:04.627785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:04.627785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:04.627785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 329/650] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:04.627785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53379cd-7a0a-478d-b898-9274ad58e33f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:04.702901 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76d2ce-4f8a-4c20-a857-06b2a4372c3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:04.704857 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76d2ce-4f8a-4c20-a857-06b2a4372c3c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:04.737972 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53379cd-7a0a-478d-b898-9274ad58e33f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:04.788567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5483463-265a-46e5-ab06-a8324dafbcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:04.789745 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5483463-265a-46e5-ab06-a8324dafbcc2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:04.790837 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5483463-265a-46e5-ab06-a8324dafbcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:04.791171 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5483463-265a-46e5-ab06-a8324dafbcc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:04.792331 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5483463-265a-46e5-ab06-a8324dafbcc2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:04.792774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5483463-265a-46e5-ab06-a8324dafbcc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:04.796425 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5483463-265a-46e5-ab06-a8324dafbcc2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:04.818882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 330/651] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jul 5 12:42:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:04.820452 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5483463-265a-46e5-ab06-a8324dafbcc2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:04.827616 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 322/652] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:42:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:42:04.828325 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76d2ce-4f8a-4c20-a857-06b2a4372c3c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:04.840211 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:04.869133 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:04.933181 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76d2ce-4f8a-4c20-a857-06b2a4372c3c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:04.947785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5483463-265a-46e5-ab06-a8324dafbcc2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:04.970206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512366c-48aa-4d9c-8fca-51dadfc648a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:04.971010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512366c-48aa-4d9c-8fca-51dadfc648a4 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:04.971297 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512366c-48aa-4d9c-8fca-51dadfc648a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:04.971574 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512366c-48aa-4d9c-8fca-51dadfc648a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:04.985222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512366c-48aa-4d9c-8fca-51dadfc648a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:04.985758 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06be45-8051-403f-90a9-f67001794c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:04.986512 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06be45-8051-403f-90a9-f67001794c7e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:04.986750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512366c-48aa-4d9c-8fca-51dadfc648a4 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:04.986932 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06be45-8051-403f-90a9-f67001794c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:04.987285 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06be45-8051-403f-90a9-f67001794c7e None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:04.988106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06be45-8051-403f-90a9-f67001794c7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:04.989198 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06be45-8051-403f-90a9-f67001794c7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:04.990800 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06be45-8051-403f-90a9-f67001794c7e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:05.008091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-3512366c-48aa-4d9c-8fca-51dadfc648a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:05.008091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:05.008091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:05.008091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:05.008091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:05.008091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:05.008091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:05.008091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:05.008091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:05.008091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:05.008091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:05.008091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:05.008091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:05.008091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:05.008091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:05.009373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:05.009373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:05.009373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:05.009373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:05.009373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:05.009373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:05.009373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:05.009373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:05.009373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:05.009373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:05.009373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:05.009373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:05.009373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:05.009373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:05.009373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:05.009373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:05.009373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:05.010587 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:05.010587 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:05.010587 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:05.010587 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:05.015274 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 331/653] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:05.015274 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06be45-8051-403f-90a9-f67001794c7e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:05.015707 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 323/654] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:05.016575 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512366c-48aa-4d9c-8fca-51dadfc648a4 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:05.089166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:05.131995 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512366c-48aa-4d9c-8fca-51dadfc648a4 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:05.145674 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:05.159335 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06be45-8051-403f-90a9-f67001794c7e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:05.175383 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3c850-5777-48b6-94fd-fabe7b53f606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:05.176503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3c850-5777-48b6-94fd-fabe7b53f606 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:05.177012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3c850-5777-48b6-94fd-fabe7b53f606 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:05.177526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3c850-5777-48b6-94fd-fabe7b53f606 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:05.185660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3c850-5777-48b6-94fd-fabe7b53f606 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:05.187409 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3c850-5777-48b6-94fd-fabe7b53f606 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:05.203013 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e98d1-7ca6-43e2-954e-4a12ef32470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:05.203701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-aba3c850-5777-48b6-94fd-fabe7b53f606 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 12:42:05.203701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:05.203701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:05.203701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:05.203701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:05.203701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:05.203701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:05.203701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:05.203701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:05.203701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:05.203701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:05.203701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:05.203701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:05.203701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:05.203701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:05.203701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:05.204743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:05.204743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:05.204743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:05.204743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:05.204743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:05.204743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:05.204743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:05.204743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:05.204743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:05.204743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:05.204743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:05.204743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:05.204743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:05.204743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:05.204743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:05.204743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:05.204743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:05.204743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:05.205711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:05.205711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:05.205711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:05.205711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:05.205711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:05.205711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:05.205711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:05.205711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:05.205711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 12:42:05.205711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:05.206250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e98d1-7ca6-43e2-954e-4a12ef32470d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:05.206250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e98d1-7ca6-43e2-954e-4a12ef32470d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:05.206250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e98d1-7ca6-43e2-954e-4a12ef32470d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:05.213064 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 324/655] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:42:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:05.214203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3c850-5777-48b6-94fd-fabe7b53f606 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:05.217640 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e98d1-7ca6-43e2-954e-4a12ef32470d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:05.219388 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e98d1-7ca6-43e2-954e-4a12ef32470d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:05.243103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-1e4e98d1-7ca6-43e2-954e-4a12ef32470d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:05.243103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:05.243103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:05.243103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:05.243103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:05.243103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:05.243103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:05.243103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:05.243103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:05.243103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:05.243103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:05.243103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:05.243103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:05.243103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:05.243103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:05.244082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:05.244082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:05.244082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:05.244082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:05.244082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:05.244082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:05.244082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:05.244082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:05.244082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:05.244082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:05.244082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:05.244082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:05.244082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:05.244082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:05.244082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:05.244082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:05.244082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:05.244986 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:05.244986 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:05.244986 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:05.244986 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:05.248662 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 332/656] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:05.249682 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e98d1-7ca6-43e2-954e-4a12ef32470d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:05.328929 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3c850-5777-48b6-94fd-fabe7b53f606 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:05.354999 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:05.367717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383ec1a-3ccc-44a3-a407-42b563bc9a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:05.369643 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383ec1a-3ccc-44a3-a407-42b563bc9a2f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:05.369643 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383ec1a-3ccc-44a3-a407-42b563bc9a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:05.369643 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383ec1a-3ccc-44a3-a407-42b563bc9a2f None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:05.370556 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383ec1a-3ccc-44a3-a407-42b563bc9a2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:05.371039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383ec1a-3ccc-44a3-a407-42b563bc9a2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:05.372794 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383ec1a-3ccc-44a3-a407-42b563bc9a2f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:05.375567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e98d1-7ca6-43e2-954e-4a12ef32470d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:05.385932 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 325/657] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:05.387056 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383ec1a-3ccc-44a3-a407-42b563bc9a2f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:05.423356 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b02c1-d753-4539-ac64-bfc9f109fa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:05.424039 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b02c1-d753-4539-ac64-bfc9f109fa1d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:05.424324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b02c1-d753-4539-ac64-bfc9f109fa1d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:05.424612 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b02c1-d753-4539-ac64-bfc9f109fa1d None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:05.425644 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b02c1-d753-4539-ac64-bfc9f109fa1d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:05.425991 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b02c1-d753-4539-ac64-bfc9f109fa1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:05.428229 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b02c1-d753-4539-ac64-bfc9f109fa1d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:05.454017 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 333/658] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jul 5 12:42:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:05.454017 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b02c1-d753-4539-ac64-bfc9f109fa1d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:05.454711 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:05.503427 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383ec1a-3ccc-44a3-a407-42b563bc9a2f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:05.541645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ab31b-5039-4f0d-881e-e130f1bd6a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:05.542723 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ab31b-5039-4f0d-881e-e130f1bd6a51 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:05.543237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ab31b-5039-4f0d-881e-e130f1bd6a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:05.543725 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ab31b-5039-4f0d-881e-e130f1bd6a51 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:05.544694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ab31b-5039-4f0d-881e-e130f1bd6a51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:05.545236 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ab31b-5039-4f0d-881e-e130f1bd6a51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:05.546957 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ab31b-5039-4f0d-881e-e130f1bd6a51 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:05.561209 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 326/659] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:05.562351 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ab31b-5039-4f0d-881e-e130f1bd6a51 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:05.577993 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b02c1-d753-4539-ac64-bfc9f109fa1d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:05.615527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916df1c-9f1f-425e-bd20-eb8b4669b9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:05.616291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916df1c-9f1f-425e-bd20-eb8b4669b9aa None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:05.616656 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916df1c-9f1f-425e-bd20-eb8b4669b9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:05.616939 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916df1c-9f1f-425e-bd20-eb8b4669b9aa None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:05.625313 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:05.626258 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916df1c-9f1f-425e-bd20-eb8b4669b9aa None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:05.627443 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916df1c-9f1f-425e-bd20-eb8b4669b9aa None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:05.643304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-b916df1c-9f1f-425e-bd20-eb8b4669b9aa None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 12:42:05.643304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:05.643304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:05.643304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:05.643304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:05.643304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:05.643304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:05.643304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:05.643304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:05.643304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:05.643304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:05.643304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:05.643304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:05.643304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:05.643304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:05.643304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:05.649510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:05.649510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:05.649510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:05.649510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:05.649510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:05.649510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:05.649510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:05.649510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:05.649510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:05.649510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:05.649510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:05.649510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:05.649510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:05.649510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:05.649510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:05.649510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:05.649510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:05.649510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:05.650468 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:05.650468 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:05.650468 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:05.650468 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:05.650468 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:05.650468 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:05.650468 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:05.650468 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:05.650468 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 12:42:05.650468 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:05.650468 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 334/660] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:42:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:05.650468 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916df1c-9f1f-425e-bd20-eb8b4669b9aa None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:05.696743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ab31b-5039-4f0d-881e-e130f1bd6a51 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:05.733238 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:05.734302 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5684a6-3588-4156-b2d6-58de814dfc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:05.735228 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5684a6-3588-4156-b2d6-58de814dfc13 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:05.735714 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5684a6-3588-4156-b2d6-58de814dfc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:05.736199 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5684a6-3588-4156-b2d6-58de814dfc13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:05.779821 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916df1c-9f1f-425e-bd20-eb8b4669b9aa None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:05.815538 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562db578-8b6a-487e-9a7f-e82e92c797d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:05.817599 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562db578-8b6a-487e-9a7f-e82e92c797d0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:05.818087 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562db578-8b6a-487e-9a7f-e82e92c797d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:05.818614 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562db578-8b6a-487e-9a7f-e82e92c797d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:05.825907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562db578-8b6a-487e-9a7f-e82e92c797d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:05.827760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562db578-8b6a-487e-9a7f-e82e92c797d0 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:05.827872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5684a6-3588-4156-b2d6-58de814dfc13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:05.829275 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5684a6-3588-4156-b2d6-58de814dfc13 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:05.843180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-562db578-8b6a-487e-9a7f-e82e92c797d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:05.843180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:05.843180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:05.843180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:05.843180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:05.843180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:05.843180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:05.843180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:05.843180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:05.843180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:05.843180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:05.843180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:05.843180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:05.843180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:05.843180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:05.844092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:05.844092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:05.844092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:05.844092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:05.844092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:05.844092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:05.844092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:05.844092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:05.844092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:05.844092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:05.844092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:05.844092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:05.844092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:05.844092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:05.844092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:05.844092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:05.844092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:05.845120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:05.845120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:05.845120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:05.845120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:05.845120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:05.845120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:05.845120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:05.845120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:05.847281 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 335/661] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:05.848791 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562db578-8b6a-487e-9a7f-e82e92c797d0 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:05.889549 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:05.958003 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562db578-8b6a-487e-9a7f-e82e92c797d0 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:05.968791 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 327/662] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:42:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:42:05.969647 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5684a6-3588-4156-b2d6-58de814dfc13 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:05.986394 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:05.998388 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0b3d7-5747-48d2-bd39-0a9a333c5e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:05.999059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0b3d7-5747-48d2-bd39-0a9a333c5e04 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:05.999339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0b3d7-5747-48d2-bd39-0a9a333c5e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:05.999613 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0b3d7-5747-48d2-bd39-0a9a333c5e04 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:06.000448 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0b3d7-5747-48d2-bd39-0a9a333c5e04 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:06.001055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0b3d7-5747-48d2-bd39-0a9a333c5e04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:06.002308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0b3d7-5747-48d2-bd39-0a9a333c5e04 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:06.024776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 336/663] 10.222.0.36 () {56 vars in 1139 bytes} [Tue Jul 5 12:42:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:06.024776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27939f35-a5f2-490e-b424-571d7df702c9 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:06.024776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27939f35-a5f2-490e-b424-571d7df702c9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:06.024776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27939f35-a5f2-490e-b424-571d7df702c9 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:06.024776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 337/664] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:06.024776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27939f35-a5f2-490e-b424-571d7df702c9 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:06.084952 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5684a6-3588-4156-b2d6-58de814dfc13 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:06.118917 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c5c65-5e25-4b10-b6ec-c5c0141464e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:06.119610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c5c65-5e25-4b10-b6ec-c5c0141464e5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:06.119844 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c5c65-5e25-4b10-b6ec-c5c0141464e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:06.120130 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c5c65-5e25-4b10-b6ec-c5c0141464e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:06.121016 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c5c65-5e25-4b10-b6ec-c5c0141464e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:06.121316 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c5c65-5e25-4b10-b6ec-c5c0141464e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:06.122750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c5c65-5e25-4b10-b6ec-c5c0141464e5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:06.135175 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 328/665] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:06.135829 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c5c65-5e25-4b10-b6ec-c5c0141464e5 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:06.138371 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:06.158070 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27939f35-a5f2-490e-b424-571d7df702c9 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:06.183572 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47918c71-2da3-4340-a1bc-7cc03367244d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:06.184411 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47918c71-2da3-4340-a1bc-7cc03367244d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:06.184718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47918c71-2da3-4340-a1bc-7cc03367244d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:06.184989 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47918c71-2da3-4340-a1bc-7cc03367244d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:06.196472 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47918c71-2da3-4340-a1bc-7cc03367244d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:06.197980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47918c71-2da3-4340-a1bc-7cc03367244d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:06.215610 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-47918c71-2da3-4340-a1bc-7cc03367244d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:06.215610 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:06.215610 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:06.215610 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:06.215610 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:06.215610 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:06.215610 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:06.215610 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:06.215610 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:06.215610 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:06.215610 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:06.215610 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:06.215610 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:06.215610 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:06.215610 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:06.216503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:06.216503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:06.216503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:06.216503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:06.216503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:06.216503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:06.216503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:06.216503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:06.216503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:06.216503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:06.216503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:06.216503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:06.216503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:06.216503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:06.216503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:06.216503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:06.216503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:06.217446 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:06.217446 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:06.217446 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:06.217446 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:06.217446 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 338/666] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:06.218463 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26be1d-2438-49c9-a0cb-0dd9c7d08b52 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:06.218608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26be1d-2438-49c9-a0cb-0dd9c7d08b52 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:06.218819 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26be1d-2438-49c9-a0cb-0dd9c7d08b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:06.236412 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-0e26be1d-2438-49c9-a0cb-0dd9c7d08b52 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:06.237655 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0e26be1d-2438-49c9-a0cb-0dd9c7d08b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:06.246385 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c5c65-5e25-4b10-b6ec-c5c0141464e5 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:06.266885 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:06.283040 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb3f7c-3a53-4133-91a1-4c84e0f17ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:06.283682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb3f7c-3a53-4133-91a1-4c84e0f17ded None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:06.284007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb3f7c-3a53-4133-91a1-4c84e0f17ded None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:06.284272 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb3f7c-3a53-4133-91a1-4c84e0f17ded None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:06.312677 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 339/667] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:42:06.313677 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26be1d-2438-49c9-a0cb-0dd9c7d08b52 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:06.368537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb3f7c-3a53-4133-91a1-4c84e0f17ded None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:06.370015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb3f7c-3a53-4133-91a1-4c84e0f17ded None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:06.372249 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:06.421326 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26be1d-2438-49c9-a0cb-0dd9c7d08b52 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:06.458975 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b082d61-5546-4acd-8ce8-6fa6d8adf72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:06.459754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b082d61-5546-4acd-8ce8-6fa6d8adf72e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:06.460038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b082d61-5546-4acd-8ce8-6fa6d8adf72e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:06.460430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b082d61-5546-4acd-8ce8-6fa6d8adf72e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:06.461315 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b082d61-5546-4acd-8ce8-6fa6d8adf72e None admin] RBAC: Adding query filter params (role.id=fb140b8a852547a5b8f339dce8d3440e, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=7e7c4b0bd50c474996a21b69bde4e227) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:06.461630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b082d61-5546-4acd-8ce8-6fa6d8adf72e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:06.463219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b082d61-5546-4acd-8ce8-6fa6d8adf72e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:06.476613 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 329/668] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:42:06.476786 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 340/669] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:42:06 2022] GET /identity/v3/role_assignments?user.id=7e7c4b0bd50c474996a21b69bde4e227&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=fb140b8a852547a5b8f339dce8d3440e => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:06.476903 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb3f7c-3a53-4133-91a1-4c84e0f17ded None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:06.476993 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b082d61-5546-4acd-8ce8-6fa6d8adf72e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:06.514085 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:06.600028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b082d61-5546-4acd-8ce8-6fa6d8adf72e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:06.616418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb3f7c-3a53-4133-91a1-4c84e0f17ded None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:06.618485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:06.637804 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c1993-5362-4ca6-9647-193fa3c81961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:06.638611 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c1993-5362-4ca6-9647-193fa3c81961 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:06.638914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c1993-5362-4ca6-9647-193fa3c81961 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:06.639173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c1993-5362-4ca6-9647-193fa3c81961 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:06.653344 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c1993-5362-4ca6-9647-193fa3c81961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:06.658117 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739e4c4-0263-4a14-a75c-f81d807bfc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:06.659052 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739e4c4-0263-4a14-a75c-f81d807bfc7e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:06.660358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739e4c4-0263-4a14-a75c-f81d807bfc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:06.660755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-ff5c1993-5362-4ca6-9647-193fa3c81961 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:42:06.660755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:06.660755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:06.660755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:06.660755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:06.660755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:06.660755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:06.660755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:06.660755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:06.660755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:06.660755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:06.660755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:06.660755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:06.660755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:06.660755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:06.660755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:06.661665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:06.661665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:06.661665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:06.661665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:06.661665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:06.661665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:06.661665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:06.661665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:06.661665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:06.661665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:06.661665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:06.661665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:06.661665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:06.661665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:06.661665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:06.661665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:06.662507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:06.662507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:06.662507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:06.662507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:06.662507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:06.662507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:06.662507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:06.662507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:06.662507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:06.662507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:06.662507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:42:06.662507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:06.662507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 341/670] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:42:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:06.663196 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c1993-5362-4ca6-9647-193fa3c81961 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:06.663839 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739e4c4-0263-4a14-a75c-f81d807bfc7e None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:06.664858 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739e4c4-0263-4a14-a75c-f81d807bfc7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:06.665325 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739e4c4-0263-4a14-a75c-f81d807bfc7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:06.666861 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739e4c4-0263-4a14-a75c-f81d807bfc7e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:06.680378 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 330/671] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:06.681658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99f3f4-7b7d-43ff-9b74-0257a039e656 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:06.681937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99f3f4-7b7d-43ff-9b74-0257a039e656 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:06.682221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99f3f4-7b7d-43ff-9b74-0257a039e656 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:06.683727 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 331/672] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:06.684328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99f3f4-7b7d-43ff-9b74-0257a039e656 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:06.761810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:06.778060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c1993-5362-4ca6-9647-193fa3c81961 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:06.798456 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99f3f4-7b7d-43ff-9b74-0257a039e656 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:06.816226 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1353a6-e92f-4040-a27c-578c017e6803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:06.817956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1353a6-e92f-4040-a27c-578c017e6803 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:06.818240 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1353a6-e92f-4040-a27c-578c017e6803 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:06.818567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1353a6-e92f-4040-a27c-578c017e6803 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:06.829824 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1353a6-e92f-4040-a27c-578c017e6803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:06.831378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1353a6-e92f-4040-a27c-578c017e6803 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:06.835097 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a5c7c-dfe3-46b7-91f9-437bbd5aad10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:06.835770 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a5c7c-dfe3-46b7-91f9-437bbd5aad10 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:06.836060 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a5c7c-dfe3-46b7-91f9-437bbd5aad10 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:06.836339 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a5c7c-dfe3-46b7-91f9-437bbd5aad10 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:06.837120 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a5c7c-dfe3-46b7-91f9-437bbd5aad10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:06.837431 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a5c7c-dfe3-46b7-91f9-437bbd5aad10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:06.838808 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a5c7c-dfe3-46b7-91f9-437bbd5aad10 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:06.848060 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 332/673] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:42:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:06.850120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-ff1353a6-e92f-4040-a27c-578c017e6803 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:06.850120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:06.850120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:06.850120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:06.850120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:06.850120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:06.850120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:06.850120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:06.850120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:06.850120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:06.850120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:06.850120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:06.850120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:06.850120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:06.850120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:06.851236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:06.851236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:06.851236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:06.851236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:06.851236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:06.851236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:06.851236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:06.851236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:06.851236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:06.851236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:06.851236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:06.851236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:06.851236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:06.851236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:06.851236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:06.851236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:06.851236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:06.852313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:06.852313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:06.852313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:06.852313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:06.852971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 342/674] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:06.853412 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a5c7c-dfe3-46b7-91f9-437bbd5aad10 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:06.854076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a5732-07fd-4b3b-b9a2-8dc954ea750f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:06.854360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a5732-07fd-4b3b-b9a2-8dc954ea750f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:06.854640 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a5732-07fd-4b3b-b9a2-8dc954ea750f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:06.871445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-474a5732-07fd-4b3b-b9a2-8dc954ea750f None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:06.872618 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-474a5732-07fd-4b3b-b9a2-8dc954ea750f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:06.884994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:06.946835 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 343/675] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:42:06.947601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a5732-07fd-4b3b-b9a2-8dc954ea750f None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:06.973164 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a5c7c-dfe3-46b7-91f9-437bbd5aad10 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:07.011264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a08be-1798-4d10-a280-5bf80d553674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:07.012149 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a08be-1798-4d10-a280-5bf80d553674 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:07.012328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a08be-1798-4d10-a280-5bf80d553674 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:07.012626 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a08be-1798-4d10-a280-5bf80d553674 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:07.018328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:07.019612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a08be-1798-4d10-a280-5bf80d553674 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:07.021113 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a08be-1798-4d10-a280-5bf80d553674 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:07.036754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-d76a08be-1798-4d10-a280-5bf80d553674 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:07.036754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:07.036754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:07.036754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:07.036754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:07.036754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:07.036754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:07.036754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:07.036754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:07.036754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:07.036754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:07.036754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:07.036754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:07.036754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:07.036754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:07.037699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:07.037699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:07.037699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:07.037699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:07.037699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:07.037699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:07.037699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:07.037699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:07.037699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:07.037699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:07.037699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:07.037699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:07.037699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:07.037699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:07.037699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:07.037699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:07.037699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:07.038606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:07.038606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:07.038606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:07.038606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:07.038606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:07.038606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:07.038606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:07.038606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:07.038606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 333/676] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:07.039099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a08be-1798-4d10-a280-5bf80d553674 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:07.066307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a5732-07fd-4b3b-b9a2-8dc954ea750f None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:07.103563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacff56d-324f-46a1-ba46-a786bab9ff9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:07.104367 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacff56d-324f-46a1-ba46-a786bab9ff9f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:07.104690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacff56d-324f-46a1-ba46-a786bab9ff9f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:07.104973 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacff56d-324f-46a1-ba46-a786bab9ff9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:07.116281 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacff56d-324f-46a1-ba46-a786bab9ff9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:07.117775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacff56d-324f-46a1-ba46-a786bab9ff9f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:07.130262 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:07.135129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-cacff56d-324f-46a1-ba46-a786bab9ff9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:07.135129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:07.135129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:07.135129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:07.135129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:07.135129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:07.135129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:07.135129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:07.135129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:07.135129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:07.135129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:07.135129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:07.135129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:07.135129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:07.135129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:07.136060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:07.136060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:07.136060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:07.136060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:07.136060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:07.136060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:07.136060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:07.136060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:07.136060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:07.136060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:07.136060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:07.136060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:07.136060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:07.136060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:07.136060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:07.136060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:07.136060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:07.142489 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:07.142489 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:07.142489 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:07.142489 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:07.142489 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 344/677] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:07.142489 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacff56d-324f-46a1-ba46-a786bab9ff9f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:07.152109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a08be-1798-4d10-a280-5bf80d553674 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:07.189007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e0ac9-5f4a-4d47-9d7f-05a425730964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:07.189835 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e0ac9-5f4a-4d47-9d7f-05a425730964 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:07.189946 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e0ac9-5f4a-4d47-9d7f-05a425730964 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:07.190203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e0ac9-5f4a-4d47-9d7f-05a425730964 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:07.190918 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e0ac9-5f4a-4d47-9d7f-05a425730964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:07.191223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e0ac9-5f4a-4d47-9d7f-05a425730964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:07.193118 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e0ac9-5f4a-4d47-9d7f-05a425730964 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:07.206282 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 334/678] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:07.208381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e0ac9-5f4a-4d47-9d7f-05a425730964 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:07.245064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacff56d-324f-46a1-ba46-a786bab9ff9f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:07.268811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:07.283828 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b639807-3fea-42b0-ac14-97b799854160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:07.284650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b639807-3fea-42b0-ac14-97b799854160 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:07.284931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b639807-3fea-42b0-ac14-97b799854160 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:07.285232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b639807-3fea-42b0-ac14-97b799854160 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:07.296823 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b639807-3fea-42b0-ac14-97b799854160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:07.305785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-3b639807-3fea-42b0-ac14-97b799854160 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:07.305785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:07.305785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:07.305785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:07.305785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:07.305785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:07.305785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:07.305785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:07.305785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:07.305785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:07.305785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:07.305785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:07.305785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:07.305785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:07.305785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:07.305785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:07.306719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:07.306719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:07.306719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:07.306719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:07.306719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:07.306719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:07.306719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:07.306719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:07.306719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:07.306719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:07.306719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:07.306719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:07.306719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:07.306719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:07.306719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:07.306719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:07.313195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:07.313195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:07.313195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:07.313195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:07.313195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:07.313195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:07.313195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:07.313195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:07.313195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:07.313195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:07.313195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:07.313195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:07.313195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 345/679] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:42:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:07.313195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b639807-3fea-42b0-ac14-97b799854160 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:07.326041 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e0ac9-5f4a-4d47-9d7f-05a425730964 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:07.362333 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746d433-4693-4eab-8f61-1a29a8a276f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:07.362961 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746d433-4693-4eab-8f61-1a29a8a276f2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:07.363251 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746d433-4693-4eab-8f61-1a29a8a276f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:07.363539 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746d433-4693-4eab-8f61-1a29a8a276f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:07.364321 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746d433-4693-4eab-8f61-1a29a8a276f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:07.364656 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746d433-4693-4eab-8f61-1a29a8a276f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:07.366095 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746d433-4693-4eab-8f61-1a29a8a276f2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:07.385791 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 335/680] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:07.386051 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746d433-4693-4eab-8f61-1a29a8a276f2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:07.390220 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:07.416158 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b639807-3fea-42b0-ac14-97b799854160 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:07.452040 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a712143-bff7-49ba-8837-bc66de995786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:07.452728 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a712143-bff7-49ba-8837-bc66de995786 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:07.453012 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a712143-bff7-49ba-8837-bc66de995786 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:07.453291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a712143-bff7-49ba-8837-bc66de995786 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:07.454003 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a712143-bff7-49ba-8837-bc66de995786 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:07.454312 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a712143-bff7-49ba-8837-bc66de995786 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:07.455681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a712143-bff7-49ba-8837-bc66de995786 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:07.467773 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 346/681] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:07.468334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a712143-bff7-49ba-8837-bc66de995786 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:07.494145 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746d433-4693-4eab-8f61-1a29a8a276f2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:07.514439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:07.528799 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81900c19-3caf-45ed-bcc4-f59265f68fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:07.529673 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81900c19-3caf-45ed-bcc4-f59265f68fcb None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:07.529969 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81900c19-3caf-45ed-bcc4-f59265f68fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:07.538563 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81900c19-3caf-45ed-bcc4-f59265f68fcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:07.538563 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81900c19-3caf-45ed-bcc4-f59265f68fcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:07.538750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81900c19-3caf-45ed-bcc4-f59265f68fcb None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:07.553822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-81900c19-3caf-45ed-bcc4-f59265f68fcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:07.553822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:07.553822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:07.553822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:07.553822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:07.553822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:07.553822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:07.553822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:07.553822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:07.553822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:07.553822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:07.553822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:07.553822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:07.553822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:07.553822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:07.554766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:07.554766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:07.554766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:07.554766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:07.554766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:07.554766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:07.554766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:07.554766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:07.554766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:07.554766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:07.554766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:07.554766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:07.554766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:07.554766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:07.554766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:07.554766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:07.554766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:07.555730 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:07.555730 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:07.555730 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:07.555730 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:07.555730 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:07.555730 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:07.555730 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:07.555730 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:07.559647 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 336/682] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:07.560488 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81900c19-3caf-45ed-bcc4-f59265f68fcb None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:07.577861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a712143-bff7-49ba-8837-bc66de995786 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:07.612554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d815b8a-08f3-42d4-b06e-7aedc0f2dffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:07.613766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815b8a-08f3-42d4-b06e-7aedc0f2dffd None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:07.614055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815b8a-08f3-42d4-b06e-7aedc0f2dffd None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:07.614331 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815b8a-08f3-42d4-b06e-7aedc0f2dffd None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:07.615066 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d815b8a-08f3-42d4-b06e-7aedc0f2dffd None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:07.615373 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d815b8a-08f3-42d4-b06e-7aedc0f2dffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:07.616773 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d815b8a-08f3-42d4-b06e-7aedc0f2dffd None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:07.623717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:07.629747 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 347/683] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jul 5 12:42:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:07.629747 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d815b8a-08f3-42d4-b06e-7aedc0f2dffd None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:07.666366 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81900c19-3caf-45ed-bcc4-f59265f68fcb None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:07.705546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692a843-a2ac-4117-92b1-3681ebaf5e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:07.706202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692a843-a2ac-4117-92b1-3681ebaf5e48 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:07.706488 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692a843-a2ac-4117-92b1-3681ebaf5e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:07.706760 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692a843-a2ac-4117-92b1-3681ebaf5e48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:07.707798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692a843-a2ac-4117-92b1-3681ebaf5e48 None admin] RBAC: Adding query filter params (role.id=fb140b8a852547a5b8f339dce8d3440e, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=4bb924cdb5aa48ba9dfcc7be7e912991) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:07.708119 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692a843-a2ac-4117-92b1-3681ebaf5e48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:07.709581 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692a843-a2ac-4117-92b1-3681ebaf5e48 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:07.727842 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 337/684] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:42:07 2022] GET /identity/v3/role_assignments?user.id=4bb924cdb5aa48ba9dfcc7be7e912991&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=fb140b8a852547a5b8f339dce8d3440e => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:07.727842 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692a843-a2ac-4117-92b1-3681ebaf5e48 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:07.762390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d815b8a-08f3-42d4-b06e-7aedc0f2dffd None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:07.764708 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:07.816893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2f898-cb56-49a6-aaed-8af3dc0789dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:07.817711 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2f898-cb56-49a6-aaed-8af3dc0789dd None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:07.817990 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2f898-cb56-49a6-aaed-8af3dc0789dd None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:07.818261 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2f898-cb56-49a6-aaed-8af3dc0789dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:07.827733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2f898-cb56-49a6-aaed-8af3dc0789dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:07.829507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2f898-cb56-49a6-aaed-8af3dc0789dd None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:07.845439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-2ec2f898-cb56-49a6-aaed-8af3dc0789dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:42:07.845439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:07.845439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:07.845439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:07.845439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:07.845439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:07.845439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:07.845439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:07.845439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:07.845439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:07.845439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:07.845439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:07.845439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:07.845439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:07.845439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:07.845439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:07.846653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:07.846653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:07.846653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:07.846653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:07.846653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:07.846653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:07.846653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:07.846653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:07.846653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:07.846653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:07.846653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:07.846653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:07.846653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:07.846653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:07.846653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:07.846653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:07.846653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:07.846653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:07.848378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:07.848378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:07.848378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:07.848378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:07.848378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:07.848378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:07.848378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:07.848378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:07.848378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:42:07.848378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:07.848378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 348/685] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jul 5 12:42:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:07.848378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2f898-cb56-49a6-aaed-8af3dc0789dd None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:07.856311 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692a843-a2ac-4117-92b1-3681ebaf5e48 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:07.900068 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:07.913722 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4e8e6-d8cf-48be-b19d-306991daf955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:07.914386 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4e8e6-d8cf-48be-b19d-306991daf955 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:07.914781 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4e8e6-d8cf-48be-b19d-306991daf955 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:07.916330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4e8e6-d8cf-48be-b19d-306991daf955 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:07.916330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4e8e6-d8cf-48be-b19d-306991daf955 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:07.916330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4e8e6-d8cf-48be-b19d-306991daf955 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:07.917956 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4e8e6-d8cf-48be-b19d-306991daf955 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:07.932697 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 338/686] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:07.933527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4e8e6-d8cf-48be-b19d-306991daf955 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:07.971393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2f898-cb56-49a6-aaed-8af3dc0789dd None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:08.013349 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32650cbe-c62c-4631-8645-bac4baec1393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:08.014069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32650cbe-c62c-4631-8645-bac4baec1393 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:08.014358 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32650cbe-c62c-4631-8645-bac4baec1393 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:08.014641 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32650cbe-c62c-4631-8645-bac4baec1393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:08.030613 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32650cbe-c62c-4631-8645-bac4baec1393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:08.032911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32650cbe-c62c-4631-8645-bac4baec1393 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:08.051659 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4e8e6-d8cf-48be-b19d-306991daf955 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:08.052038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-32650cbe-c62c-4631-8645-bac4baec1393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:08.052038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:08.052038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:08.052038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:08.052038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:08.052038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:08.052038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:08.052038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:08.052038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:08.052038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:08.052038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:08.052038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:08.052038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:08.052038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:08.052038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:08.052935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:08.052935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:08.052935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:08.052935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:08.052935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:08.052935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:08.052935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:08.052935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:08.052935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:08.052935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:08.052935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:08.052935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:08.052935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:08.052935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:08.052935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:08.052935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:08.052935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:08.053868 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:08.053868 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:08.053868 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:08.053868 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:08.053868 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 349/687] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:08.054551 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32650cbe-c62c-4631-8645-bac4baec1393 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:08.074747 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:08.101804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418320ef-f9f1-4a49-bce9-1be85c61ff80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:08.103098 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418320ef-f9f1-4a49-bce9-1be85c61ff80 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:08.103538 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418320ef-f9f1-4a49-bce9-1be85c61ff80 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:08.104090 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418320ef-f9f1-4a49-bce9-1be85c61ff80 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:08.106528 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418320ef-f9f1-4a49-bce9-1be85c61ff80 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:08.107024 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418320ef-f9f1-4a49-bce9-1be85c61ff80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:08.108920 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418320ef-f9f1-4a49-bce9-1be85c61ff80 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:08.136641 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 339/688] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jul 5 12:42:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:08.137471 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418320ef-f9f1-4a49-bce9-1be85c61ff80 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:08.183093 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32650cbe-c62c-4631-8645-bac4baec1393 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:08.188521 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:08.229432 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06704e5-4344-414a-adbd-93380f483bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:08.230694 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06704e5-4344-414a-adbd-93380f483bbb None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:08.231520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06704e5-4344-414a-adbd-93380f483bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:08.231957 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06704e5-4344-414a-adbd-93380f483bbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:08.233186 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06704e5-4344-414a-adbd-93380f483bbb None admin] RBAC: Adding query filter params (role.id=fb140b8a852547a5b8f339dce8d3440e, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=07ab8f60c4ff4969a277b33dca05e685) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:08.233658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06704e5-4344-414a-adbd-93380f483bbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:08.235847 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06704e5-4344-414a-adbd-93380f483bbb None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:08.243749 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 350/689] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:42:08 2022] GET /identity/v3/role_assignments?user.id=07ab8f60c4ff4969a277b33dca05e685&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=fb140b8a852547a5b8f339dce8d3440e => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:08.245254 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06704e5-4344-414a-adbd-93380f483bbb None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:08.255469 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418320ef-f9f1-4a49-bce9-1be85c61ff80 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:08.301996 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107ec9f-0279-4693-8084-360fd2eea865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:08.303717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107ec9f-0279-4693-8084-360fd2eea865 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:08.304178 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107ec9f-0279-4693-8084-360fd2eea865 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:08.304640 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107ec9f-0279-4693-8084-360fd2eea865 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:08.306173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107ec9f-0279-4693-8084-360fd2eea865 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:08.306663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107ec9f-0279-4693-8084-360fd2eea865 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:08.309000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107ec9f-0279-4693-8084-360fd2eea865 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:08.326443 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 340/690] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:08.331643 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107ec9f-0279-4693-8084-360fd2eea865 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:08.346746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:08.373842 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06704e5-4344-414a-adbd-93380f483bbb None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:08.412982 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70618c57-f2cf-4870-a164-dc68d10d8c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:08.413929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70618c57-f2cf-4870-a164-dc68d10d8c49 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:08.414312 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70618c57-f2cf-4870-a164-dc68d10d8c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:08.415053 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70618c57-f2cf-4870-a164-dc68d10d8c49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:08.459020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107ec9f-0279-4693-8084-360fd2eea865 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:08.466935 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:08.493942 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70618c57-f2cf-4870-a164-dc68d10d8c49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:08.495802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ee877-6aa2-4198-8dbc-5335e74720a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:08.496072 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70618c57-f2cf-4870-a164-dc68d10d8c49 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:08.496631 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ee877-6aa2-4198-8dbc-5335e74720a8 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:08.496927 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ee877-6aa2-4198-8dbc-5335e74720a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:08.497210 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ee877-6aa2-4198-8dbc-5335e74720a8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:08.506356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ee877-6aa2-4198-8dbc-5335e74720a8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:08.507511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ee877-6aa2-4198-8dbc-5335e74720a8 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:08.523658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-674ee877-6aa2-4198-8dbc-5335e74720a8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:42:08.523658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:08.523658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:08.523658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:08.523658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:08.523658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:08.523658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:08.523658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:08.523658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:08.523658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:08.523658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:08.523658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:08.523658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:08.523658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:08.523658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:08.523658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:08.524693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:08.524693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:08.524693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:08.524693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:08.524693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:08.524693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:08.524693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:08.524693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:08.524693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:08.524693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:08.524693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:08.524693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:08.524693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:08.524693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:08.524693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:08.524693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:08.524693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:08.524693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:08.525704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:08.525704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:08.525704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:08.525704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:08.525704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:08.525704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:08.525704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:08.525704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:08.525704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:42:08.525704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:08.525704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 341/691] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:42:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:08.530579 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ee877-6aa2-4198-8dbc-5335e74720a8 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:08.603988 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:08.638696 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 351/692] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:42:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:42:08.645733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70618c57-f2cf-4870-a164-dc68d10d8c49 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:08.674983 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ee877-6aa2-4198-8dbc-5335e74720a8 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:08.714269 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31b271-5b2c-493d-bbdf-ae1022354a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:08.714979 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31b271-5b2c-493d-bbdf-ae1022354a56 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:08.715264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31b271-5b2c-493d-bbdf-ae1022354a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:08.715545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31b271-5b2c-493d-bbdf-ae1022354a56 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:08.716390 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31b271-5b2c-493d-bbdf-ae1022354a56 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:08.716728 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31b271-5b2c-493d-bbdf-ae1022354a56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:08.718377 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31b271-5b2c-493d-bbdf-ae1022354a56 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:08.739878 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 342/693] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jul 5 12:42:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:08.745116 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31b271-5b2c-493d-bbdf-ae1022354a56 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:08.774566 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:08.778807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70618c57-f2cf-4870-a164-dc68d10d8c49 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:08.824636 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe10d5-db29-4813-96e9-2aa52cb0adce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:08.824636 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe10d5-db29-4813-96e9-2aa52cb0adce None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:08.824946 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe10d5-db29-4813-96e9-2aa52cb0adce None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:08.825207 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe10d5-db29-4813-96e9-2aa52cb0adce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:08.836510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe10d5-db29-4813-96e9-2aa52cb0adce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:08.838001 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe10d5-db29-4813-96e9-2aa52cb0adce None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:08.856933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-9bbe10d5-db29-4813-96e9-2aa52cb0adce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:08.856933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:08.856933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:08.856933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:08.856933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:08.856933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:08.856933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:08.856933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:08.856933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:08.856933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:08.856933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:08.856933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:08.856933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:08.856933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:08.856933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:08.858060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:08.858060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:08.858060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:08.858060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:08.858060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:08.858060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:08.858060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:08.858060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:08.858060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:08.858060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:08.858060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:08.858060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:08.858060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:08.858060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:08.858060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:08.858060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:08.858060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:08.859334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:08.859334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:08.859334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:08.859334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:08.859334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 352/694] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:08.859672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc39fb-ced0-438c-8b1d-139b4561db39 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:08.859889 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc39fb-ced0-438c-8b1d-139b4561db39 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:08.860172 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc39fb-ced0-438c-8b1d-139b4561db39 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:08.861766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 353/695] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:08.866740 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc39fb-ced0-438c-8b1d-139b4561db39 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:08.869712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31b271-5b2c-493d-bbdf-ae1022354a56 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:08.905002 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:08.912493 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303ec36-0353-4704-81bb-b4ac72caf65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:08.913539 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303ec36-0353-4704-81bb-b4ac72caf65c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:08.913971 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303ec36-0353-4704-81bb-b4ac72caf65c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:08.914406 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303ec36-0353-4704-81bb-b4ac72caf65c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:08.993996 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303ec36-0353-4704-81bb-b4ac72caf65c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:08.995485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303ec36-0353-4704-81bb-b4ac72caf65c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:09.002601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc39fb-ced0-438c-8b1d-139b4561db39 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:09.022434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:09.052402 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af0804-0431-4d79-b7b4-0e1de5cdfcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:09.055892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af0804-0431-4d79-b7b4-0e1de5cdfcc7 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:09.056176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af0804-0431-4d79-b7b4-0e1de5cdfcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:09.056453 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af0804-0431-4d79-b7b4-0e1de5cdfcc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:09.057214 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af0804-0431-4d79-b7b4-0e1de5cdfcc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:09.057525 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af0804-0431-4d79-b7b4-0e1de5cdfcc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:09.059002 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af0804-0431-4d79-b7b4-0e1de5cdfcc7 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:09.075537 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 354/696] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:09.077083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f1219-4f44-419e-b30d-db84aafa2c12 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:09.077618 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f1219-4f44-419e-b30d-db84aafa2c12 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:09.077854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f1219-4f44-419e-b30d-db84aafa2c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:09.094128 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-852f1219-4f44-419e-b30d-db84aafa2c12 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:09.095499 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-852f1219-4f44-419e-b30d-db84aafa2c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:09.126610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 343/697] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:42:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 12:42:09.127686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303ec36-0353-4704-81bb-b4ac72caf65c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:09.176694 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 355/698] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:42:09.178592 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f1219-4f44-419e-b30d-db84aafa2c12 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:09.215021 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:09.265359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303ec36-0353-4704-81bb-b4ac72caf65c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:09.291534 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:09.303411 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5f4da-89d7-4d33-b25b-4dc0bdc4166f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:09.304487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5f4da-89d7-4d33-b25b-4dc0bdc4166f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:09.304970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5f4da-89d7-4d33-b25b-4dc0bdc4166f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:09.307617 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5f4da-89d7-4d33-b25b-4dc0bdc4166f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:09.312692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5f4da-89d7-4d33-b25b-4dc0bdc4166f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:09.314313 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5f4da-89d7-4d33-b25b-4dc0bdc4166f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:09.320916 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f1219-4f44-419e-b30d-db84aafa2c12 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:09.329123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-d6a5f4da-89d7-4d33-b25b-4dc0bdc4166f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:09.329123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:09.329123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:09.329123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:09.329123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:09.329123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:09.329123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:09.329123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:09.329123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:09.329123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:09.329123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:09.329123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:09.329123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:09.329123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:09.329123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:09.330133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:09.330133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:09.330133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:09.330133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:09.330133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:09.330133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:09.330133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:09.330133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:09.330133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:09.330133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:09.330133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:09.330133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:09.330133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:09.330133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:09.330133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:09.330133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:09.330133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:09.331022 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:09.331022 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:09.331022 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:09.331022 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:09.331022 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:09.331022 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:09.331022 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:09.331022 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:09.331437 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 344/699] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:09.335924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5f4da-89d7-4d33-b25b-4dc0bdc4166f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:09.366429 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20edbb9-4177-4915-aaf8-0571905b9081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:09.367639 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20edbb9-4177-4915-aaf8-0571905b9081 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:09.367927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20edbb9-4177-4915-aaf8-0571905b9081 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:09.368467 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20edbb9-4177-4915-aaf8-0571905b9081 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:09.383339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20edbb9-4177-4915-aaf8-0571905b9081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:09.386798 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20edbb9-4177-4915-aaf8-0571905b9081 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:09.412360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-b20edbb9-4177-4915-aaf8-0571905b9081 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:09.412360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:09.412360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:09.412360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:09.412360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:09.412360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:09.412360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:09.412360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:09.412360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:09.412360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:09.412360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:09.412360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:09.412360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:09.412360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:09.412360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:09.414170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:09.414170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:09.414170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:09.414170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:09.414170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:09.414170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:09.414170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:09.414170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:09.414170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:09.414170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:09.414170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:09.414170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:09.414170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:09.414170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:09.414170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:09.414170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:09.414170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:09.415976 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:09.415976 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:09.415976 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:09.415976 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:09.415976 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 356/700] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:09.415976 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20edbb9-4177-4915-aaf8-0571905b9081 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:09.455467 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5f4da-89d7-4d33-b25b-4dc0bdc4166f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:09.495199 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:09.512026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fe108-693d-47d8-af27-27c25f7d500a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:09.512884 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fe108-693d-47d8-af27-27c25f7d500a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:09.513219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fe108-693d-47d8-af27-27c25f7d500a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:09.513500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fe108-693d-47d8-af27-27c25f7d500a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:09.526755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20edbb9-4177-4915-aaf8-0571905b9081 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:09.528831 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fe108-693d-47d8-af27-27c25f7d500a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:09.531105 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fe108-693d-47d8-af27-27c25f7d500a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:09.557093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-fd7fe108-693d-47d8-af27-27c25f7d500a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:09.557093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:09.557093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:09.557093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:09.557093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:09.557093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:09.557093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:09.557093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:09.557093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:09.557093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:09.557093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:09.557093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:09.557093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:09.557093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:09.557093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:09.558380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:09.558380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:09.558380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:09.558380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:09.558380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:09.558380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:09.558380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:09.558380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:09.558380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:09.558380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:09.558380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:09.558380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:09.558380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:09.558380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:09.558380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:09.558380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:09.558380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:09.559862 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:09.559862 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:09.559862 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:09.559862 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:09.564675 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 345/701] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:09.564675 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fe108-693d-47d8-af27-27c25f7d500a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:09.577636 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b0968-b3d5-4841-a7ee-5353309c73c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:09.578438 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b0968-b3d5-4841-a7ee-5353309c73c2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:09.579060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b0968-b3d5-4841-a7ee-5353309c73c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:09.579466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b0968-b3d5-4841-a7ee-5353309c73c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:09.581145 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b0968-b3d5-4841-a7ee-5353309c73c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:09.581469 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b0968-b3d5-4841-a7ee-5353309c73c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:09.583676 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b0968-b3d5-4841-a7ee-5353309c73c2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:09.601603 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:09.603813 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 357/702] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:09.605012 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b0968-b3d5-4841-a7ee-5353309c73c2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:09.676579 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fe108-693d-47d8-af27-27c25f7d500a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:09.713150 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c031e6f-230b-4f9d-a5a9-082474f04a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:09.713975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c031e6f-230b-4f9d-a5a9-082474f04a65 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:09.714412 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c031e6f-230b-4f9d-a5a9-082474f04a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:09.714732 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c031e6f-230b-4f9d-a5a9-082474f04a65 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:09.715566 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c031e6f-230b-4f9d-a5a9-082474f04a65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:09.715995 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c031e6f-230b-4f9d-a5a9-082474f04a65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:09.717492 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c031e6f-230b-4f9d-a5a9-082474f04a65 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:09.731304 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 346/703] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:09.733476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c031e6f-230b-4f9d-a5a9-082474f04a65 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:09.746735 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b0968-b3d5-4841-a7ee-5353309c73c2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:09.789465 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:09.794951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826611f0-a37a-4c5d-ba4d-e802ef66386a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:09.796061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826611f0-a37a-4c5d-ba4d-e802ef66386a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:09.796891 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826611f0-a37a-4c5d-ba4d-e802ef66386a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:09.797187 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826611f0-a37a-4c5d-ba4d-e802ef66386a None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:09.797928 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826611f0-a37a-4c5d-ba4d-e802ef66386a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:09.798242 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826611f0-a37a-4c5d-ba4d-e802ef66386a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:09.799626 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826611f0-a37a-4c5d-ba4d-e802ef66386a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:09.816533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 358/704] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:09.816533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826611f0-a37a-4c5d-ba4d-e802ef66386a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:09.848319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:09.855479 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c031e6f-230b-4f9d-a5a9-082474f04a65 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:09.891461 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8007c3-d488-4730-8867-5ed7ef3efb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:09.892495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8007c3-d488-4730-8867-5ed7ef3efb1e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:09.893096 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8007c3-d488-4730-8867-5ed7ef3efb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:09.893579 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8007c3-d488-4730-8867-5ed7ef3efb1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:09.895185 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8007c3-d488-4730-8867-5ed7ef3efb1e None admin] RBAC: Adding query filter params (role.id=868c7a356c674ded875dd079f5a9f5e0, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=cdf37a42279a466b85906b23751f9c22) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:09.895708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8007c3-d488-4730-8867-5ed7ef3efb1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:09.897370 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8007c3-d488-4730-8867-5ed7ef3efb1e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:09.903836 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 347/705] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:42:09 2022] GET /identity/v3/role_assignments?user.id=cdf37a42279a466b85906b23751f9c22&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=868c7a356c674ded875dd079f5a9f5e0 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:09.904900 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8007c3-d488-4730-8867-5ed7ef3efb1e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:09.945829 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826611f0-a37a-4c5d-ba4d-e802ef66386a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:09.995691 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69023dd-eebf-4859-ad22-33c84593297b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:09.996606 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69023dd-eebf-4859-ad22-33c84593297b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:09.996885 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69023dd-eebf-4859-ad22-33c84593297b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:09.997162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69023dd-eebf-4859-ad22-33c84593297b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:10.011011 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69023dd-eebf-4859-ad22-33c84593297b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:10.012832 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69023dd-eebf-4859-ad22-33c84593297b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:10.034057 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-d69023dd-eebf-4859-ad22-33c84593297b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:10.034057 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:10.034057 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:10.034057 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:10.034057 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:10.034057 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:10.034057 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:10.034057 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:10.034057 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:10.034057 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:10.034057 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:10.034057 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:10.034057 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:10.034057 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:10.034057 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:10.035111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:10.035111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:10.035111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:10.035111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:10.035111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:10.035111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:10.035111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:10.035111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:10.035111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:10.035111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:10.035111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:10.035111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:10.035111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:10.035111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:10.035111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:10.035111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:10.035111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:10.036019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:10.036019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:10.036019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:10.036019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:10.036019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:10.036019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:10.036019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:10.036019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:10.038013 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8007c3-d488-4730-8867-5ed7ef3efb1e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:10.040443 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 359/706] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:10.043050 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dc136-929d-469c-9a20-11e78c8c8512 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:10.043338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dc136-929d-469c-9a20-11e78c8c8512 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:10.043620 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dc136-929d-469c-9a20-11e78c8c8512 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:10.045372 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 360/707] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:10.054208 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70dc136-929d-469c-9a20-11e78c8c8512 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:10.092834 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa7e5c-9b22-41a6-8276-fbe754c3dba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:10.093877 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa7e5c-9b22-41a6-8276-fbe754c3dba5 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:10.094366 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa7e5c-9b22-41a6-8276-fbe754c3dba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:10.094858 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa7e5c-9b22-41a6-8276-fbe754c3dba5 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:10.095570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa7e5c-9b22-41a6-8276-fbe754c3dba5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:10.097036 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa7e5c-9b22-41a6-8276-fbe754c3dba5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:10.121332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:10.176189 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70dc136-929d-469c-9a20-11e78c8c8512 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:10.180881 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 348/708] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jul 5 12:42:09 2022] POST /identity/v3/users => generated 254 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:42:10.182591 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475a5ac-306a-4686-a47e-b52279ad4f27 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:10.182985 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475a5ac-306a-4686-a47e-b52279ad4f27 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:10.183364 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475a5ac-306a-4686-a47e-b52279ad4f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:10.220961 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b757f-5cc3-47c8-80d4-86f6a2f1d185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:10.221906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b757f-5cc3-47c8-80d4-86f6a2f1d185 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:10.222028 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-1475a5ac-306a-4686-a47e-b52279ad4f27 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:10.222544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b757f-5cc3-47c8-80d4-86f6a2f1d185 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:10.222974 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b757f-5cc3-47c8-80d4-86f6a2f1d185 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:10.223609 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1475a5ac-306a-4686-a47e-b52279ad4f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:10.224155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b757f-5cc3-47c8-80d4-86f6a2f1d185 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:10.224938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b757f-5cc3-47c8-80d4-86f6a2f1d185 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:10.226895 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b757f-5cc3-47c8-80d4-86f6a2f1d185 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:10.242170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 361/709] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:10.248657 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b757f-5cc3-47c8-80d4-86f6a2f1d185 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:10.249724 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:10.386755 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 349/710] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:42:10.416768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475a5ac-306a-4686-a47e-b52279ad4f27 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:10.427232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b757f-5cc3-47c8-80d4-86f6a2f1d185 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:10.442249 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:10.463098 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdee39c-79c0-469e-b97f-7fc757f0c557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:10.463768 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdee39c-79c0-469e-b97f-7fc757f0c557 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:10.464054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdee39c-79c0-469e-b97f-7fc757f0c557 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:10.464332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdee39c-79c0-469e-b97f-7fc757f0c557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:10.465209 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdee39c-79c0-469e-b97f-7fc757f0c557 None admin] RBAC: Adding query filter params (role.id=fb140b8a852547a5b8f339dce8d3440e, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=1fb7db02f8e945a7af39cb30c3d606f8) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:10.465528 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdee39c-79c0-469e-b97f-7fc757f0c557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:10.466994 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdee39c-79c0-469e-b97f-7fc757f0c557 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:10.473688 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 362/711] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:42:10 2022] GET /identity/v3/role_assignments?user.id=1fb7db02f8e945a7af39cb30c3d606f8&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=fb140b8a852547a5b8f339dce8d3440e => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:10.530327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475a5ac-306a-4686-a47e-b52279ad4f27 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:10.569797 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733cb10-b238-42d2-9aa8-28cddccc68f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:10.570639 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733cb10-b238-42d2-9aa8-28cddccc68f2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:10.570916 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733cb10-b238-42d2-9aa8-28cddccc68f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:10.571194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733cb10-b238-42d2-9aa8-28cddccc68f2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:10.571878 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733cb10-b238-42d2-9aa8-28cddccc68f2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:10.573327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733cb10-b238-42d2-9aa8-28cddccc68f2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:10.588408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-f733cb10-b238-42d2-9aa8-28cddccc68f2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 12:42:10.588408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:10.588408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:10.588408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:10.588408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:10.588408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:10.588408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:10.588408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:10.588408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 12:42:10.588408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:10.588408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:10.588408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:10.588408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:10.588408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:10.588408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:10.588408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:10.589546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:10.589546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:10.589546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:10.589546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:10.589546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:10.589546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:10.589546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:10.589546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:10.589546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:10.589546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:10.589546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:10.589546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:10.589546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:10.589546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:10.589546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:10.589546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:10.590392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:10.590392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:10.590392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:10.590392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:10.590392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:10.590392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:10.590392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:10.590392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:10.590392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:10.590392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:10.590392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:10.590392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:10.590392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:10.590392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 12:42:10.590392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:10.594746 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 350/712] 10.222.0.36 () {56 vars in 1129 bytes} [Tue Jul 5 12:42:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:10.596179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdee39c-79c0-469e-b97f-7fc757f0c557 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:10.706829 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdee39c-79c0-469e-b97f-7fc757f0c557 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:10.742472 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97147a29-eb1a-4a67-b23b-ee6bd55e2667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:10.743073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97147a29-eb1a-4a67-b23b-ee6bd55e2667 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:10.743356 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97147a29-eb1a-4a67-b23b-ee6bd55e2667 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:10.743634 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97147a29-eb1a-4a67-b23b-ee6bd55e2667 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:10.744345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97147a29-eb1a-4a67-b23b-ee6bd55e2667 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:10.744694 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97147a29-eb1a-4a67-b23b-ee6bd55e2667 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:10.746078 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97147a29-eb1a-4a67-b23b-ee6bd55e2667 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:10.756042 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 363/713] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jul 5 12:42:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:10.757436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733cb10-b238-42d2-9aa8-28cddccc68f2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:10.772977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:10.834768 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05249620-2826-453f-affc-bd6994979347 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:10.835112 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05249620-2826-453f-affc-bd6994979347 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:10.835391 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05249620-2826-453f-affc-bd6994979347 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:10.837062 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 364/714] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:42:10.848489 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aac27-8d5e-41e2-8442-19a2e58ba4b7 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:10.848836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aac27-8d5e-41e2-8442-19a2e58ba4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:10.849119 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aac27-8d5e-41e2-8442-19a2e58ba4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:10.869628 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-9e1aac27-8d5e-41e2-8442-19a2e58ba4b7 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:10.871018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9e1aac27-8d5e-41e2-8442-19a2e58ba4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:10.872993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733cb10-b238-42d2-9aa8-28cddccc68f2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:10.913909 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135e9f3-fc16-4154-9aea-03365ffef724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:10.914584 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135e9f3-fc16-4154-9aea-03365ffef724 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:10.914869 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135e9f3-fc16-4154-9aea-03365ffef724 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:10.915149 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135e9f3-fc16-4154-9aea-03365ffef724 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:10.915254 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:10.915868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135e9f3-fc16-4154-9aea-03365ffef724 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:10.916176 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135e9f3-fc16-4154-9aea-03365ffef724 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:10.917628 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135e9f3-fc16-4154-9aea-03365ffef724 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:10.923823 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 351/715] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jul 5 12:42:10 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:10.967700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 365/716] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:42:10.993874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135e9f3-fc16-4154-9aea-03365ffef724 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:11.087962 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:11.116569 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135e9f3-fc16-4154-9aea-03365ffef724 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:11.152897 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d29e21-4770-490a-a42a-d4d36e0697fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:11.153726 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d29e21-4770-490a-a42a-d4d36e0697fe None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:11.154019 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d29e21-4770-490a-a42a-d4d36e0697fe None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:11.154292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d29e21-4770-490a-a42a-d4d36e0697fe None admin] PATH_INFO: `/v3/services/network` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:11.154948 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d29e21-4770-490a-a42a-d4d36e0697fe None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:11.156324 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d29e21-4770-490a-a42a-d4d36e0697fe None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:11.168852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-46d29e21-4770-490a-a42a-d4d36e0697fe None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 12:42:11.168852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:11.168852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:11.168852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:11.168852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:11.168852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:11.168852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:11.168852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:11.168852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 12:42:11.168852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:11.168852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:11.168852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:11.168852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:11.168852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:11.168852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:11.168852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:11.168852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:11.169868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:11.169868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:11.169868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:11.169868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:11.169868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:11.169868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:11.169868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:11.169868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:11.169868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:11.169868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:11.169868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:11.169868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:11.169868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:11.169868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:11.169868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:11.169868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:11.171129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:11.171129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:11.171129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:11.171129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:11.171129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:11.171129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:11.171129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:11.171129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:11.171129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:11.171129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:11.171129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:11.171129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:11.171129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 12:42:11.171129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:11.171129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 352/717] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:10 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:11.177328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aac27-8d5e-41e2-8442-19a2e58ba4b7 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:11.282977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aac27-8d5e-41e2-8442-19a2e58ba4b7 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:11.318082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13926e-e415-44fa-ae1d-f86e073764a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:11.318760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13926e-e415-44fa-ae1d-f86e073764a5 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:11.319044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13926e-e415-44fa-ae1d-f86e073764a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:11.319321 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13926e-e415-44fa-ae1d-f86e073764a5 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:11.320025 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13926e-e415-44fa-ae1d-f86e073764a5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:11.320335 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13926e-e415-44fa-ae1d-f86e073764a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:11.321738 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13926e-e415-44fa-ae1d-f86e073764a5 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:11.326436 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 366/718] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jul 5 12:42:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:11.332511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d29e21-4770-490a-a42a-d4d36e0697fe None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:11.443691 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d29e21-4770-490a-a42a-d4d36e0697fe None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:11.482761 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f82f26-b0d7-47f4-b1e6-8462538da8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:11.483438 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f82f26-b0d7-47f4-b1e6-8462538da8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:11.483833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f82f26-b0d7-47f4-b1e6-8462538da8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:11.484115 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f82f26-b0d7-47f4-b1e6-8462538da8e0 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:11.484848 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f82f26-b0d7-47f4-b1e6-8462538da8e0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:11.485155 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f82f26-b0d7-47f4-b1e6-8462538da8e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:11.486536 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f82f26-b0d7-47f4-b1e6-8462538da8e0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:11.495443 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 353/719] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jul 5 12:42:11 2022] GET /identity/v3/services?type=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:12.343465 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae464c-44a9-4c24-97d7-ca295e548dfe None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:12.343971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae464c-44a9-4c24-97d7-ca295e548dfe None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:12.343971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae464c-44a9-4c24-97d7-ca295e548dfe None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:12.345548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 367/720] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:12.352038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf443fb-3476-48cf-af85-e21b33c22f03 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:12.352330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf443fb-3476-48cf-af85-e21b33c22f03 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:12.352634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf443fb-3476-48cf-af85-e21b33c22f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:12.357869 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:12.377562 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-8bf443fb-3476-48cf-af85-e21b33c22f03 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:12.378841 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8bf443fb-3476-48cf-af85-e21b33c22f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:12.465457 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 354/721] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:42:12.508916 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae464c-44a9-4c24-97d7-ca295e548dfe None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:12.551639 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:12.639253 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae464c-44a9-4c24-97d7-ca295e548dfe None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:12.713297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068d7b2-ee36-4a60-8410-02d369902bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:12.714107 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068d7b2-ee36-4a60-8410-02d369902bad None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:12.714392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068d7b2-ee36-4a60-8410-02d369902bad None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:12.714669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068d7b2-ee36-4a60-8410-02d369902bad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:12.729463 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068d7b2-ee36-4a60-8410-02d369902bad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:12.737116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-1068d7b2-ee36-4a60-8410-02d369902bad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:42:12.737116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:12.737116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:12.737116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:12.737116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:12.737116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:12.737116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:12.737116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:12.737116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:12.737116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:12.737116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:12.737116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:12.737116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:12.737116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:12.737116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:12.737116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:12.738569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:12.738569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:12.738569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:12.738569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:12.738569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:12.738569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:12.738569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:12.738569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:12.738569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:12.738569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:12.738569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:12.738569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:12.738569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:12.738569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:12.738569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:12.738569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:12.739437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:12.739437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:12.739437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:12.739437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:12.739437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:12.739437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:12.739437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:12.739437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:12.739437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:12.739437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:12.739437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:42:12.739437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:12.739437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 368/722] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:42:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:12.745024 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf443fb-3476-48cf-af85-e21b33c22f03 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:12.887179 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf443fb-3476-48cf-af85-e21b33c22f03 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:12.918444 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:12.927227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3c5cd-2a49-4571-a186-20f8158b1f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:12.927908 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3c5cd-2a49-4571-a186-20f8158b1f0f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:12.928198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3c5cd-2a49-4571-a186-20f8158b1f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:12.928478 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3c5cd-2a49-4571-a186-20f8158b1f0f None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:12.929301 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3c5cd-2a49-4571-a186-20f8158b1f0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:12.929612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3c5cd-2a49-4571-a186-20f8158b1f0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:12.930988 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3c5cd-2a49-4571-a186-20f8158b1f0f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:12.939980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 355/723] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:42:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:12.945760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068d7b2-ee36-4a60-8410-02d369902bad None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:13.016572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91ac20-42e7-4e53-bbac-81b7a31fc552 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:13.017068 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91ac20-42e7-4e53-bbac-81b7a31fc552 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:13.017576 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91ac20-42e7-4e53-bbac-81b7a31fc552 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:13.020688 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 356/724] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:13.038237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1115b-f9f2-4853-9194-2be553eb0051 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:13.038883 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1115b-f9f2-4853-9194-2be553eb0051 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:13.039366 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1115b-f9f2-4853-9194-2be553eb0051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:13.074261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-88a1115b-f9f2-4853-9194-2be553eb0051 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:13.075613 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-88a1115b-f9f2-4853-9194-2be553eb0051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:13.132950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:13.148038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068d7b2-ee36-4a60-8410-02d369902bad None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:13.182977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399c23e-d87a-4bfe-8d72-f0b7b7fa5972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:13.183701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399c23e-d87a-4bfe-8d72-f0b7b7fa5972 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:13.184006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399c23e-d87a-4bfe-8d72-f0b7b7fa5972 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:13.184487 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399c23e-d87a-4bfe-8d72-f0b7b7fa5972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:13.195997 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399c23e-d87a-4bfe-8d72-f0b7b7fa5972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:13.197734 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399c23e-d87a-4bfe-8d72-f0b7b7fa5972 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:13.205136 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 357/725] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 12:42:13.216202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-6399c23e-d87a-4bfe-8d72-f0b7b7fa5972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:13.216202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:13.216202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:13.216202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:13.216202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:13.216202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:13.216202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:13.216202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:13.216202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:13.216202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:13.216202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:13.216202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:13.216202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:13.216202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:13.216202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:13.217216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:13.217216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:13.217216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:13.217216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:13.217216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:13.217216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:13.217216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:13.217216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:13.217216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:13.217216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:13.217216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:13.217216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:13.217216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:13.217216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:13.217216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:13.217216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:13.217216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:13.218131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:13.218131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:13.218131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:13.218131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:13.220311 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 369/726] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:13.227014 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1115b-f9f2-4853-9194-2be553eb0051 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:13.234061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399c23e-d87a-4bfe-8d72-f0b7b7fa5972 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:13.341784 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399c23e-d87a-4bfe-8d72-f0b7b7fa5972 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:13.382345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e93533-c135-4459-93fc-ca3d18fc0ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:13.383902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e93533-c135-4459-93fc-ca3d18fc0ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:13.384366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e93533-c135-4459-93fc-ca3d18fc0ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:13.384848 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e93533-c135-4459-93fc-ca3d18fc0ee8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:13.404048 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e93533-c135-4459-93fc-ca3d18fc0ee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:13.412557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-64e93533-c135-4459-93fc-ca3d18fc0ee8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:13.412557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:13.412557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:13.412557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:13.412557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:13.412557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:13.412557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:13.412557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:13.412557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:13.412557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:13.412557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:13.412557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:13.412557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:13.412557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:13.412557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:13.412557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:13.413754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:13.413754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:13.413754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:13.413754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:13.413754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:13.413754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:13.413754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:13.413754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:13.413754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:13.413754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:13.413754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:13.413754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:13.413754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:13.413754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:13.413754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:13.413754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:13.414811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:13.414811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:13.414811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:13.414811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:13.414811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:13.414811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:13.414811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:13.414811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:13.414811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:13.414811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:13.414811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:13.414811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:13.418252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 370/727] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:42:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:13.426591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e93533-c135-4459-93fc-ca3d18fc0ee8 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:13.434525 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1115b-f9f2-4853-9194-2be553eb0051 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:13.440921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:13.484965 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:13.521641 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908d376-20f4-402b-bf66-22d9bc7df27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:13.522508 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908d376-20f4-402b-bf66-22d9bc7df27e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:13.522934 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908d376-20f4-402b-bf66-22d9bc7df27e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:13.523222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908d376-20f4-402b-bf66-22d9bc7df27e None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:13.523959 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908d376-20f4-402b-bf66-22d9bc7df27e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:13.524264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908d376-20f4-402b-bf66-22d9bc7df27e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:13.525676 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908d376-20f4-402b-bf66-22d9bc7df27e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:13.551638 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 358/728] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:13.557089 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908d376-20f4-402b-bf66-22d9bc7df27e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:13.560568 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e93533-c135-4459-93fc-ca3d18fc0ee8 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:13.596125 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9026b-c5fa-408f-8c47-721a9fecda48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:13.596841 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9026b-c5fa-408f-8c47-721a9fecda48 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:13.597127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9026b-c5fa-408f-8c47-721a9fecda48 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:13.597440 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9026b-c5fa-408f-8c47-721a9fecda48 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:13.598197 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9026b-c5fa-408f-8c47-721a9fecda48 None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:13.598506 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9026b-c5fa-408f-8c47-721a9fecda48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:13.600363 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9026b-c5fa-408f-8c47-721a9fecda48 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:13.612721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 371/729] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jul 5 12:42:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:13.614653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964ac5c-5dcc-4147-9be7-b7beab7622f5 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:13.614946 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964ac5c-5dcc-4147-9be7-b7beab7622f5 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:13.615227 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964ac5c-5dcc-4147-9be7-b7beab7622f5 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:13.618151 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 372/730] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:13.618871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964ac5c-5dcc-4147-9be7-b7beab7622f5 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:13.687785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:13.696507 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908d376-20f4-402b-bf66-22d9bc7df27e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:13.730340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964ac5c-5dcc-4147-9be7-b7beab7622f5 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:13.731328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2664d3-a2e3-41c7-88ef-40e5835d15c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:13.732173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2664d3-a2e3-41c7-88ef-40e5835d15c1 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:13.732446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2664d3-a2e3-41c7-88ef-40e5835d15c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:13.732726 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2664d3-a2e3-41c7-88ef-40e5835d15c1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:13.740922 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2664d3-a2e3-41c7-88ef-40e5835d15c1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:13.742373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2664d3-a2e3-41c7-88ef-40e5835d15c1 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:13.756733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-0d2664d3-a2e3-41c7-88ef-40e5835d15c1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:42:13.756733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:13.756733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:13.756733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:13.756733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:13.756733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:13.756733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:13.756733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:13.756733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:13.756733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:13.756733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:13.756733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:13.756733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:13.756733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:13.756733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:13.756733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:13.757872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:13.757872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:13.757872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:13.757872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:13.757872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:13.757872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:13.757872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:13.757872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:13.757872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:13.757872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:13.757872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:13.757872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:13.757872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:13.757872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:13.757872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:13.757872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:13.757872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:13.757872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:13.759033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:13.759033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:13.759033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:13.759033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:13.759033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:13.759033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:13.759033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:13.759033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:13.759033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:42:13.759033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:13.762575 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 359/731] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jul 5 12:42:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:13.763763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c1bdb-125a-4b81-aaf8-9e6d8a8dcd8d None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:13.764059 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c1bdb-125a-4b81-aaf8-9e6d8a8dcd8d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:13.764339 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c1bdb-125a-4b81-aaf8-9e6d8a8dcd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:13.771373 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e4781-e829-4740-8112-855a1c899158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:13.772441 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e4781-e829-4740-8112-855a1c899158 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:13.772926 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e4781-e829-4740-8112-855a1c899158 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:13.773382 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e4781-e829-4740-8112-855a1c899158 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:13.781408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-601c1bdb-125a-4b81-aaf8-9e6d8a8dcd8d None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:13.782991 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-601c1bdb-125a-4b81-aaf8-9e6d8a8dcd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:13.785587 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e4781-e829-4740-8112-855a1c899158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:13.787342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e4781-e829-4740-8112-855a1c899158 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:13.805838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-365e4781-e829-4740-8112-855a1c899158 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:13.805838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:13.805838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:13.805838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:13.805838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:13.805838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:13.805838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:13.805838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:13.805838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:13.805838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:13.805838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:13.805838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:13.805838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:13.805838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:13.805838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:13.806763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:13.806763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:13.806763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:13.806763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:13.806763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:13.806763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:13.806763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:13.806763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:13.806763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:13.806763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:13.806763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:13.806763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:13.806763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:13.806763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:13.806763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:13.806763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:13.806763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:13.807638 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:13.807638 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:13.807638 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:13.807638 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:13.807638 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 373/732] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:13.809064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b207770-62d9-480b-a3c5-bffa79811899 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:13.809350 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b207770-62d9-480b-a3c5-bffa79811899 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:13.809628 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b207770-62d9-480b-a3c5-bffa79811899 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:13.815783 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 374/733] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:13.816546 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b207770-62d9-480b-a3c5-bffa79811899 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:13.827275 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:13.860763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 360/734] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:42:13.860763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106d2c3-131d-43f5-84bb-8e3b5dde2c22 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:13.860763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106d2c3-131d-43f5-84bb-8e3b5dde2c22 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:13.860763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106d2c3-131d-43f5-84bb-8e3b5dde2c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:13.876442 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-1106d2c3-131d-43f5-84bb-8e3b5dde2c22 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:13.877904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1106d2c3-131d-43f5-84bb-8e3b5dde2c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:13.933570 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b207770-62d9-480b-a3c5-bffa79811899 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:13.952718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 361/735] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:42:13.952718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106d2c3-131d-43f5-84bb-8e3b5dde2c22 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:13.967893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:13.984977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d345f7-c62f-49d8-bc87-1f5270be2062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:13.985655 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d345f7-c62f-49d8-bc87-1f5270be2062 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:13.985940 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d345f7-c62f-49d8-bc87-1f5270be2062 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:13.986217 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d345f7-c62f-49d8-bc87-1f5270be2062 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:13.987059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d345f7-c62f-49d8-bc87-1f5270be2062 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:13.987374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d345f7-c62f-49d8-bc87-1f5270be2062 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:13.989395 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d345f7-c62f-49d8-bc87-1f5270be2062 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:14.009135 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 375/736] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jul 5 12:42:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:14.009962 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d345f7-c62f-49d8-bc87-1f5270be2062 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:14.062560 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106d2c3-131d-43f5-84bb-8e3b5dde2c22 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:14.064989 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:14.095508 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7e823-cd20-46b2-98af-6ee2c016ef21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:14.096163 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7e823-cd20-46b2-98af-6ee2c016ef21 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:14.096444 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7e823-cd20-46b2-98af-6ee2c016ef21 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:14.096749 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7e823-cd20-46b2-98af-6ee2c016ef21 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:14.098009 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7e823-cd20-46b2-98af-6ee2c016ef21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:14.098314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7e823-cd20-46b2-98af-6ee2c016ef21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:14.099925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7e823-cd20-46b2-98af-6ee2c016ef21 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:14.110810 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 362/737] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:14.110949 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d345f7-c62f-49d8-bc87-1f5270be2062 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:14.111569 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7e823-cd20-46b2-98af-6ee2c016ef21 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:14.146688 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba8a34-2de3-4e85-82a3-00fdac0ced9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:14.147476 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba8a34-2de3-4e85-82a3-00fdac0ced9e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:14.147757 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba8a34-2de3-4e85-82a3-00fdac0ced9e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:14.148029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba8a34-2de3-4e85-82a3-00fdac0ced9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:14.158275 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba8a34-2de3-4e85-82a3-00fdac0ced9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:14.166445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-2cba8a34-2de3-4e85-82a3-00fdac0ced9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:42:14.166445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:14.166445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:14.166445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:14.166445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:14.166445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:14.166445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:14.166445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:14.166445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:14.166445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:14.166445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:14.166445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:14.166445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:14.166445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:14.166445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:14.166445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:14.167435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:14.167435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:14.167435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:14.167435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:14.167435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:14.167435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:14.167435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:14.167435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:14.167435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:14.167435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:14.167435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:14.167435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:14.167435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:14.167435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:14.167435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:14.167435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:14.168286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:14.168286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:14.168286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:14.168286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:14.168286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:14.168286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:14.168286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:14.168286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:14.168286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:14.168286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:14.168286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:42:14.168286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:14.168958 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 376/738] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:42:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:14.170054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba8a34-2de3-4e85-82a3-00fdac0ced9e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:14.212042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7e823-cd20-46b2-98af-6ee2c016ef21 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:14.248042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45d4c8-0171-489e-9509-ca701c3e7f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:14.248762 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45d4c8-0171-489e-9509-ca701c3e7f02 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:14.249047 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45d4c8-0171-489e-9509-ca701c3e7f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:14.249325 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45d4c8-0171-489e-9509-ca701c3e7f02 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:14.250060 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45d4c8-0171-489e-9509-ca701c3e7f02 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:14.251566 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45d4c8-0171-489e-9509-ca701c3e7f02 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:14.322551 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:14.322757 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 363/739] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jul 5 12:42:14 2022] POST /identity/v3/services => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:42:14.326093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf559c-2f5a-45c8-88d7-49213159e1a1 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:14.326383 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf559c-2f5a-45c8-88d7-49213159e1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:14.326665 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf559c-2f5a-45c8-88d7-49213159e1a1 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:14.332847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 364/740] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:14.332847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf559c-2f5a-45c8-88d7-49213159e1a1 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:14.359982 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:14.398996 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba8a34-2de3-4e85-82a3-00fdac0ced9e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:14.442696 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368249dd-cac6-4462-aaaa-0692f19c027a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:14.443510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368249dd-cac6-4462-aaaa-0692f19c027a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:14.443797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368249dd-cac6-4462-aaaa-0692f19c027a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:14.444064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368249dd-cac6-4462-aaaa-0692f19c027a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:14.445527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf559c-2f5a-45c8-88d7-49213159e1a1 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:14.455737 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368249dd-cac6-4462-aaaa-0692f19c027a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:14.457802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368249dd-cac6-4462-aaaa-0692f19c027a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:14.476431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-368249dd-cac6-4462-aaaa-0692f19c027a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:14.476431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:14.476431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:14.476431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:14.476431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:14.476431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:14.476431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:14.476431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:14.476431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:14.476431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:14.476431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:14.476431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:14.476431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:14.476431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:14.476431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:14.477390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:14.477390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:14.477390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:14.477390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:14.477390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:14.477390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:14.477390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:14.477390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:14.477390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:14.477390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:14.477390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:14.477390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:14.477390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:14.477390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:14.477390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:14.477390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:14.477390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:14.478265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:14.478265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:14.478265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:14.478265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:14.478265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 377/741] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:14.478549 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368249dd-cac6-4462-aaaa-0692f19c027a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:14.484943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac55f1-d2d4-4b99-b04c-4781d74101f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:14.486010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac55f1-d2d4-4b99-b04c-4781d74101f9 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:14.486010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac55f1-d2d4-4b99-b04c-4781d74101f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:14.486626 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac55f1-d2d4-4b99-b04c-4781d74101f9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:14.495455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac55f1-d2d4-4b99-b04c-4781d74101f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:14.496971 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac55f1-d2d4-4b99-b04c-4781d74101f9 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:14.514195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-2cac55f1-d2d4-4b99-b04c-4781d74101f9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:42:14.514195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:14.514195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:14.514195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:14.514195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:14.514195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:14.514195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:14.514195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:14.514195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:14.514195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:14.514195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:14.514195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:14.514195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:14.514195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:14.514195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:14.514195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:14.515142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:14.515142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:14.515142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:14.515142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:14.515142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:14.515142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:14.515142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:14.515142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:14.515142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:14.515142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:14.515142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:14.515142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:14.515142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:14.515142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:14.515142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:14.515142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:14.515142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:14.515142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:14.516072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:14.516072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:14.516072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:14.516072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:14.516072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:14.516072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:14.516072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:14.516072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:14.516072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:42:14.516072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:14.517899 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 365/742] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jul 5 12:42:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:14.519120 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639a4c8-d7ae-41c9-bc91-9f09c18d3bc0 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:14.519954 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639a4c8-d7ae-41c9-bc91-9f09c18d3bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:14.520232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639a4c8-d7ae-41c9-bc91-9f09c18d3bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:14.538493 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-9639a4c8-d7ae-41c9-bc91-9f09c18d3bc0 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:14.540128 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9639a4c8-d7ae-41c9-bc91-9f09c18d3bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:14.576490 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:14.591829 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368249dd-cac6-4462-aaaa-0692f19c027a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:14.613076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 366/743] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 12:42:14.613076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639a4c8-d7ae-41c9-bc91-9f09c18d3bc0 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:14.627570 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba043ca5-f13e-4fb6-84fd-917ecace8afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:14.628246 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba043ca5-f13e-4fb6-84fd-917ecace8afd None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:14.629096 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba043ca5-f13e-4fb6-84fd-917ecace8afd None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:14.629377 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba043ca5-f13e-4fb6-84fd-917ecace8afd None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:14.630240 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba043ca5-f13e-4fb6-84fd-917ecace8afd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:14.630538 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba043ca5-f13e-4fb6-84fd-917ecace8afd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:14.631912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba043ca5-f13e-4fb6-84fd-917ecace8afd None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:14.634330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:14.642552 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 378/744] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:42:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:14.643372 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba043ca5-f13e-4fb6-84fd-917ecace8afd None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:14.737434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639a4c8-d7ae-41c9-bc91-9f09c18d3bc0 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:14.749527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba043ca5-f13e-4fb6-84fd-917ecace8afd None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:14.772967 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1921233-5ac0-4782-ad1c-b2eb0197ddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:14.773628 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1921233-5ac0-4782-ad1c-b2eb0197ddf4 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:14.773910 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1921233-5ac0-4782-ad1c-b2eb0197ddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:14.774187 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1921233-5ac0-4782-ad1c-b2eb0197ddf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:14.774906 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1921233-5ac0-4782-ad1c-b2eb0197ddf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:14.775203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1921233-5ac0-4782-ad1c-b2eb0197ddf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:14.776571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1921233-5ac0-4782-ad1c-b2eb0197ddf4 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:14.785385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785a76e-0048-42ab-96ca-76e55de673c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:14.786118 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785a76e-0048-42ab-96ca-76e55de673c9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:14.786398 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785a76e-0048-42ab-96ca-76e55de673c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:14.786678 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785a76e-0048-42ab-96ca-76e55de673c9 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:14.787517 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785a76e-0048-42ab-96ca-76e55de673c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:14.787829 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785a76e-0048-42ab-96ca-76e55de673c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:14.792905 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 367/745] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:14.792905 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1921233-5ac0-4782-ad1c-b2eb0197ddf4 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:14.793120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785a76e-0048-42ab-96ca-76e55de673c9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:14.811115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 379/746] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jul 5 12:42:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:14.811962 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785a76e-0048-42ab-96ca-76e55de673c9 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:14.822094 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:14.876759 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:14.902533 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1921233-5ac0-4782-ad1c-b2eb0197ddf4 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:14.923456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785a76e-0048-42ab-96ca-76e55de673c9 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:14.938743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c62bd-0d01-445a-9058-576903cfeeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:14.939407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c62bd-0d01-445a-9058-576903cfeeb0 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:14.939698 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c62bd-0d01-445a-9058-576903cfeeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:14.939977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c62bd-0d01-445a-9058-576903cfeeb0 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:14.940727 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c62bd-0d01-445a-9058-576903cfeeb0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:14.942666 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c62bd-0d01-445a-9058-576903cfeeb0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:14.958576 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb6fa7-82ca-4c98-ad16-9441d3b20c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:14.962078 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb6fa7-82ca-4c98-ad16-9441d3b20c29 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:14.962078 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb6fa7-82ca-4c98-ad16-9441d3b20c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:14.962078 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb6fa7-82ca-4c98-ad16-9441d3b20c29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:14.970253 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb6fa7-82ca-4c98-ad16-9441d3b20c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:14.971706 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb6fa7-82ca-4c98-ad16-9441d3b20c29 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:14.990649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-25bb6fa7-82ca-4c98-ad16-9441d3b20c29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:14.990649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:14.990649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:14.990649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:14.990649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:14.990649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:14.990649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:14.990649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:14.990649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:14.990649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:14.990649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:14.990649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:14.990649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:14.990649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:14.990649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:14.991650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:14.991650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:14.991650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:14.991650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:14.991650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:14.991650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:14.991650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:14.991650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:14.991650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:14.991650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:14.991650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:14.991650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:14.991650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:14.991650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:14.991650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:14.991650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:14.991650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:14.993083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:14.993083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:14.993083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:14.993083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:14.993083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 380/747] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:14.993083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb6fa7-82ca-4c98-ad16-9441d3b20c29 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:15.021385 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 368/748] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jul 5 12:42:14 2022] POST /identity/v3/services => generated 240 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:42:15.022604 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c62bd-0d01-445a-9058-576903cfeeb0 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:15.057074 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:15.119648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb6fa7-82ca-4c98-ad16-9441d3b20c29 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:15.179341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef72b7-6ec8-4424-9c1a-4aad6617aeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:15.179555 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c62bd-0d01-445a-9058-576903cfeeb0 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:15.180698 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef72b7-6ec8-4424-9c1a-4aad6617aeea None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:15.181418 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef72b7-6ec8-4424-9c1a-4aad6617aeea None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:15.182843 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef72b7-6ec8-4424-9c1a-4aad6617aeea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:15.192341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef72b7-6ec8-4424-9c1a-4aad6617aeea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:15.194757 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef72b7-6ec8-4424-9c1a-4aad6617aeea None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:15.210397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-0cef72b7-6ec8-4424-9c1a-4aad6617aeea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:15.210397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:15.210397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:15.210397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:15.210397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:15.210397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:15.210397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:15.210397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:15.210397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:15.210397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:15.210397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:15.210397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:15.210397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:15.210397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:15.210397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:15.211307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:15.211307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:15.211307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:15.211307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:15.211307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:15.211307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:15.211307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:15.211307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:15.211307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:15.211307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:15.211307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:15.211307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:15.211307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:15.211307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:15.211307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:15.211307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:15.211307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:15.212178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:15.212178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:15.212178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:15.212178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:15.212178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:15.212178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:15.212178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:15.212178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:15.213092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 381/749] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:15.213597 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef72b7-6ec8-4424-9c1a-4aad6617aeea None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:15.223647 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e13ab7-b289-490d-b17c-581ac8105e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:15.224303 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e13ab7-b289-490d-b17c-581ac8105e42 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:15.224901 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e13ab7-b289-490d-b17c-581ac8105e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:15.225604 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e13ab7-b289-490d-b17c-581ac8105e42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:15.229840 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:15.326663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef72b7-6ec8-4424-9c1a-4aad6617aeea None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:15.328638 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e13ab7-b289-490d-b17c-581ac8105e42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:15.330285 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e13ab7-b289-490d-b17c-581ac8105e42 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:15.342025 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:15.363977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b43b8-6d56-4631-b0ab-79a367b513a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:15.364847 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b43b8-6d56-4631-b0ab-79a367b513a2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:15.365259 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b43b8-6d56-4631-b0ab-79a367b513a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:15.365780 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b43b8-6d56-4631-b0ab-79a367b513a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:15.366466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b43b8-6d56-4631-b0ab-79a367b513a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:15.366873 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b43b8-6d56-4631-b0ab-79a367b513a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:15.368340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b43b8-6d56-4631-b0ab-79a367b513a2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:15.384621 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 382/750] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:15.384621 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b43b8-6d56-4631-b0ab-79a367b513a2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:15.449104 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 369/751] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:42:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:42:15.450326 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e13ab7-b289-490d-b17c-581ac8105e42 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:15.489333 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:15.492163 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b43b8-6d56-4631-b0ab-79a367b513a2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:15.528088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117d252-1bac-40fc-9487-49487bd375e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:15.528788 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117d252-1bac-40fc-9487-49487bd375e5 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:15.529156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117d252-1bac-40fc-9487-49487bd375e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:15.529348 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117d252-1bac-40fc-9487-49487bd375e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:15.530142 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117d252-1bac-40fc-9487-49487bd375e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:15.530451 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117d252-1bac-40fc-9487-49487bd375e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:15.532267 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117d252-1bac-40fc-9487-49487bd375e5 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:15.551398 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 383/752] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:15.552855 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117d252-1bac-40fc-9487-49487bd375e5 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:15.578820 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e13ab7-b289-490d-b17c-581ac8105e42 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:15.589032 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:15.623970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d47ac-1a96-4c78-884e-a776f90f8c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:15.625717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d47ac-1a96-4c78-884e-a776f90f8c78 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:15.626486 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d47ac-1a96-4c78-884e-a776f90f8c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:15.626966 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d47ac-1a96-4c78-884e-a776f90f8c78 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:15.636799 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d47ac-1a96-4c78-884e-a776f90f8c78 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:15.639485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d47ac-1a96-4c78-884e-a776f90f8c78 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:15.660695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-8b4d47ac-1a96-4c78-884e-a776f90f8c78 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:42:15.660695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:15.660695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:15.660695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:15.660695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:15.660695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:15.660695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:15.660695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:15.660695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:15.660695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:15.660695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:15.660695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:15.660695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:15.660695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:15.660695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:15.660695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:15.661660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:15.661660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:15.661660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:15.661660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:15.661660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:15.661660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:15.661660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:15.661660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:15.661660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:15.661660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:15.661660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:15.661660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:15.661660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:15.661660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:15.661660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:15.661660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:15.661660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:15.661660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:15.662631 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:15.662631 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:15.662631 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:15.662631 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:15.662631 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:15.662631 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:15.662631 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:15.662631 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:15.662631 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:42:15.662631 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:15.663161 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117d252-1bac-40fc-9487-49487bd375e5 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:15.666406 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 370/753] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:42:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:15.667403 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d47ac-1a96-4c78-884e-a776f90f8c78 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:15.700407 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8614b-e6b8-4d2c-ac7c-68db369fb12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:15.701245 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8614b-e6b8-4d2c-ac7c-68db369fb12c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:15.701528 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8614b-e6b8-4d2c-ac7c-68db369fb12c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:15.701815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8614b-e6b8-4d2c-ac7c-68db369fb12c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:15.713525 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8614b-e6b8-4d2c-ac7c-68db369fb12c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:15.715566 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8614b-e6b8-4d2c-ac7c-68db369fb12c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:15.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-23a8614b-e6b8-4d2c-ac7c-68db369fb12c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:15.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:15.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:15.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:15.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:15.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:15.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:15.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:15.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:15.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:15.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:15.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:15.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:15.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:15.734902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:15.735834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:15.735834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:15.735834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:15.735834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:15.735834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:15.735834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:15.735834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:15.735834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:15.735834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:15.735834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:15.735834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:15.735834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:15.735834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:15.735834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:15.735834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:15.735834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:15.735834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:15.736739 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:15.736739 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:15.736739 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:15.736739 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:15.736739 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 384/754] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:15.737445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8614b-e6b8-4d2c-ac7c-68db369fb12c None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:15.793642 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:15.802198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d47ac-1a96-4c78-884e-a776f90f8c78 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:15.834902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:15.850997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dedfe-22d4-413d-b8a9-ac8ac8f2b7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:15.852448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dedfe-22d4-413d-b8a9-ac8ac8f2b7cf None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:15.852909 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dedfe-22d4-413d-b8a9-ac8ac8f2b7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:15.853332 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dedfe-22d4-413d-b8a9-ac8ac8f2b7cf None admin] PATH_INFO: `/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/cdf37a42279a466b85906b23751f9c22/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:15.853915 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8614b-e6b8-4d2c-ac7c-68db369fb12c None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:15.855860 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2dedfe-22d4-413d-b8a9-ac8ac8f2b7cf None admin] RBAC: Authorizing `identity:create_grant(project_id=a4190347294b48c096d7aa9d3a479d12, user_id=cdf37a42279a466b85906b23751f9c22, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:15.858404 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2dedfe-22d4-413d-b8a9-ac8ac8f2b7cf None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:15.889785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57babf-3daf-4c6f-b80e-419e79cb7547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:15.890540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57babf-3daf-4c6f-b80e-419e79cb7547 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:15.890895 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57babf-3daf-4c6f-b80e-419e79cb7547 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:15.891236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57babf-3daf-4c6f-b80e-419e79cb7547 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:15.892133 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57babf-3daf-4c6f-b80e-419e79cb7547 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:15.892539 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57babf-3daf-4c6f-b80e-419e79cb7547 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:15.894683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57babf-3daf-4c6f-b80e-419e79cb7547 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:15.912853 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 385/755] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jul 5 12:42:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:15.913580 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57babf-3daf-4c6f-b80e-419e79cb7547 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:15.930698 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 371/756] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:42:15 2022] PUT /identity/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/cdf37a42279a466b85906b23751f9c22/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:42:15.931802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dedfe-22d4-413d-b8a9-ac8ac8f2b7cf None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:16.131351 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57babf-3daf-4c6f-b80e-419e79cb7547 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:16.139159 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dedfe-22d4-413d-b8a9-ac8ac8f2b7cf None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:16.169617 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffaa9c4-89e4-415c-a049-05586c432e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:16.170295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffaa9c4-89e4-415c-a049-05586c432e4f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:16.170578 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffaa9c4-89e4-415c-a049-05586c432e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:16.170857 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffaa9c4-89e4-415c-a049-05586c432e4f None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:16.171587 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffaa9c4-89e4-415c-a049-05586c432e4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:16.171900 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffaa9c4-89e4-415c-a049-05586c432e4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:16.173511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffaa9c4-89e4-415c-a049-05586c432e4f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:16.178405 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea1a88-a303-47a3-8d13-81bb7949d371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:16.179331 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea1a88-a303-47a3-8d13-81bb7949d371 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:16.179843 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea1a88-a303-47a3-8d13-81bb7949d371 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:16.180333 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea1a88-a303-47a3-8d13-81bb7949d371 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:16.186791 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 386/757] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:16.193690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffaa9c4-89e4-415c-a049-05586c432e4f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:16.206332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:16.212005 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:16.261977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea1a88-a303-47a3-8d13-81bb7949d371 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:16.263447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea1a88-a303-47a3-8d13-81bb7949d371 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:16.369005 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 372/758] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:42:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:42:16.374585 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea1a88-a303-47a3-8d13-81bb7949d371 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:16.393009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffaa9c4-89e4-415c-a049-05586c432e4f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:16.432201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:16.468265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226147b-ac5c-40ff-93dd-cb63ac69abf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:16.469142 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226147b-ac5c-40ff-93dd-cb63ac69abf1 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:16.469721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226147b-ac5c-40ff-93dd-cb63ac69abf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:16.470141 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226147b-ac5c-40ff-93dd-cb63ac69abf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:16.478325 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6226147b-ac5c-40ff-93dd-cb63ac69abf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:16.479775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6226147b-ac5c-40ff-93dd-cb63ac69abf1 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:16.479986 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea1a88-a303-47a3-8d13-81bb7949d371 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:16.494879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-6226147b-ac5c-40ff-93dd-cb63ac69abf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:16.494879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:16.494879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:16.494879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:16.494879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:16.494879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:16.494879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:16.494879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:16.494879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:16.494879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:16.494879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:16.494879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:16.494879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:16.494879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:16.494879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:16.496126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:16.496126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:16.496126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:16.496126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:16.496126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:16.496126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:16.496126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:16.496126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:16.496126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:16.496126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:16.496126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:16.496126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:16.496126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:16.496126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:16.496126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:16.496126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:16.496126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:16.497043 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:16.497043 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:16.497043 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:16.497043 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:16.497043 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:16.497043 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:16.497043 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:16.497043 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:16.497043 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 387/759] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:16.502407 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b26301-65c9-478a-ae84-75a16ebdc7d8 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:16.502846 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b26301-65c9-478a-ae84-75a16ebdc7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:16.503195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b26301-65c9-478a-ae84-75a16ebdc7d8 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:16.505398 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 388/760] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:16.506304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b26301-65c9-478a-ae84-75a16ebdc7d8 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:16.518157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b4e5c-14ec-4a07-9b0b-0e71b97d3495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:16.518951 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b4e5c-14ec-4a07-9b0b-0e71b97d3495 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:16.519325 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b4e5c-14ec-4a07-9b0b-0e71b97d3495 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:16.519609 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b4e5c-14ec-4a07-9b0b-0e71b97d3495 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:16.530226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b4e5c-14ec-4a07-9b0b-0e71b97d3495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:16.531748 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b4e5c-14ec-4a07-9b0b-0e71b97d3495 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:16.554247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-b59b4e5c-14ec-4a07-9b0b-0e71b97d3495 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:16.554247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:16.554247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:16.554247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:16.554247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:16.554247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:16.554247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:16.554247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:16.554247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:16.554247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:16.554247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:16.554247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:16.554247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:16.554247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:16.554247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:16.555177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:16.555177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:16.555177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:16.555177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:16.555177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:16.555177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:16.555177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:16.555177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:16.555177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:16.555177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:16.555177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:16.555177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:16.555177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:16.555177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:16.555177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:16.555177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:16.555177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:16.556065 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:16.556065 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:16.556065 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:16.556065 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:16.556065 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 373/761] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:16.557908 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61854a2f-f31a-4f3a-aa16-2950044b67e6 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:16.558227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61854a2f-f31a-4f3a-aa16-2950044b67e6 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:16.558513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61854a2f-f31a-4f3a-aa16-2950044b67e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:16.575429 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-61854a2f-f31a-4f3a-aa16-2950044b67e6 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:16.576650 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-61854a2f-f31a-4f3a-aa16-2950044b67e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:16.578024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:16.620058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b26301-65c9-478a-ae84-75a16ebdc7d8 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:16.649312 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 374/762] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:16.650218 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61854a2f-f31a-4f3a-aa16-2950044b67e6 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:16.656804 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbc360-368e-49a7-a3f0-ad021828a943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:16.657476 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbc360-368e-49a7-a3f0-ad021828a943 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:16.657811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbc360-368e-49a7-a3f0-ad021828a943 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:16.658093 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbc360-368e-49a7-a3f0-ad021828a943 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:16.658946 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbc360-368e-49a7-a3f0-ad021828a943 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:16.659263 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbc360-368e-49a7-a3f0-ad021828a943 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:16.660843 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbc360-368e-49a7-a3f0-ad021828a943 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:16.674910 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 389/763] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:16.685679 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbc360-368e-49a7-a3f0-ad021828a943 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:16.687162 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:16.760387 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61854a2f-f31a-4f3a-aa16-2950044b67e6 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:16.797727 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbc360-368e-49a7-a3f0-ad021828a943 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:16.798918 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d0675-4cf1-453b-ba53-f23f0a648dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:16.799607 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d0675-4cf1-453b-ba53-f23f0a648dac None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:16.799999 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d0675-4cf1-453b-ba53-f23f0a648dac None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:16.800364 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d0675-4cf1-453b-ba53-f23f0a648dac None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:16.801738 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d0675-4cf1-453b-ba53-f23f0a648dac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:16.802062 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d0675-4cf1-453b-ba53-f23f0a648dac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:16.803439 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d0675-4cf1-453b-ba53-f23f0a648dac None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:16.821538 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 375/764] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:16.822481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d0675-4cf1-453b-ba53-f23f0a648dac None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:16.825362 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:16.836911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bdada-6813-45cd-b6ff-b91d468dab98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:16.838000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bdada-6813-45cd-b6ff-b91d468dab98 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:16.839034 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bdada-6813-45cd-b6ff-b91d468dab98 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:16.839034 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bdada-6813-45cd-b6ff-b91d468dab98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:16.840091 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bdada-6813-45cd-b6ff-b91d468dab98 None admin] RBAC: Adding query filter params (role.id=fb140b8a852547a5b8f339dce8d3440e, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=ab47c91ba7854bc09f656607dbb41cfc) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:16.840719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bdada-6813-45cd-b6ff-b91d468dab98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:16.842436 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bdada-6813-45cd-b6ff-b91d468dab98 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:16.856935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 390/765] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:42:16 2022] GET /identity/v3/role_assignments?user.id=ab47c91ba7854bc09f656607dbb41cfc&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=fb140b8a852547a5b8f339dce8d3440e => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:16.858499 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bdada-6813-45cd-b6ff-b91d468dab98 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:16.933110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:16.939178 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d0675-4cf1-453b-ba53-f23f0a648dac None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:16.977547 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6353a-92f8-4f08-ab56-97ff1ded544e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:16.978382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6353a-92f8-4f08-ab56-97ff1ded544e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:16.978672 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6353a-92f8-4f08-ab56-97ff1ded544e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:16.978950 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6353a-92f8-4f08-ab56-97ff1ded544e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:16.979745 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6353a-92f8-4f08-ab56-97ff1ded544e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:16.981166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6353a-92f8-4f08-ab56-97ff1ded544e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:16.995222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-1ff6353a-92f8-4f08-ab56-97ff1ded544e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 12:42:16.995222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:16.995222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:16.995222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:16.995222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:16.995222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:16.995222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:16.995222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:16.995222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 12:42:16.995222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:16.995222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:16.995222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:16.995222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:16.995222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:16.995222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:16.995222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:16.996206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:16.996206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:16.996206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:16.996206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:16.996206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:16.996206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:16.996206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:16.996206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:16.996206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:16.996206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:16.996206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:16.996206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:16.996206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:16.996206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:16.996206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:16.996206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:16.997072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:16.997072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:16.997072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:16.997072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:16.997072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:16.997072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:16.997072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:16.997072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:16.997072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:16.997072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:16.997072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:16.997072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:16.997072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:16.997072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 12:42:16.997072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:16.997072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 376/766] 10.222.0.36 () {56 vars in 1129 bytes} [Tue Jul 5 12:42:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:17.006431 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6353a-92f8-4f08-ab56-97ff1ded544e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:17.064766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bdada-6813-45cd-b6ff-b91d468dab98 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:17.124226 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b01cd9-f11e-4f1f-b4ca-e5034cc4263e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:17.125054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b01cd9-f11e-4f1f-b4ca-e5034cc4263e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:17.125337 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b01cd9-f11e-4f1f-b4ca-e5034cc4263e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:17.125615 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b01cd9-f11e-4f1f-b4ca-e5034cc4263e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:17.132753 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b01cd9-f11e-4f1f-b4ca-e5034cc4263e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:17.134215 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b01cd9-f11e-4f1f-b4ca-e5034cc4263e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:17.143570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6353a-92f8-4f08-ab56-97ff1ded544e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:17.150076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-88b01cd9-f11e-4f1f-b4ca-e5034cc4263e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:17.150076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:17.150076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:17.150076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:17.150076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:17.150076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:17.150076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:17.150076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:17.150076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:17.150076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:17.150076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:17.150076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:17.150076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:17.150076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:17.150076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:17.150964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:17.150964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:17.150964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:17.150964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:17.150964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:17.150964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:17.150964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:17.150964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:17.150964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:17.150964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:17.150964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:17.150964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:17.150964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:17.150964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:17.150964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:17.150964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:17.150964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:17.151856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:17.151856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:17.151856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:17.151856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:17.151856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:17.151856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:17.151856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:17.151856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:17.151856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 391/767] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:17.156910 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b01cd9-f11e-4f1f-b4ca-e5034cc4263e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:17.184006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07404d2a-643c-420c-93e8-6acf46915a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:17.185043 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07404d2a-643c-420c-93e8-6acf46915a81 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:17.185528 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07404d2a-643c-420c-93e8-6acf46915a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:17.186024 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07404d2a-643c-420c-93e8-6acf46915a81 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:17.187034 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07404d2a-643c-420c-93e8-6acf46915a81 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:17.187537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07404d2a-643c-420c-93e8-6acf46915a81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:17.189160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07404d2a-643c-420c-93e8-6acf46915a81 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:17.194690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 377/768] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jul 5 12:42:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:17.200324 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07404d2a-643c-420c-93e8-6acf46915a81 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:17.228951 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:17.241395 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:17.324857 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07404d2a-643c-420c-93e8-6acf46915a81 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:17.363589 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3e08e-37ee-4064-945c-02e987a415ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:17.364566 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3e08e-37ee-4064-945c-02e987a415ee None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:17.364985 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b01cd9-f11e-4f1f-b4ca-e5034cc4263e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:17.365269 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3e08e-37ee-4064-945c-02e987a415ee None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:17.365734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3e08e-37ee-4064-945c-02e987a415ee None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:17.366722 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3e08e-37ee-4064-945c-02e987a415ee None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:17.367298 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3e08e-37ee-4064-945c-02e987a415ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:17.368867 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3e08e-37ee-4064-945c-02e987a415ee None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:17.374742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 378/769] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jul 5 12:42:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:17.380959 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901910b-e3f4-48c0-8b4d-8aacfc695acf None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:17.381582 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901910b-e3f4-48c0-8b4d-8aacfc695acf None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:17.382046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901910b-e3f4-48c0-8b4d-8aacfc695acf None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:17.383971 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 379/770] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:17.384979 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901910b-e3f4-48c0-8b4d-8aacfc695acf None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:17.406438 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e31624-18ab-4994-8e0a-2c738dc93f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:17.407040 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e31624-18ab-4994-8e0a-2c738dc93f65 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:17.407333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e31624-18ab-4994-8e0a-2c738dc93f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:17.407617 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e31624-18ab-4994-8e0a-2c738dc93f65 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:17.408425 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e31624-18ab-4994-8e0a-2c738dc93f65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:17.408764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e31624-18ab-4994-8e0a-2c738dc93f65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:17.410903 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e31624-18ab-4994-8e0a-2c738dc93f65 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:17.428027 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 392/771] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:17.429626 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816573dc-98c9-4324-bd12-63868c1aeb30 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:17.430364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816573dc-98c9-4324-bd12-63868c1aeb30 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:17.431218 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816573dc-98c9-4324-bd12-63868c1aeb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:17.451821 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-816573dc-98c9-4324-bd12-63868c1aeb30 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:17.453319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-816573dc-98c9-4324-bd12-63868c1aeb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:17.503066 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:17.525894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901910b-e3f4-48c0-8b4d-8aacfc695acf None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:17.550650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 393/772] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:17.550650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816573dc-98c9-4324-bd12-63868c1aeb30 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:17.578288 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66369a-1b6d-49d6-bae6-f6e78ff0d26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:17.578971 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66369a-1b6d-49d6-bae6-f6e78ff0d26f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:17.579480 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66369a-1b6d-49d6-bae6-f6e78ff0d26f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:17.579601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66369a-1b6d-49d6-bae6-f6e78ff0d26f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:17.580444 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66369a-1b6d-49d6-bae6-f6e78ff0d26f None admin] RBAC: Adding query filter params (interface=public, service_id=c6285ce49aa2459e9211ee8fc9ed2559, region_id=RegionOne) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:17.580784 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66369a-1b6d-49d6-bae6-f6e78ff0d26f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:17.582356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66369a-1b6d-49d6-bae6-f6e78ff0d26f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:17.591152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 380/773] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jul 5 12:42:17 2022] GET /identity/v3/endpoints?service_id=c6285ce49aa2459e9211ee8fc9ed2559&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:17.591808 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66369a-1b6d-49d6-bae6-f6e78ff0d26f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:17.606179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:17.670058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816573dc-98c9-4324-bd12-63868c1aeb30 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:17.701729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66369a-1b6d-49d6-bae6-f6e78ff0d26f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:17.708225 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09194ca-1689-4aca-8c0e-4c8c0fe0217b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:17.709196 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09194ca-1689-4aca-8c0e-4c8c0fe0217b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:17.709698 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09194ca-1689-4aca-8c0e-4c8c0fe0217b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:17.710180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09194ca-1689-4aca-8c0e-4c8c0fe0217b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:17.711249 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09194ca-1689-4aca-8c0e-4c8c0fe0217b None admin] RBAC: Adding query filter params (role.id=868c7a356c674ded875dd079f5a9f5e0, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=1fb7db02f8e945a7af39cb30c3d606f8) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:17.711770 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09194ca-1689-4aca-8c0e-4c8c0fe0217b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:17.713465 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09194ca-1689-4aca-8c0e-4c8c0fe0217b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:17.724955 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 394/774] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:42:17 2022] GET /identity/v3/role_assignments?user.id=1fb7db02f8e945a7af39cb30c3d606f8&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=868c7a356c674ded875dd079f5a9f5e0 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:17.726226 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09194ca-1689-4aca-8c0e-4c8c0fe0217b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:17.741538 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32ab75-277f-42d5-b0c0-15618157a72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:17.742390 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32ab75-277f-42d5-b0c0-15618157a72a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:17.742676 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32ab75-277f-42d5-b0c0-15618157a72a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:17.743045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32ab75-277f-42d5-b0c0-15618157a72a None admin] PATH_INFO: `/v3/services/network` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:17.743713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32ab75-277f-42d5-b0c0-15618157a72a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:17.745379 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32ab75-277f-42d5-b0c0-15618157a72a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:17.770837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-1f32ab75-277f-42d5-b0c0-15618157a72a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 12:42:17.770837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:17.770837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:17.770837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:17.770837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:17.770837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:17.770837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:17.770837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:17.770837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 12:42:17.770837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:17.770837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:17.770837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:17.770837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:17.770837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:17.770837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:17.770837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:17.770837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:17.777099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:17.777099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:17.777099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:17.777099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:17.777099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:17.777099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:17.777099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:17.777099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:17.777099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:17.777099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:17.777099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:17.777099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:17.777099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:17.777099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:17.777099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:17.777099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:17.777975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:17.777975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:17.777975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:17.777975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:17.777975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:17.777975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:17.777975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:17.777975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:17.777975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:17.777975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:17.777975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:17.777975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:17.777975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 12:42:17.777975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:17.777975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 381/775] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:17 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:17.785702 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32ab75-277f-42d5-b0c0-15618157a72a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:17.806103 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:17.916300 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32ab75-277f-42d5-b0c0-15618157a72a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:17.926113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09194ca-1689-4aca-8c0e-4c8c0fe0217b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:17.927935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:17.961827 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f76dff-3ac4-47e1-9585-69b66b8dbcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:17.962479 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f76dff-3ac4-47e1-9585-69b66b8dbcab None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:17.962769 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f76dff-3ac4-47e1-9585-69b66b8dbcab None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:17.963042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f76dff-3ac4-47e1-9585-69b66b8dbcab None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:17.963767 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f76dff-3ac4-47e1-9585-69b66b8dbcab None admin] RBAC: Adding query filter params (name=network) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:17.964068 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f76dff-3ac4-47e1-9585-69b66b8dbcab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:17.965481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f76dff-3ac4-47e1-9585-69b66b8dbcab None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:17.974900 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 382/776] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jul 5 12:42:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:17.982453 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f76dff-3ac4-47e1-9585-69b66b8dbcab None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:17.998619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e691ba8-a18f-43b8-9fc3-1fe4ab4c3995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:17.999395 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e691ba8-a18f-43b8-9fc3-1fe4ab4c3995 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:17.999677 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e691ba8-a18f-43b8-9fc3-1fe4ab4c3995 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:17.999953 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e691ba8-a18f-43b8-9fc3-1fe4ab4c3995 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:18.000718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e691ba8-a18f-43b8-9fc3-1fe4ab4c3995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:18.002943 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e691ba8-a18f-43b8-9fc3-1fe4ab4c3995 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:18.010532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 395/777] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jul 5 12:42:17 2022] GET /identity/v3/services => generated 772 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:18.117834 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:18.135035 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f76dff-3ac4-47e1-9585-69b66b8dbcab None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:18.189832 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bbe7e-4548-4261-90b0-833fa861dc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:18.190562 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bbe7e-4548-4261-90b0-833fa861dc9d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:18.190896 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bbe7e-4548-4261-90b0-833fa861dc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:18.191181 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bbe7e-4548-4261-90b0-833fa861dc9d None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:18.191900 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bbe7e-4548-4261-90b0-833fa861dc9d None admin] RBAC: Adding query filter params (type=network) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:18.192211 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bbe7e-4548-4261-90b0-833fa861dc9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:18.193685 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bbe7e-4548-4261-90b0-833fa861dc9d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:18.204272 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 383/778] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jul 5 12:42:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:18.213881 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e691ba8-a18f-43b8-9fc3-1fe4ab4c3995 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:18.306733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c20fd7-4025-4fed-adbe-5133d962cd6c None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:18.307068 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c20fd7-4025-4fed-adbe-5133d962cd6c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:18.307296 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c20fd7-4025-4fed-adbe-5133d962cd6c None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:18.308668 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 384/779] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:18.313776 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7ac1d-aa1e-4449-898f-1605c7e75917 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:18.314063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7ac1d-aa1e-4449-898f-1605c7e75917 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:18.314344 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7ac1d-aa1e-4449-898f-1605c7e75917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:18.335015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-a0a7ac1d-aa1e-4449-898f-1605c7e75917 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:18.336204 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a0a7ac1d-aa1e-4449-898f-1605c7e75917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:18.353635 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e691ba8-a18f-43b8-9fc3-1fe4ab4c3995 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:18.395205 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e4ee8-9f63-4d5c-8488-579ffb4155f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:18.396076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e4ee8-9f63-4d5c-8488-579ffb4155f3 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:18.396354 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e4ee8-9f63-4d5c-8488-579ffb4155f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:18.397035 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e4ee8-9f63-4d5c-8488-579ffb4155f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:18.397831 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e4ee8-9f63-4d5c-8488-579ffb4155f3 None admin] RBAC: Adding query filter params (interface=public, service_id=19702ed9dcf0465288a60de198902eb6, region_id=RegionOne) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:18.398148 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e4ee8-9f63-4d5c-8488-579ffb4155f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:18.400027 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e4ee8-9f63-4d5c-8488-579ffb4155f3 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:18.412781 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 396/780] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jul 5 12:42:18 2022] GET /identity/v3/endpoints?service_id=19702ed9dcf0465288a60de198902eb6&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:18.418281 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e4ee8-9f63-4d5c-8488-579ffb4155f3 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:18.431041 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 385/781] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:42:18.483710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:18.509525 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7ac1d-aa1e-4449-898f-1605c7e75917 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:18.603377 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e4ee8-9f63-4d5c-8488-579ffb4155f3 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:18.613244 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:18.640952 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7ac1d-aa1e-4449-898f-1605c7e75917 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:18.680229 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908ca5d-1c65-4739-a793-73e734367d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:18.681642 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908ca5d-1c65-4739-a793-73e734367d69 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:18.682246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908ca5d-1c65-4739-a793-73e734367d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:18.682729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908ca5d-1c65-4739-a793-73e734367d69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:18.689914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc6bb3-604b-451f-95ed-f429f81f86a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:18.690594 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc6bb3-604b-451f-95ed-f429f81f86a7 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:18.690936 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc6bb3-604b-451f-95ed-f429f81f86a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:18.691233 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc6bb3-604b-451f-95ed-f429f81f86a7 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:18.691908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc6bb3-604b-451f-95ed-f429f81f86a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:18.693319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc6bb3-604b-451f-95ed-f429f81f86a7 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:18.695769 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908ca5d-1c65-4739-a793-73e734367d69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:18.703811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-7908ca5d-1c65-4739-a793-73e734367d69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:42:18.703811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:18.703811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:18.703811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:18.703811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:18.703811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:18.703811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:18.703811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:18.703811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:18.703811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:18.703811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:18.703811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:18.703811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:18.703811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:18.703811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:18.703811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:18.705001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:18.705001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:18.705001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:18.705001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:18.705001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:18.705001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:18.705001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:18.705001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:18.705001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:18.705001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:18.705001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:18.705001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:18.705001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:18.705001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:18.705001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:18.705001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:18.705846 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:18.705846 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:18.705846 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:18.705846 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:18.705846 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:18.705846 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:18.705846 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:18.705846 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:18.705846 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:18.705846 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:18.705846 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:42:18.705846 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:18.708033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 397/782] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jul 5 12:42:18 2022] GET /identity/v3/services => generated 772 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:18.709258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 386/783] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:42:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:18.715555 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc6bb3-604b-451f-95ed-f429f81f86a7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:18.863939 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:18.874935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc6bb3-604b-451f-95ed-f429f81f86a7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:18.920259 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca697d-da02-4763-9635-d9dbfd85daf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:18.920961 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca697d-da02-4763-9635-d9dbfd85daf1 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:18.921236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca697d-da02-4763-9635-d9dbfd85daf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:18.921507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca697d-da02-4763-9635-d9dbfd85daf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:18.922253 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca697d-da02-4763-9635-d9dbfd85daf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:18.922556 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca697d-da02-4763-9635-d9dbfd85daf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:18.923923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca697d-da02-4763-9635-d9dbfd85daf1 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:18.933020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 398/784] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:42:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:18.938516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908ca5d-1c65-4739-a793-73e734367d69 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:19.070720 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908ca5d-1c65-4739-a793-73e734367d69 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:19.124658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161da6e-d478-4866-b099-6fee409825f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:19.125380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161da6e-d478-4866-b099-6fee409825f0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:19.125667 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161da6e-d478-4866-b099-6fee409825f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:19.125945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161da6e-d478-4866-b099-6fee409825f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:19.134166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:19.146611 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161da6e-d478-4866-b099-6fee409825f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:19.148128 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161da6e-d478-4866-b099-6fee409825f0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:19.171924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-f161da6e-d478-4866-b099-6fee409825f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:19.171924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:19.171924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:19.171924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:19.171924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:19.171924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:19.171924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:19.171924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:19.171924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:19.171924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:19.171924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:19.171924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:19.171924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:19.171924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:19.171924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:19.172911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:19.172911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:19.172911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:19.172911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:19.172911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:19.172911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:19.172911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:19.172911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:19.172911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:19.172911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:19.172911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:19.172911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:19.172911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:19.172911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:19.172911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:19.172911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:19.172911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:19.173814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:19.173814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:19.173814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:19.173814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:19.176689 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 387/785] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:19.178771 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca697d-da02-4763-9635-d9dbfd85daf1 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:19.342502 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca697d-da02-4763-9635-d9dbfd85daf1 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:19.343276 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db6961-84af-4564-81b5-68e15f3b3530 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:19.343670 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db6961-84af-4564-81b5-68e15f3b3530 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:19.344125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db6961-84af-4564-81b5-68e15f3b3530 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:19.345944 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 388/786] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:42:19.351233 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3703eb7-aef1-4267-8418-db3aa7243d45 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:19.351521 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3703eb7-aef1-4267-8418-db3aa7243d45 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:19.351803 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3703eb7-aef1-4267-8418-db3aa7243d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:19.371822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c3703eb7-aef1-4267-8418-db3aa7243d45 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:19.373057 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c3703eb7-aef1-4267-8418-db3aa7243d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:19.408575 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4065e54-1781-40bb-a384-cbfcc995ee02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:19.409368 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4065e54-1781-40bb-a384-cbfcc995ee02 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:19.409781 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4065e54-1781-40bb-a384-cbfcc995ee02 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:19.410058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4065e54-1781-40bb-a384-cbfcc995ee02 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:19.410788 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4065e54-1781-40bb-a384-cbfcc995ee02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:19.411095 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4065e54-1781-40bb-a384-cbfcc995ee02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:19.412576 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4065e54-1781-40bb-a384-cbfcc995ee02 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:19.427184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 399/787] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:19.433098 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4065e54-1781-40bb-a384-cbfcc995ee02 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:19.462273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:19.522597 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 389/788] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:19.547576 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3703eb7-aef1-4267-8418-db3aa7243d45 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:19.642768 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4065e54-1781-40bb-a384-cbfcc995ee02 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:19.665195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3703eb7-aef1-4267-8418-db3aa7243d45 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:19.686074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:19.707333 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da2b8b-7e46-4d80-a09b-04b5eb29e61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:19.708508 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da2b8b-7e46-4d80-a09b-04b5eb29e61c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:19.709249 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da2b8b-7e46-4d80-a09b-04b5eb29e61c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:19.709729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da2b8b-7e46-4d80-a09b-04b5eb29e61c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:19.723142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da2b8b-7e46-4d80-a09b-04b5eb29e61c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:19.732572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-a8da2b8b-7e46-4d80-a09b-04b5eb29e61c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:19.732572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:19.732572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:19.732572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:19.732572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:19.732572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:19.732572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:19.732572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:19.732572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:19.732572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:19.732572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:19.732572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:19.732572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:19.732572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:19.732572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:19.732572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:19.734448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:19.734448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:19.734448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:19.734448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:19.734448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:19.734448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:19.734448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:19.734448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:19.734448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:19.734448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:19.734448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:19.734448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:19.734448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:19.734448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:19.734448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:19.734448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:19.735274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:19.735274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:19.735274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:19.735274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:19.735274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:19.735274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:19.735274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:19.735274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:19.735274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:19.735274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:19.735274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:19.735274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:19.737532 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 390/789] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:42:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:19.744143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da2b8b-7e46-4d80-a09b-04b5eb29e61c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:19.749384 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e795913-05cb-4170-ac09-6ce82c288ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:19.750265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e795913-05cb-4170-ac09-6ce82c288ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:19.750668 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e795913-05cb-4170-ac09-6ce82c288ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:19.750953 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e795913-05cb-4170-ac09-6ce82c288ca5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:19.760432 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e795913-05cb-4170-ac09-6ce82c288ca5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:19.761929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e795913-05cb-4170-ac09-6ce82c288ca5 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:19.791250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-3e795913-05cb-4170-ac09-6ce82c288ca5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:42:19.791250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:19.791250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:19.791250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:19.791250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:19.791250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:19.791250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:19.791250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:19.791250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:19.791250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:19.791250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:19.791250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:19.791250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:19.791250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:19.791250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:19.791250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:19.792328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:19.792328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:19.792328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:19.792328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:19.792328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:19.792328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:19.792328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:19.792328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:19.792328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:19.792328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:19.792328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:19.792328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:19.792328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:19.792328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:19.792328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:19.792328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:19.792328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:19.792328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:19.793334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:19.793334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:19.793334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:19.793334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:19.793334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:19.793334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:19.793334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:19.793334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:19.793334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:42:19.793334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:19.796693 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 400/790] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jul 5 12:42:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:19.797956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e795913-05cb-4170-ac09-6ce82c288ca5 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:19.861448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da2b8b-7e46-4d80-a09b-04b5eb29e61c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:19.898821 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b196f3-4500-414d-8a01-7dde55262d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:19.899973 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b196f3-4500-414d-8a01-7dde55262d22 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:19.900467 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b196f3-4500-414d-8a01-7dde55262d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:19.901026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b196f3-4500-414d-8a01-7dde55262d22 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:19.901969 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b196f3-4500-414d-8a01-7dde55262d22 None admin] RBAC: Adding query filter params (name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:19.902479 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b196f3-4500-414d-8a01-7dde55262d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:19.904077 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b196f3-4500-414d-8a01-7dde55262d22 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:19.910697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:19.914878 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 391/791] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jul 5 12:42:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:19.924676 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b196f3-4500-414d-8a01-7dde55262d22 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:19.951532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e795913-05cb-4170-ac09-6ce82c288ca5 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:19.964217 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:20.004485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8cdc1-a22a-4846-b010-2d6641aa4c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:20.005198 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8cdc1-a22a-4846-b010-2d6641aa4c0d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:20.005477 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8cdc1-a22a-4846-b010-2d6641aa4c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:20.005758 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8cdc1-a22a-4846-b010-2d6641aa4c0d None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:20.006591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8cdc1-a22a-4846-b010-2d6641aa4c0d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:20.006907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8cdc1-a22a-4846-b010-2d6641aa4c0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:20.008342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8cdc1-a22a-4846-b010-2d6641aa4c0d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:20.030362 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 401/792] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jul 5 12:42:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:20.031627 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8cdc1-a22a-4846-b010-2d6641aa4c0d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:20.042710 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b196f3-4500-414d-8a01-7dde55262d22 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:20.107913 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2637b9e-6b1a-4886-9dad-c883406fc3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:20.108745 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2637b9e-6b1a-4886-9dad-c883406fc3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:20.109044 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2637b9e-6b1a-4886-9dad-c883406fc3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:20.109355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2637b9e-6b1a-4886-9dad-c883406fc3c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:20.126748 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2637b9e-6b1a-4886-9dad-c883406fc3c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:20.129089 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2637b9e-6b1a-4886-9dad-c883406fc3c0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:20.135219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8cdc1-a22a-4846-b010-2d6641aa4c0d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:20.164977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-a2637b9e-6b1a-4886-9dad-c883406fc3c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:20.164977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:20.164977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:20.164977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:20.164977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:20.164977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:20.164977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:20.164977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:20.164977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:20.164977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:20.164977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:20.164977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:20.164977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:20.164977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:20.164977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:20.165945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:20.165945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:20.165945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:20.165945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:20.165945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:20.165945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:20.165945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:20.165945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:20.165945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:20.165945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:20.165945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:20.165945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:20.165945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:20.165945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:20.165945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:20.165945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:20.165945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:20.166825 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:20.166825 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:20.166825 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:20.166825 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:20.167058 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 392/793] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:20.177166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2637b9e-6b1a-4886-9dad-c883406fc3c0 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:20.199514 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c7303-f4ac-4c23-b697-9bae3dd2b8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:20.200182 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c7303-f4ac-4c23-b697-9bae3dd2b8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:20.200470 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c7303-f4ac-4c23-b697-9bae3dd2b8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:20.202396 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c7303-f4ac-4c23-b697-9bae3dd2b8d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:20.210034 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:20.305431 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:20.316500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c7303-f4ac-4c23-b697-9bae3dd2b8d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:20.318000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c7303-f4ac-4c23-b697-9bae3dd2b8d9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:20.325584 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2637b9e-6b1a-4886-9dad-c883406fc3c0 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:20.378021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba2e19-8b5f-4149-a84f-b0c401ba7eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:20.379174 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba2e19-8b5f-4149-a84f-b0c401ba7eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:20.379879 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba2e19-8b5f-4149-a84f-b0c401ba7eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:20.380168 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba2e19-8b5f-4149-a84f-b0c401ba7eb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:20.381210 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba2e19-8b5f-4149-a84f-b0c401ba7eb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:20.381579 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba2e19-8b5f-4149-a84f-b0c401ba7eb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:20.383923 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba2e19-8b5f-4149-a84f-b0c401ba7eb9 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:20.401597 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 393/794] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:20.403234 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fa522-c073-4f8c-af84-c3f3d13319fa None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:20.403529 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fa522-c073-4f8c-af84-c3f3d13319fa None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:20.403809 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fa522-c073-4f8c-af84-c3f3d13319fa None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:20.408679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 394/795] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:20.410149 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fa522-c073-4f8c-af84-c3f3d13319fa None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:20.450820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 402/796] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:42:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:42:20.452234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb27b5d-e0f9-4d6e-b5f9-560ab09a74bd None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:20.452524 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb27b5d-e0f9-4d6e-b5f9-560ab09a74bd None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:20.452969 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb27b5d-e0f9-4d6e-b5f9-560ab09a74bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:20.474566 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-1bb27b5d-e0f9-4d6e-b5f9-560ab09a74bd None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:20.476280 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1bb27b5d-e0f9-4d6e-b5f9-560ab09a74bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:20.506456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:20.532909 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fa522-c073-4f8c-af84-c3f3d13319fa None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:20.553015 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 403/797] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:20.554079 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb27b5d-e0f9-4d6e-b5f9-560ab09a74bd None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:20.594512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae005dd1-1ac4-4338-b477-cec88a38583d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:20.595485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae005dd1-1ac4-4338-b477-cec88a38583d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:20.595774 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae005dd1-1ac4-4338-b477-cec88a38583d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:20.596056 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae005dd1-1ac4-4338-b477-cec88a38583d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:20.606614 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae005dd1-1ac4-4338-b477-cec88a38583d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:20.608732 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae005dd1-1ac4-4338-b477-cec88a38583d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:20.630621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-ae005dd1-1ac4-4338-b477-cec88a38583d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:42:20.630621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:20.630621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:20.630621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:20.630621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:20.630621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:20.630621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:20.630621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:20.630621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:20.630621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:20.630621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:20.630621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:20.630621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:20.630621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:20.630621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:20.630621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:20.631619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:20.631619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:20.631619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:20.631619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:20.631619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:20.631619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:20.631619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:20.631619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:20.631619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:20.631619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:20.631619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:20.631619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:20.631619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:20.631619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:20.631619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:20.631619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:20.631619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:20.631619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:20.632570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:20.632570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:20.632570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:20.632570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:20.632570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:20.632570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:20.632570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:20.632570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:20.632570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:42:20.632570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:20.632570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 395/798] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jul 5 12:42:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:20.633204 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae005dd1-1ac4-4338-b477-cec88a38583d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:20.651088 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:20.688884 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb27b5d-e0f9-4d6e-b5f9-560ab09a74bd None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:20.731026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072ac6b-7e62-433b-99b5-7c188a8e7f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:20.731026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072ac6b-7e62-433b-99b5-7c188a8e7f1e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:20.731026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072ac6b-7e62-433b-99b5-7c188a8e7f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:20.731026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072ac6b-7e62-433b-99b5-7c188a8e7f1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:20.740389 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072ac6b-7e62-433b-99b5-7c188a8e7f1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:20.741882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072ac6b-7e62-433b-99b5-7c188a8e7f1e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:20.753968 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae005dd1-1ac4-4338-b477-cec88a38583d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:20.760341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-f072ac6b-7e62-433b-99b5-7c188a8e7f1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:20.760341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:20.760341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:20.760341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:20.760341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:20.760341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:20.760341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:20.760341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:20.760341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:20.760341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:20.760341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:20.760341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:20.760341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:20.760341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:20.760341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:20.761450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:20.761450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:20.761450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:20.761450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:20.761450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:20.761450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:20.761450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:20.761450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:20.761450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:20.761450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:20.761450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:20.761450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:20.761450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:20.761450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:20.761450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:20.761450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:20.761450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:20.762350 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:20.762350 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:20.762350 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:20.762350 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:20.766427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 404/799] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:20.767129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072ac6b-7e62-433b-99b5-7c188a8e7f1e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:20.787489 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:20.796756 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e25c4-a58a-4618-bd8a-07e97615ba70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:20.797571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e25c4-a58a-4618-bd8a-07e97615ba70 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:20.798208 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e25c4-a58a-4618-bd8a-07e97615ba70 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:20.798208 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e25c4-a58a-4618-bd8a-07e97615ba70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:20.810800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e25c4-a58a-4618-bd8a-07e97615ba70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:20.818925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-105e25c4-a58a-4618-bd8a-07e97615ba70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:42:20.818925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:20.818925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:20.818925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:20.818925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:20.818925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:20.818925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:20.818925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:20.818925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:20.818925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:20.818925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:20.818925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:20.818925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:20.818925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:20.818925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:20.818925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:20.820114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:20.820114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:20.820114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:20.820114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:20.820114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:20.820114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:20.820114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:20.820114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:20.820114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:20.820114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:20.820114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:20.820114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:20.820114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:20.820114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:20.820114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:20.820114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:20.820980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:20.820980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:20.820980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:20.820980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:20.820980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:20.820980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:20.820980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:20.820980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:20.820980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:20.820980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:20.820980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:42:20.820980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:20.820980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 396/800] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:42:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:20.821687 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ab1de-4eed-4f4e-9a3e-b344a36a1597 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:20.821687 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ab1de-4eed-4f4e-9a3e-b344a36a1597 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:20.821954 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ab1de-4eed-4f4e-9a3e-b344a36a1597 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:20.823534 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 397/801] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:20.824249 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ab1de-4eed-4f4e-9a3e-b344a36a1597 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:20.889602 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072ac6b-7e62-433b-99b5-7c188a8e7f1e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:20.903695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:20.927863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca234d-b615-4555-9a74-2b83dec1abcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:20.928675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca234d-b615-4555-9a74-2b83dec1abcb None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:20.928966 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca234d-b615-4555-9a74-2b83dec1abcb None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:20.929249 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca234d-b615-4555-9a74-2b83dec1abcb None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:20.930102 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca234d-b615-4555-9a74-2b83dec1abcb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:20.930414 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca234d-b615-4555-9a74-2b83dec1abcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:20.931925 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca234d-b615-4555-9a74-2b83dec1abcb None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:20.938224 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ab1de-4eed-4f4e-9a3e-b344a36a1597 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:20.953879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 405/802] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jul 5 12:42:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:20.953879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa56360-e9ee-4a58-9e3c-736cd7611eeb None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:20.953879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa56360-e9ee-4a58-9e3c-736cd7611eeb None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:20.953879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa56360-e9ee-4a58-9e3c-736cd7611eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:20.967934 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-5aa56360-e9ee-4a58-9e3c-736cd7611eeb None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:20.969164 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5aa56360-e9ee-4a58-9e3c-736cd7611eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:20.985131 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927f4c8-6267-4417-ac26-f7eb8669b0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:20.985835 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927f4c8-6267-4417-ac26-f7eb8669b0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:20.986196 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927f4c8-6267-4417-ac26-f7eb8669b0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:20.986576 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927f4c8-6267-4417-ac26-f7eb8669b0a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:20.987431 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927f4c8-6267-4417-ac26-f7eb8669b0a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:20.987895 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927f4c8-6267-4417-ac26-f7eb8669b0a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:20.989314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927f4c8-6267-4417-ac26-f7eb8669b0a1 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:21.006585 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 398/803] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:21.006585 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927f4c8-6267-4417-ac26-f7eb8669b0a1 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:21.049916 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 406/804] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:21.050639 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa56360-e9ee-4a58-9e3c-736cd7611eeb None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:21.057930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:21.118562 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927f4c8-6267-4417-ac26-f7eb8669b0a1 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:21.149119 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:21.155382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dabc21-0f9e-438b-a9f0-6c8d9ee7b874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:21.156060 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dabc21-0f9e-438b-a9f0-6c8d9ee7b874 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:21.156345 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dabc21-0f9e-438b-a9f0-6c8d9ee7b874 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:21.156668 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dabc21-0f9e-438b-a9f0-6c8d9ee7b874 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:21.157420 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dabc21-0f9e-438b-a9f0-6c8d9ee7b874 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:21.157728 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dabc21-0f9e-438b-a9f0-6c8d9ee7b874 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:21.159102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dabc21-0f9e-438b-a9f0-6c8d9ee7b874 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:21.159381 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa56360-e9ee-4a58-9e3c-736cd7611eeb None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:21.169406 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 399/805] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:42:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:21.170071 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dabc21-0f9e-438b-a9f0-6c8d9ee7b874 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:21.201204 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e22c6-cc8a-4abe-a640-328f8616776f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:21.202143 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e22c6-cc8a-4abe-a640-328f8616776f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:21.202436 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e22c6-cc8a-4abe-a640-328f8616776f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:21.202715 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e22c6-cc8a-4abe-a640-328f8616776f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:21.213729 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e22c6-cc8a-4abe-a640-328f8616776f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:21.215180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e22c6-cc8a-4abe-a640-328f8616776f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:21.234114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-e37e22c6-cc8a-4abe-a640-328f8616776f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:21.234114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:21.234114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:21.234114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:21.234114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:21.234114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:21.234114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:21.234114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:21.234114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:21.234114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:21.234114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:21.234114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:21.234114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:21.234114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:21.234114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:21.235054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:21.235054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:21.235054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:21.235054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:21.235054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:21.235054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:21.235054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:21.235054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:21.235054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:21.235054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:21.235054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:21.235054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:21.235054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:21.235054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:21.235054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:21.235054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:21.235054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:21.236430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:21.236430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:21.236430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:21.236430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:21.236430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 407/806] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:21.236430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e22c6-cc8a-4abe-a640-328f8616776f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:21.282834 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dabc21-0f9e-438b-a9f0-6c8d9ee7b874 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:21.292875 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:21.321185 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22458f-e941-44ff-a4d0-153fd792f89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:21.321972 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22458f-e941-44ff-a4d0-153fd792f89c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:21.322252 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22458f-e941-44ff-a4d0-153fd792f89c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:21.322526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22458f-e941-44ff-a4d0-153fd792f89c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:21.329235 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22458f-e941-44ff-a4d0-153fd792f89c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:21.330658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22458f-e941-44ff-a4d0-153fd792f89c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:21.338102 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e22c6-cc8a-4abe-a640-328f8616776f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:21.344407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-ad22458f-e941-44ff-a4d0-153fd792f89c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:21.344407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:21.344407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:21.344407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:21.344407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:21.344407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:21.344407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:21.344407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:21.344407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:21.344407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:21.344407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:21.344407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:21.344407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:21.344407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:21.344407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:21.345338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:21.345338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:21.345338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:21.345338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:21.345338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:21.345338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:21.345338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:21.345338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:21.345338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:21.345338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:21.345338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:21.345338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:21.345338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:21.345338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:21.345338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:21.345338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:21.345338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:21.346238 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:21.346238 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:21.346238 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:21.346238 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:21.346238 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:21.346238 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:21.346238 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:21.346238 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:21.346238 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 400/807] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:21.346724 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22458f-e941-44ff-a4d0-153fd792f89c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:21.376347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5f9cf-bb36-4f2d-9c62-ce860af03068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:21.377180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5f9cf-bb36-4f2d-9c62-ce860af03068 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:21.377461 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5f9cf-bb36-4f2d-9c62-ce860af03068 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:21.377733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5f9cf-bb36-4f2d-9c62-ce860af03068 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:21.378887 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5f9cf-bb36-4f2d-9c62-ce860af03068 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:21.380253 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5f9cf-bb36-4f2d-9c62-ce860af03068 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:21.393721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-07b5f9cf-bb36-4f2d-9c62-ce860af03068 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 12:42:21.393721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:21.393721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:21.393721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:21.393721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:21.393721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:21.393721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:21.393721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:21.393721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 12:42:21.393721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:21.393721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:21.393721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:21.393721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:21.393721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:21.393721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:21.393721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:21.394905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:21.394905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:21.394905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:21.394905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:21.394905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:21.394905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:21.394905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:21.394905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:21.394905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:21.394905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:21.394905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:21.394905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:21.394905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:21.394905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:21.394905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:21.394905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:21.395776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:21.395776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:21.395776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:21.395776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:21.395776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:21.395776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:21.395776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:21.395776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:21.395776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:21.395776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:21.395776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:21.395776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:21.395776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:21.395776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 12:42:21.395776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:21.395776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 408/808] 10.222.0.36 () {56 vars in 1129 bytes} [Tue Jul 5 12:42:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:21.396666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ef474-ff35-4da8-b894-a0582c5b0722 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:21.396666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ef474-ff35-4da8-b894-a0582c5b0722 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:21.396805 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ef474-ff35-4da8-b894-a0582c5b0722 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:21.398164 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 409/809] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:21.400371 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ef474-ff35-4da8-b894-a0582c5b0722 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:21.404749 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:21.450773 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22458f-e941-44ff-a4d0-153fd792f89c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:21.485345 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d676177-e4ac-4cbb-b1e3-7cafb0a19c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:21.486138 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d676177-e4ac-4cbb-b1e3-7cafb0a19c9f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:21.486428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d676177-e4ac-4cbb-b1e3-7cafb0a19c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:21.486752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d676177-e4ac-4cbb-b1e3-7cafb0a19c9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:21.497549 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d676177-e4ac-4cbb-b1e3-7cafb0a19c9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:21.498998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d676177-e4ac-4cbb-b1e3-7cafb0a19c9f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:21.503170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ef474-ff35-4da8-b894-a0582c5b0722 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:21.516198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-1d676177-e4ac-4cbb-b1e3-7cafb0a19c9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:21.516198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:21.516198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:21.516198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:21.516198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:21.516198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:21.516198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:21.516198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:21.516198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:21.516198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:21.516198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:21.516198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:21.516198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:21.516198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:21.516198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:21.517139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:21.517139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:21.517139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:21.517139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:21.517139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:21.517139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:21.517139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:21.517139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:21.517139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:21.517139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:21.517139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:21.517139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:21.517139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:21.517139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:21.517139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:21.517139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:21.517139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:21.518020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:21.518020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:21.518020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:21.518020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:21.518020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 401/810] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:21.518304 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d676177-e4ac-4cbb-b1e3-7cafb0a19c9f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:21.526758 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:21.541051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de64bf-5756-4cfc-a2cc-58c6617d6151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:21.541724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de64bf-5756-4cfc-a2cc-58c6617d6151 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:21.542011 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de64bf-5756-4cfc-a2cc-58c6617d6151 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:21.542289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de64bf-5756-4cfc-a2cc-58c6617d6151 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:21.546325 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de64bf-5756-4cfc-a2cc-58c6617d6151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:21.546325 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de64bf-5756-4cfc-a2cc-58c6617d6151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:21.546325 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de64bf-5756-4cfc-a2cc-58c6617d6151 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:21.556290 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 410/811] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:21.557150 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de64bf-5756-4cfc-a2cc-58c6617d6151 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:21.620107 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d676177-e4ac-4cbb-b1e3-7cafb0a19c9f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:21.622826 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:21.654063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abb2d0-b8e4-4c41-907e-f3a798543af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:21.654800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abb2d0-b8e4-4c41-907e-f3a798543af5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:21.654989 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abb2d0-b8e4-4c41-907e-f3a798543af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:21.655260 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abb2d0-b8e4-4c41-907e-f3a798543af5 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:21.656040 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abb2d0-b8e4-4c41-907e-f3a798543af5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:21.656344 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abb2d0-b8e4-4c41-907e-f3a798543af5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:21.657813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abb2d0-b8e4-4c41-907e-f3a798543af5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:21.658262 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de64bf-5756-4cfc-a2cc-58c6617d6151 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:21.669321 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 402/812] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:21.670642 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a674d-f8f1-4fbd-b056-c4bf6b5a9fda None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:21.670861 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a674d-f8f1-4fbd-b056-c4bf6b5a9fda None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:21.671144 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a674d-f8f1-4fbd-b056-c4bf6b5a9fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:21.687212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ec7a674d-f8f1-4fbd-b056-c4bf6b5a9fda None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:21.688394 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ec7a674d-f8f1-4fbd-b056-c4bf6b5a9fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:21.692766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95dd17-d342-4005-84ab-30ea057aa950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:21.693439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95dd17-d342-4005-84ab-30ea057aa950 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:21.693723 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95dd17-d342-4005-84ab-30ea057aa950 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:21.694003 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95dd17-d342-4005-84ab-30ea057aa950 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:21.694712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95dd17-d342-4005-84ab-30ea057aa950 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:21.695024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95dd17-d342-4005-84ab-30ea057aa950 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:21.696403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95dd17-d342-4005-84ab-30ea057aa950 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:21.701050 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 411/813] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jul 5 12:42:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:21.701872 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95dd17-d342-4005-84ab-30ea057aa950 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:21.748161 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:21.756310 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 403/814] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:21.757189 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a674d-f8f1-4fbd-b056-c4bf6b5a9fda None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:21.807875 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95dd17-d342-4005-84ab-30ea057aa950 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:21.841158 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67d904-f37b-478f-a618-6a8d1d4dc2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:21.841823 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67d904-f37b-478f-a618-6a8d1d4dc2fc None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:21.842107 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67d904-f37b-478f-a618-6a8d1d4dc2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:21.842387 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67d904-f37b-478f-a618-6a8d1d4dc2fc None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:21.843110 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67d904-f37b-478f-a618-6a8d1d4dc2fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:21.843415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67d904-f37b-478f-a618-6a8d1d4dc2fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:21.844823 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67d904-f37b-478f-a618-6a8d1d4dc2fc None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:21.852373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:21.857098 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 412/815] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:21.858065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67d904-f37b-478f-a618-6a8d1d4dc2fc None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:21.859100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a674d-f8f1-4fbd-b056-c4bf6b5a9fda None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:21.893848 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc660d-3943-4a20-9279-11bc9e238e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:21.894649 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc660d-3943-4a20-9279-11bc9e238e36 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:21.894933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc660d-3943-4a20-9279-11bc9e238e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:21.895208 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc660d-3943-4a20-9279-11bc9e238e36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:21.901828 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc660d-3943-4a20-9279-11bc9e238e36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:21.903308 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc660d-3943-4a20-9279-11bc9e238e36 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:21.917157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-88dc660d-3943-4a20-9279-11bc9e238e36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:21.917157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:21.917157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:21.917157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:21.917157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:21.917157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:21.917157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:21.917157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:21.917157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:21.917157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:21.917157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:21.917157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:21.917157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:21.917157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:21.917157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:21.918026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:21.918026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:21.918026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:21.918026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:21.918026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:21.918026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:21.918026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:21.918026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:21.918026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:21.918026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:21.918026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:21.918026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:21.918026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:21.918026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:21.918026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:21.918026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:21.918026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:21.919191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:21.919191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:21.919191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:21.919191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:21.919191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:21.919191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:21.919191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:21.919191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:21.919191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 404/816] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:21.919927 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc660d-3943-4a20-9279-11bc9e238e36 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:21.960815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67d904-f37b-478f-a618-6a8d1d4dc2fc None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:21.963079 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:21.994247 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74adec2-3259-4402-8310-2df6ad381385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:21.994910 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74adec2-3259-4402-8310-2df6ad381385 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:21.995225 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74adec2-3259-4402-8310-2df6ad381385 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:21.995526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74adec2-3259-4402-8310-2df6ad381385 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:21.996741 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74adec2-3259-4402-8310-2df6ad381385 None admin] RBAC: Adding query filter params (role.id=868c7a356c674ded875dd079f5a9f5e0, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=cdf37a42279a466b85906b23751f9c22) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:21.997421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74adec2-3259-4402-8310-2df6ad381385 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:21.999256 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74adec2-3259-4402-8310-2df6ad381385 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:22.005988 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 413/817] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:42:21 2022] GET /identity/v3/role_assignments?user.id=cdf37a42279a466b85906b23751f9c22&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=868c7a356c674ded875dd079f5a9f5e0 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:22.006777 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74adec2-3259-4402-8310-2df6ad381385 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:22.018283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc660d-3943-4a20-9279-11bc9e238e36 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:22.059455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92b734-3b55-4a04-a700-b0fa45d24198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:22.060155 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b734-3b55-4a04-a700-b0fa45d24198 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:22.060442 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b734-3b55-4a04-a700-b0fa45d24198 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:22.060780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b734-3b55-4a04-a700-b0fa45d24198 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:22.061528 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92b734-3b55-4a04-a700-b0fa45d24198 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:22.061840 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92b734-3b55-4a04-a700-b0fa45d24198 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:22.063286 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92b734-3b55-4a04-a700-b0fa45d24198 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:22.069401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 405/818] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jul 5 12:42:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:22.074027 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92b734-3b55-4a04-a700-b0fa45d24198 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:22.096177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:22.130734 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74adec2-3259-4402-8310-2df6ad381385 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:22.171740 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5212711-174f-439a-b972-39d573432a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:22.172555 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5212711-174f-439a-b972-39d573432a31 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:22.172876 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5212711-174f-439a-b972-39d573432a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:22.173156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5212711-174f-439a-b972-39d573432a31 None admin] PATH_INFO: `/v3/services/network` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:22.173818 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5212711-174f-439a-b972-39d573432a31 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:22.175787 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5212711-174f-439a-b972-39d573432a31 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:22.187921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-e5212711-174f-439a-b972-39d573432a31 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 12:42:22.187921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:22.187921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:22.187921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:22.187921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:22.187921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:22.187921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:22.187921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:22.187921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 12:42:22.187921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:22.187921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:22.187921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:22.187921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:22.187921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:22.187921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:22.187921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:22.187921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:22.189029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:22.189029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:22.189029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:22.189029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:22.189029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:22.189029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:22.189029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:22.189029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:22.189029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:22.189029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:22.189029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:22.189029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:22.189029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:22.189029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:22.189029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:22.189029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:22.189855 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:22.189855 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:22.189855 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:22.189855 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:22.189855 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:22.189855 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:22.189855 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:22.189855 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:22.189855 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:22.189855 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:22.189855 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:22.189855 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:22.189855 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 12:42:22.189855 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:22.191152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 414/819] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:22 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:22.191152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5212711-174f-439a-b972-39d573432a31 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:22.197802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92b734-3b55-4a04-a700-b0fa45d24198 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:22.230436 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:22.238679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a86f8b-28e9-4c0a-9592-748dbc337bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:22.244653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a86f8b-28e9-4c0a-9592-748dbc337bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:22.244653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a86f8b-28e9-4c0a-9592-748dbc337bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:22.244653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a86f8b-28e9-4c0a-9592-748dbc337bd6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:22.247649 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a86f8b-28e9-4c0a-9592-748dbc337bd6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:22.249153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a86f8b-28e9-4c0a-9592-748dbc337bd6 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:22.263729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-73a86f8b-28e9-4c0a-9592-748dbc337bd6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:42:22.263729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:22.263729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:22.263729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:22.263729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:22.263729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:22.263729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:22.263729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:22.263729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:22.263729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:22.263729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:22.263729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:22.263729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:22.263729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:22.263729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:22.263729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:22.264705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:22.264705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:22.264705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:22.264705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:22.264705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:22.264705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:22.264705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:22.264705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:22.264705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:22.264705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:22.264705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:22.264705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:22.264705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:22.264705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:22.264705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:22.264705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:22.264705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:22.264705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:22.265686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:22.265686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:22.265686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:22.265686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:22.265686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:22.265686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:22.265686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:22.265686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:22.265686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:42:22.265686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:22.265686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 406/820] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:42:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:22.266316 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a86f8b-28e9-4c0a-9592-748dbc337bd6 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:22.311677 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5212711-174f-439a-b972-39d573432a31 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:22.348516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:22.350694 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad736eb-0e91-440f-9b07-d8557fd70af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:22.351370 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad736eb-0e91-440f-9b07-d8557fd70af1 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:22.351656 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad736eb-0e91-440f-9b07-d8557fd70af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:22.351930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad736eb-0e91-440f-9b07-d8557fd70af1 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:22.352767 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad736eb-0e91-440f-9b07-d8557fd70af1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:22.353077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad736eb-0e91-440f-9b07-d8557fd70af1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:22.354516 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad736eb-0e91-440f-9b07-d8557fd70af1 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:22.369245 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 415/821] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:22.370079 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad736eb-0e91-440f-9b07-d8557fd70af1 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:22.377065 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a86f8b-28e9-4c0a-9592-748dbc337bd6 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:22.415435 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e0d0f-0921-425f-88a2-5eef0b2224ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:22.416254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e0d0f-0921-425f-88a2-5eef0b2224ec None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:22.416547 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e0d0f-0921-425f-88a2-5eef0b2224ec None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:22.416860 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e0d0f-0921-425f-88a2-5eef0b2224ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:22.417606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e0d0f-0921-425f-88a2-5eef0b2224ec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:22.418968 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e0d0f-0921-425f-88a2-5eef0b2224ec None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:22.462756 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:22.470978 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad736eb-0e91-440f-9b07-d8557fd70af1 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:22.503601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d3b7c-75f2-4199-8d77-a4c16dc51710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:22.504264 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3b7c-75f2-4199-8d77-a4c16dc51710 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:22.504544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3b7c-75f2-4199-8d77-a4c16dc51710 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:22.504848 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3b7c-75f2-4199-8d77-a4c16dc51710 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:22.505547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d3b7c-75f2-4199-8d77-a4c16dc51710 None admin] RBAC: Adding query filter params (name=network) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:22.505852 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d3b7c-75f2-4199-8d77-a4c16dc51710 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:22.507210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d3b7c-75f2-4199-8d77-a4c16dc51710 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:22.511631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 416/822] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jul 5 12:42:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:22.512498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d3b7c-75f2-4199-8d77-a4c16dc51710 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:22.556627 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 407/823] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jul 5 12:42:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:42:22.556627 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e0d0f-0921-425f-88a2-5eef0b2224ec None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:22.655753 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d3b7c-75f2-4199-8d77-a4c16dc51710 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:22.685799 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e0d0f-0921-425f-88a2-5eef0b2224ec None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:22.713268 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172cf6d1-3be6-458e-9d96-5aef6fb0c130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:22.713268 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cf6d1-3be6-458e-9d96-5aef6fb0c130 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:22.713887 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cf6d1-3be6-458e-9d96-5aef6fb0c130 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:22.713887 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cf6d1-3be6-458e-9d96-5aef6fb0c130 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:22.715857 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172cf6d1-3be6-458e-9d96-5aef6fb0c130 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:22.715857 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172cf6d1-3be6-458e-9d96-5aef6fb0c130 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:22.718688 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172cf6d1-3be6-458e-9d96-5aef6fb0c130 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:22.723950 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:22.730970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d1d5e-4d22-4a39-96e6-ffe0effdca36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:22.731981 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d1d5e-4d22-4a39-96e6-ffe0effdca36 None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:22.732264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d1d5e-4d22-4a39-96e6-ffe0effdca36 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:22.732692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d1d5e-4d22-4a39-96e6-ffe0effdca36 None admin] PATH_INFO: `/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/ab47c91ba7854bc09f656607dbb41cfc/roles/fb140b8a852547a5b8f339dce8d3440e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:22.742470 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 417/824] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jul 5 12:42:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:22.743375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172cf6d1-3be6-458e-9d96-5aef6fb0c130 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:22.756293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d1d5e-4d22-4a39-96e6-ffe0effdca36 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4190347294b48c096d7aa9d3a479d12, user_id=ab47c91ba7854bc09f656607dbb41cfc, role_id=fb140b8a852547a5b8f339dce8d3440e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:22.757796 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d1d5e-4d22-4a39-96e6-ffe0effdca36 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:22.761611 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:22.848733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172cf6d1-3be6-458e-9d96-5aef6fb0c130 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:22.885259 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e9c54-9f0c-4c89-a104-62f60f6c0624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:22.885965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e9c54-9f0c-4c89-a104-62f60f6c0624 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:22.886255 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e9c54-9f0c-4c89-a104-62f60f6c0624 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:22.886535 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e9c54-9f0c-4c89-a104-62f60f6c0624 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:22.887242 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e9c54-9f0c-4c89-a104-62f60f6c0624 None admin] RBAC: Adding query filter params (type=network) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:22.887553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e9c54-9f0c-4c89-a104-62f60f6c0624 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:22.888964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e9c54-9f0c-4c89-a104-62f60f6c0624 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:22.896672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 418/826] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jul 5 12:42:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:22.899838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 408/826] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:42:22 2022] PUT /identity/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/ab47c91ba7854bc09f656607dbb41cfc/roles/fb140b8a852547a5b8f339dce8d3440e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:42:22.899951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e9c54-9f0c-4c89-a104-62f60f6c0624 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:22.903260 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d1d5e-4d22-4a39-96e6-ffe0effdca36 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:22.994281 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:23.018297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e9c54-9f0c-4c89-a104-62f60f6c0624 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:23.057936 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8928bb-7a73-4dd6-a80e-85a1be8a54d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:23.058770 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8928bb-7a73-4dd6-a80e-85a1be8a54d4 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:23.059058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8928bb-7a73-4dd6-a80e-85a1be8a54d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:23.059336 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8928bb-7a73-4dd6-a80e-85a1be8a54d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:23.072277 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8928bb-7a73-4dd6-a80e-85a1be8a54d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:23.073842 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8928bb-7a73-4dd6-a80e-85a1be8a54d4 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:23.094375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-dc8928bb-7a73-4dd6-a80e-85a1be8a54d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:23.094375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:23.094375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:23.094375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:23.094375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:23.094375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:23.094375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:23.094375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:23.094375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:23.094375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:23.094375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:23.094375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:23.094375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:23.094375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:23.094375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:23.095333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:23.095333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:23.095333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:23.095333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:23.095333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:23.095333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:23.095333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:23.095333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:23.095333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:23.095333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:23.095333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:23.095333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:23.095333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:23.095333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:23.095333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:23.095333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:23.095333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:23.096713 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:23.096713 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:23.096713 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:23.096713 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:23.096713 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 419/827] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:23.103183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8928bb-7a73-4dd6-a80e-85a1be8a54d4 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:23.214781 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8928bb-7a73-4dd6-a80e-85a1be8a54d4 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:23.217881 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d1d5e-4d22-4a39-96e6-ffe0effdca36 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:23.252105 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f763d42-ee14-49f7-acaf-4d57cf5aeb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:23.252810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f763d42-ee14-49f7-acaf-4d57cf5aeb82 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:23.253245 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f763d42-ee14-49f7-acaf-4d57cf5aeb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:23.253535 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f763d42-ee14-49f7-acaf-4d57cf5aeb82 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:23.254220 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a0faf-bdee-451e-b214-f03490fd1636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:23.254339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f763d42-ee14-49f7-acaf-4d57cf5aeb82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:23.254624 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f763d42-ee14-49f7-acaf-4d57cf5aeb82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:23.255376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a0faf-bdee-451e-b214-f03490fd1636 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:23.255851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a0faf-bdee-451e-b214-f03490fd1636 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:23.256035 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f763d42-ee14-49f7-acaf-4d57cf5aeb82 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:23.256486 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a0faf-bdee-451e-b214-f03490fd1636 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:23.257458 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a0faf-bdee-451e-b214-f03490fd1636 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:23.259004 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a0faf-bdee-451e-b214-f03490fd1636 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:23.270014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:23.276620 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 420/828] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:23.276620 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f763d42-ee14-49f7-acaf-4d57cf5aeb82 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:23.336266 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 409/829] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jul 5 12:42:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:42:23.387973 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f763d42-ee14-49f7-acaf-4d57cf5aeb82 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:23.432043 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf402508-112e-4e02-9fbc-e35dd614ad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:23.432878 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf402508-112e-4e02-9fbc-e35dd614ad83 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:23.433161 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf402508-112e-4e02-9fbc-e35dd614ad83 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:23.433438 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf402508-112e-4e02-9fbc-e35dd614ad83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:23.440889 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf402508-112e-4e02-9fbc-e35dd614ad83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:23.442400 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf402508-112e-4e02-9fbc-e35dd614ad83 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:23.457951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-bf402508-112e-4e02-9fbc-e35dd614ad83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:23.457951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:23.457951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:23.457951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:23.457951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:23.457951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:23.457951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:23.457951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:23.457951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:23.457951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:23.457951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:23.457951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:23.457951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:23.457951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:23.457951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:23.458892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:23.458892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:23.458892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:23.458892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:23.458892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:23.458892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:23.458892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:23.458892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:23.458892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:23.458892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:23.458892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:23.458892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:23.458892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:23.458892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:23.458892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:23.458892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:23.458892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:23.460282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:23.460282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:23.460282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:23.460282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:23.460282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:23.460282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:23.460282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:23.460282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:23.460282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 421/830] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:23.465447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a0faf-bdee-451e-b214-f03490fd1636 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:23.506941 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:23.589959 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a0faf-bdee-451e-b214-f03490fd1636 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:23.624686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadee251-8aca-470a-a04d-085d8882be3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:23.625351 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadee251-8aca-470a-a04d-085d8882be3a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:23.625636 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadee251-8aca-470a-a04d-085d8882be3a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:23.625971 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadee251-8aca-470a-a04d-085d8882be3a None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:23.626765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadee251-8aca-470a-a04d-085d8882be3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:23.627122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadee251-8aca-470a-a04d-085d8882be3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:23.629131 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadee251-8aca-470a-a04d-085d8882be3a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:23.642623 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 410/831] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:23.649067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf402508-112e-4e02-9fbc-e35dd614ad83 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:23.697745 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:23.752124 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf402508-112e-4e02-9fbc-e35dd614ad83 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:23.788048 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590a32a-618c-4857-8922-9d24342214be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:23.788974 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590a32a-618c-4857-8922-9d24342214be None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:23.789315 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590a32a-618c-4857-8922-9d24342214be None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:23.789596 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590a32a-618c-4857-8922-9d24342214be None admin] PATH_INFO: `/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/1fb7db02f8e945a7af39cb30c3d606f8/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:23.791619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590a32a-618c-4857-8922-9d24342214be None admin] RBAC: Authorizing `identity:create_grant(project_id=a4190347294b48c096d7aa9d3a479d12, user_id=1fb7db02f8e945a7af39cb30c3d606f8, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:23.793097 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590a32a-618c-4857-8922-9d24342214be None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:23.889010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 422/832] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:42:23 2022] PUT /identity/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/1fb7db02f8e945a7af39cb30c3d606f8/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:42:24.274879 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f419b-4392-4634-b90b-7dc6291d1cf1 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:24.275396 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f419b-4392-4634-b90b-7dc6291d1cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:24.275498 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f419b-4392-4634-b90b-7dc6291d1cf1 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:24.277091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 411/833] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:24.282257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e28e60-4617-4ea8-b3f3-a983abbe2ae5 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:24.282553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e28e60-4617-4ea8-b3f3-a983abbe2ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:24.282835 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e28e60-4617-4ea8-b3f3-a983abbe2ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:24.299595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-22e28e60-4617-4ea8-b3f3-a983abbe2ae5 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:24.300850 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-22e28e60-4617-4ea8-b3f3-a983abbe2ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:24.371161 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 423/834] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:42:24.394315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f419b-4392-4634-b90b-7dc6291d1cf1 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:24.495976 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:24.502548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f419b-4392-4634-b90b-7dc6291d1cf1 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:24.537743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f88de4-155f-41ff-9088-26d37bf7d3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:24.538561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f88de4-155f-41ff-9088-26d37bf7d3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:24.538840 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f88de4-155f-41ff-9088-26d37bf7d3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:24.539109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f88de4-155f-41ff-9088-26d37bf7d3f6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:24.539753 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f88de4-155f-41ff-9088-26d37bf7d3f6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:24.541141 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f88de4-155f-41ff-9088-26d37bf7d3f6 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:24.553557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-f4f88de4-155f-41ff-9088-26d37bf7d3f6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 12:42:24.553557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:24.553557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:24.553557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:24.553557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:24.553557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:24.553557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:24.553557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:24.553557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 12:42:24.553557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:24.553557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:24.553557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:24.553557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:24.553557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:24.553557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:24.553557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:24.554510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:24.554510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:24.554510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:24.554510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:24.554510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:24.554510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:24.554510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:24.554510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:24.554510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:24.554510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:24.554510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:24.554510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:24.554510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:24.554510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:24.554510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:24.554510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:24.555357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:24.555357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:24.555357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:24.555357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:24.555357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:24.555357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:24.555357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:24.555357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:24.555357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:24.555357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:24.555357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:24.555357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:24.555357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:24.555357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 12:42:24.555357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:24.555357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 412/835] 10.222.0.36 () {56 vars in 1132 bytes} [Tue Jul 5 12:42:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:24.562685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e28e60-4617-4ea8-b3f3-a983abbe2ae5 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:24.598863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:24.671244 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e28e60-4617-4ea8-b3f3-a983abbe2ae5 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:24.707995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7b781-fd26-44a0-af56-a528fbbe41df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:24.708700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7b781-fd26-44a0-af56-a528fbbe41df None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:24.708986 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7b781-fd26-44a0-af56-a528fbbe41df None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:24.709265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7b781-fd26-44a0-af56-a528fbbe41df None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:24.709976 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7b781-fd26-44a0-af56-a528fbbe41df None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:24.710282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7b781-fd26-44a0-af56-a528fbbe41df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:24.711661 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7b781-fd26-44a0-af56-a528fbbe41df None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:24.716672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 424/836] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jul 5 12:42:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:24.729983 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f88de4-155f-41ff-9088-26d37bf7d3f6 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:24.837659 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f88de4-155f-41ff-9088-26d37bf7d3f6 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:24.872411 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a8aa1-ed0f-4fa9-809c-6c680b7b387e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:24.873101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a8aa1-ed0f-4fa9-809c-6c680b7b387e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:24.873386 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a8aa1-ed0f-4fa9-809c-6c680b7b387e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:24.873662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a8aa1-ed0f-4fa9-809c-6c680b7b387e None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:24.874361 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a8aa1-ed0f-4fa9-809c-6c680b7b387e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:24.874666 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a8aa1-ed0f-4fa9-809c-6c680b7b387e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:24.876032 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a8aa1-ed0f-4fa9-809c-6c680b7b387e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:24.881509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 413/837] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jul 5 12:42:24 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:24.972544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8471170-4dbe-4e8b-b8b9-688426c1d170 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:24.973508 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8471170-4dbe-4e8b-b8b9-688426c1d170 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:24.973997 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8471170-4dbe-4e8b-b8b9-688426c1d170 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:24.976292 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 425/838] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:24.981769 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715de03-b885-4525-b788-0172aa748612 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:24.982048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715de03-b885-4525-b788-0172aa748612 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:24.982330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715de03-b885-4525-b788-0172aa748612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:25.000698 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-9715de03-b885-4525-b788-0172aa748612 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:25.001920 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9715de03-b885-4525-b788-0172aa748612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:25.022293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:25.083196 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 414/839] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:25.099969 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8471170-4dbe-4e8b-b8b9-688426c1d170 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:25.186254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ec9d8-3c3d-405a-8536-e4aa1054debb None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:25.186578 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ec9d8-3c3d-405a-8536-e4aa1054debb None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:25.186820 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ec9d8-3c3d-405a-8536-e4aa1054debb None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:25.188191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 415/840] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:42:25.196721 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfc47c-6920-4701-9d28-33dc5a4dde30 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:25.197259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfc47c-6920-4701-9d28-33dc5a4dde30 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:25.197732 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfc47c-6920-4701-9d28-33dc5a4dde30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:25.208069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:25.212947 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8471170-4dbe-4e8b-b8b9-688426c1d170 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:25.216240 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-6fdfc47c-6920-4701-9d28-33dc5a4dde30 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:25.217712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6fdfc47c-6920-4701-9d28-33dc5a4dde30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:25.256148 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8bb22-92eb-4a18-bd1a-9185d3196b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:25.257784 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8bb22-92eb-4a18-bd1a-9185d3196b4e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:25.258081 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8bb22-92eb-4a18-bd1a-9185d3196b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:25.258366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8bb22-92eb-4a18-bd1a-9185d3196b4e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:25.259031 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8bb22-92eb-4a18-bd1a-9185d3196b4e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:25.260426 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8bb22-92eb-4a18-bd1a-9185d3196b4e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:25.275894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-3ef8bb22-92eb-4a18-bd1a-9185d3196b4e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 12:42:25.275894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:25.275894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:25.275894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:25.275894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:25.275894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:25.275894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:25.275894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:25.275894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 12:42:25.275894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:25.275894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:25.275894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:25.275894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:25.275894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:25.275894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:25.275894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:25.275894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:25.276968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:25.276968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:25.276968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:25.276968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:25.276968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:25.276968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:25.276968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:25.276968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:25.276968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:25.276968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:25.276968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:25.276968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:25.276968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:25.276968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:25.276968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:25.276968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:25.282844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:25.282844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:25.282844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:25.282844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:25.282844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:25.282844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:25.282844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:25.282844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:25.282844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:25.282844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:25.282844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:25.282844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:25.282844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 12:42:25.282844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:25.282844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 426/841] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jul 5 12:42:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:25.285642 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8bb22-92eb-4a18-bd1a-9185d3196b4e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:25.298146 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 416/842] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:42:25.323572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfc47c-6920-4701-9d28-33dc5a4dde30 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:25.410287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8bb22-92eb-4a18-bd1a-9185d3196b4e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:25.433969 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:25.455228 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfc47c-6920-4701-9d28-33dc5a4dde30 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:25.458803 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a4062-a446-47d3-aa99-59f3645f56d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:25.459496 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a4062-a446-47d3-aa99-59f3645f56d7 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:25.459786 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a4062-a446-47d3-aa99-59f3645f56d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:25.460070 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a4062-a446-47d3-aa99-59f3645f56d7 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:25.460850 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a4062-a446-47d3-aa99-59f3645f56d7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:25.461165 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a4062-a446-47d3-aa99-59f3645f56d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:25.462607 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a4062-a446-47d3-aa99-59f3645f56d7 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:25.472960 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 427/843] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jul 5 12:42:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:25.474405 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a4062-a446-47d3-aa99-59f3645f56d7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:25.499465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef9353-84ff-43db-aabe-5fadcb8193b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:25.500337 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef9353-84ff-43db-aabe-5fadcb8193b2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:25.500620 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef9353-84ff-43db-aabe-5fadcb8193b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:25.500957 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef9353-84ff-43db-aabe-5fadcb8193b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:25.506922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:25.512125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef9353-84ff-43db-aabe-5fadcb8193b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:25.520223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-09ef9353-84ff-43db-aabe-5fadcb8193b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:25.520223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:25.520223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:25.520223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:25.520223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:25.520223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:25.520223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:25.520223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:25.520223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:25.520223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:25.520223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:25.520223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:25.520223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:25.520223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:25.520223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:25.520223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:25.523261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:25.523261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:25.523261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:25.523261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:25.523261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:25.523261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:25.523261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:25.523261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:25.523261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:25.523261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:25.523261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:25.523261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:25.523261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:25.523261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:25.523261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:25.523261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:25.524121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:25.524121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:25.524121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:25.524121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:25.524121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:25.524121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:25.524121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:25.524121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:25.524121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:25.524121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:25.524121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:42:25.524121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:25.526932 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 417/844] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:42:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:25.527983 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef9353-84ff-43db-aabe-5fadcb8193b2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:25.587951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a4062-a446-47d3-aa99-59f3645f56d7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:25.624192 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a446e-51c2-468f-902b-687a94bc581b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:25.625272 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a446e-51c2-468f-902b-687a94bc581b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:25.625753 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a446e-51c2-468f-902b-687a94bc581b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:25.626220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a446e-51c2-468f-902b-687a94bc581b None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:25.627120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a446e-51c2-468f-902b-687a94bc581b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:25.627620 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a446e-51c2-468f-902b-687a94bc581b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:25.629804 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a446e-51c2-468f-902b-687a94bc581b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:25.633948 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef9353-84ff-43db-aabe-5fadcb8193b2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:25.640732 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 428/845] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jul 5 12:42:25 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:25.673176 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639ac2f-84a3-4199-b873-b25efbb822f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:25.673870 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639ac2f-84a3-4199-b873-b25efbb822f9 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:25.674154 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639ac2f-84a3-4199-b873-b25efbb822f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:25.674433 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639ac2f-84a3-4199-b873-b25efbb822f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:25.675746 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639ac2f-84a3-4199-b873-b25efbb822f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:25.676058 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639ac2f-84a3-4199-b873-b25efbb822f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:25.677480 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639ac2f-84a3-4199-b873-b25efbb822f9 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:25.687494 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 418/846] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jul 5 12:42:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:25.693881 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a446e-51c2-468f-902b-687a94bc581b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:25.802792 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:25.811401 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a446e-51c2-468f-902b-687a94bc581b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:25.847869 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6e8be-210a-48eb-8a64-a424e189ee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:25.848720 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6e8be-210a-48eb-8a64-a424e189ee6f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:25.849011 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6e8be-210a-48eb-8a64-a424e189ee6f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:25.849290 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6e8be-210a-48eb-8a64-a424e189ee6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:25.860248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6e8be-210a-48eb-8a64-a424e189ee6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:25.861747 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6e8be-210a-48eb-8a64-a424e189ee6f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:25.880248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-b8e6e8be-210a-48eb-8a64-a424e189ee6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:25.880248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:25.880248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:25.880248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:25.880248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:25.880248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:25.880248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:25.880248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:25.880248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:25.880248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:25.880248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:25.880248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:25.880248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:25.880248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:25.880248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:25.881342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:25.881342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:25.881342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:25.881342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:25.881342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:25.881342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:25.881342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:25.881342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:25.881342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:25.881342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:25.881342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:25.881342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:25.881342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:25.881342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:25.881342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:25.881342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:25.881342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:25.882416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:25.882416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:25.882416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:25.882416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:25.882416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 429/847] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:25.887180 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639ac2f-84a3-4199-b873-b25efbb822f9 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:25.908950 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:25.999738 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639ac2f-84a3-4199-b873-b25efbb822f9 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:26.009496 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef87782-a5c4-4242-9013-77b8ce1d56f8 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:26.010011 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef87782-a5c4-4242-9013-77b8ce1d56f8 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:26.010092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef87782-a5c4-4242-9013-77b8ce1d56f8 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:26.011561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 430/848] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:42:26.016950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969bd59-5b91-4a28-a04e-d489bb865ff2 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:26.017476 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969bd59-5b91-4a28-a04e-d489bb865ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:26.017972 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969bd59-5b91-4a28-a04e-d489bb865ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:26.035802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-5969bd59-5b91-4a28-a04e-d489bb865ff2 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:26.036113 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cf87b-579e-4865-bca8-7f4d33320d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:26.036796 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cf87b-579e-4865-bca8-7f4d33320d22 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:26.037085 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cf87b-579e-4865-bca8-7f4d33320d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:26.037366 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cf87b-579e-4865-bca8-7f4d33320d22 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:26.038096 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cf87b-579e-4865-bca8-7f4d33320d22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:26.038407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cf87b-579e-4865-bca8-7f4d33320d22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:26.038660 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5969bd59-5b91-4a28-a04e-d489bb865ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:26.039782 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cf87b-579e-4865-bca8-7f4d33320d22 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:26.053496 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 419/849] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:26.059172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cf87b-579e-4865-bca8-7f4d33320d22 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:26.132788 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 431/850] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:26.137390 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:26.151951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969bd59-5b91-4a28-a04e-d489bb865ff2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:26.181802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cf87b-579e-4865-bca8-7f4d33320d22 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:26.228976 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45737df6-27df-4a22-a5ce-538ef4819e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:26.230564 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45737df6-27df-4a22-a5ce-538ef4819e91 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:26.230922 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45737df6-27df-4a22-a5ce-538ef4819e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:26.231297 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45737df6-27df-4a22-a5ce-538ef4819e91 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:26.248626 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:26.248800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45737df6-27df-4a22-a5ce-538ef4819e91 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:26.248800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45737df6-27df-4a22-a5ce-538ef4819e91 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:26.265372 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-45737df6-27df-4a22-a5ce-538ef4819e91 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:42:26.265372 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:26.265372 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:26.265372 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:26.265372 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:26.265372 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:26.265372 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:26.265372 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:26.265372 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:26.265372 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:26.265372 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:26.265372 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:26.265372 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:26.265372 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:26.265372 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:26.265372 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:26.266653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:26.266653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:26.266653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:26.266653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:26.266653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:26.266653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:26.266653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:26.266653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:26.266653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:26.266653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:26.266653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:26.266653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:26.266653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:26.266653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:26.266653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:26.266653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:26.266653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:26.266653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:26.267675 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:26.267675 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:26.267675 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:26.267675 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:26.267675 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:26.267675 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:26.267675 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:26.267675 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:26.267675 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:42:26.267675 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:26.271314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 420/851] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jul 5 12:42:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:26.272573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45737df6-27df-4a22-a5ce-538ef4819e91 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:26.284520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969bd59-5b91-4a28-a04e-d489bb865ff2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:26.320673 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e782c7d-036a-4c25-b960-1db052f8ad9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:26.321419 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e782c7d-036a-4c25-b960-1db052f8ad9f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:26.321787 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e782c7d-036a-4c25-b960-1db052f8ad9f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:26.322010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e782c7d-036a-4c25-b960-1db052f8ad9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:26.332722 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e782c7d-036a-4c25-b960-1db052f8ad9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:26.340521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-5e782c7d-036a-4c25-b960-1db052f8ad9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:42:26.340521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:26.340521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:26.340521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:26.340521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:26.340521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:26.340521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:26.340521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:26.340521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:26.340521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:26.340521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:26.340521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:26.340521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:26.340521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:26.340521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:26.340521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:26.341648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:26.341648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:26.341648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:26.341648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:26.341648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:26.341648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:26.341648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:26.341648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:26.341648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:26.341648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:26.341648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:26.341648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:26.341648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:26.341648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:26.341648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:26.341648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:26.342526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:26.342526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:26.342526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:26.342526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:26.342526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:26.342526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:26.342526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:26.342526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:26.342526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:26.342526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:26.342526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:42:26.342526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:26.342526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 432/852] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:42:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:26.347511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e782c7d-036a-4c25-b960-1db052f8ad9f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:26.397931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45737df6-27df-4a22-a5ce-538ef4819e91 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:26.424633 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:26.434164 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640453e7-f8de-4f59-8ece-ba8c08603140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:26.434908 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640453e7-f8de-4f59-8ece-ba8c08603140 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:26.435195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640453e7-f8de-4f59-8ece-ba8c08603140 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:26.435472 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640453e7-f8de-4f59-8ece-ba8c08603140 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:26.438196 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640453e7-f8de-4f59-8ece-ba8c08603140 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:26.438196 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640453e7-f8de-4f59-8ece-ba8c08603140 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:26.438196 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640453e7-f8de-4f59-8ece-ba8c08603140 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:26.462511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 421/853] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jul 5 12:42:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:26.464157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640453e7-f8de-4f59-8ece-ba8c08603140 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:26.485765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e782c7d-036a-4c25-b960-1db052f8ad9f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:26.520309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b6322-f7c9-4202-9ff0-bd301ff082cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:26.521037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b6322-f7c9-4202-9ff0-bd301ff082cb None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:26.521321 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b6322-f7c9-4202-9ff0-bd301ff082cb None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:26.521603 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b6322-f7c9-4202-9ff0-bd301ff082cb None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:26.522352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b6322-f7c9-4202-9ff0-bd301ff082cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:26.522660 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b6322-f7c9-4202-9ff0-bd301ff082cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:26.524038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b6322-f7c9-4202-9ff0-bd301ff082cb None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:26.525438 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:26.539034 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 433/854] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:42:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:26.539880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b6322-f7c9-4202-9ff0-bd301ff082cb None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:26.582784 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640453e7-f8de-4f59-8ece-ba8c08603140 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:26.621776 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b8adf-b9da-439d-a86c-adcf9f81de98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:26.622258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b8adf-b9da-439d-a86c-adcf9f81de98 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:26.622542 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b8adf-b9da-439d-a86c-adcf9f81de98 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:26.622817 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b8adf-b9da-439d-a86c-adcf9f81de98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:26.645747 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b6322-f7c9-4202-9ff0-bd301ff082cb None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:26.681894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:26.691692 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a239243-7599-4f73-a073-8e33df7cc115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:26.692809 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a239243-7599-4f73-a073-8e33df7cc115 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:26.693104 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a239243-7599-4f73-a073-8e33df7cc115 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:26.693381 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a239243-7599-4f73-a073-8e33df7cc115 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:26.700036 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b8adf-b9da-439d-a86c-adcf9f81de98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:26.702191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b8adf-b9da-439d-a86c-adcf9f81de98 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:26.705491 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a239243-7599-4f73-a073-8e33df7cc115 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:26.708364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a239243-7599-4f73-a073-8e33df7cc115 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:26.731291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-1a239243-7599-4f73-a073-8e33df7cc115 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:26.731291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:26.731291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:26.731291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:26.731291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:26.731291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:26.731291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:26.731291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:26.731291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:26.731291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:26.731291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:26.731291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:26.731291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:26.731291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:26.731291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:26.732439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:26.732439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:26.732439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:26.732439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:26.732439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:26.732439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:26.732439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:26.732439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:26.732439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:26.732439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:26.732439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:26.732439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:26.732439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:26.732439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:26.732439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:26.732439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:26.732439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:26.733366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:26.733366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:26.733366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:26.733366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:26.733366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 434/855] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:26.738058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a239243-7599-4f73-a073-8e33df7cc115 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:26.805281 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:26.824763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 422/856] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:42:26 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:42:26.826791 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b8adf-b9da-439d-a86c-adcf9f81de98 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:26.872538 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a239243-7599-4f73-a073-8e33df7cc115 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:26.909760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ffcfc-af76-4782-a498-06de00bcbdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:26.910386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ffcfc-af76-4782-a498-06de00bcbdba None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:26.910670 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ffcfc-af76-4782-a498-06de00bcbdba None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:26.910944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ffcfc-af76-4782-a498-06de00bcbdba None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:26.911666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ffcfc-af76-4782-a498-06de00bcbdba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:26.912367 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ffcfc-af76-4782-a498-06de00bcbdba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:26.913382 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ffcfc-af76-4782-a498-06de00bcbdba None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:26.930223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 435/857] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:26.931525 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ffcfc-af76-4782-a498-06de00bcbdba None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:26.932036 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:26.950355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b8adf-b9da-439d-a86c-adcf9f81de98 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:26.988061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9556347-c68c-4cd6-9f61-9e0bf177ac58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:26.989363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9556347-c68c-4cd6-9f61-9e0bf177ac58 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:26.989864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9556347-c68c-4cd6-9f61-9e0bf177ac58 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:26.990329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9556347-c68c-4cd6-9f61-9e0bf177ac58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:27.001374 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9556347-c68c-4cd6-9f61-9e0bf177ac58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:27.003169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9556347-c68c-4cd6-9f61-9e0bf177ac58 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:27.022264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-b9556347-c68c-4cd6-9f61-9e0bf177ac58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:27.022264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:27.022264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:27.022264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:27.022264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:27.022264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:27.022264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:27.022264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:27.022264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:27.022264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:27.022264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:27.022264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:27.022264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:27.022264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:27.022264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:27.023356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:27.023356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:27.023356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:27.023356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:27.023356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:27.023356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:27.023356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:27.023356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:27.023356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:27.023356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:27.023356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:27.023356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:27.023356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:27.023356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:27.023356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:27.023356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:27.023356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:27.024445 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:27.024445 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:27.024445 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:27.024445 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:27.025900 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 423/858] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:27.029065 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973af91a-fdc3-417a-92df-cb1c36b665fa None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:27.029580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973af91a-fdc3-417a-92df-cb1c36b665fa None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:27.030058 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973af91a-fdc3-417a-92df-cb1c36b665fa None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:27.031778 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 424/859] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:27.032708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973af91a-fdc3-417a-92df-cb1c36b665fa None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:27.044406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ffcfc-af76-4782-a498-06de00bcbdba None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:27.054337 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:27.083838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1879a-27ec-44aa-bc71-e1906bc2c2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:27.084670 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1879a-27ec-44aa-bc71-e1906bc2c2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:27.085482 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1879a-27ec-44aa-bc71-e1906bc2c2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:27.085771 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1879a-27ec-44aa-bc71-e1906bc2c2d4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:27.095273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1879a-27ec-44aa-bc71-e1906bc2c2d4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:27.096722 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1879a-27ec-44aa-bc71-e1906bc2c2d4 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:27.111332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-67c1879a-27ec-44aa-bc71-e1906bc2c2d4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:42:27.111332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:27.111332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:27.111332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:27.111332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:27.111332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:27.111332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:27.111332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:27.111332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:27.111332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:27.111332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:27.111332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:27.111332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:27.111332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:27.111332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:27.111332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:27.112817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:27.112817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:27.112817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:27.112817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:27.112817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:27.112817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:27.112817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:27.112817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:27.112817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:27.112817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:27.112817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:27.112817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:27.112817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:27.112817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:27.112817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:27.112817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:27.112817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:27.112817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:27.113775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:27.113775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:27.113775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:27.113775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:27.113775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:27.113775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:27.113775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:27.113775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:27.113775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 12:42:27.113775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:27.113775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 436/860] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:42:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:27.114980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d589c9e-12f5-4fa6-a907-d53469806867 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:27.114980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d589c9e-12f5-4fa6-a907-d53469806867 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:27.114980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d589c9e-12f5-4fa6-a907-d53469806867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:27.132326 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-2d589c9e-12f5-4fa6-a907-d53469806867 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:27.133504 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2d589c9e-12f5-4fa6-a907-d53469806867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:27.154387 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973af91a-fdc3-417a-92df-cb1c36b665fa None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:27.192030 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76adbda-02ce-4163-8b12-22b73f008f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:27.192722 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76adbda-02ce-4163-8b12-22b73f008f33 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:27.193016 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76adbda-02ce-4163-8b12-22b73f008f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:27.193316 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76adbda-02ce-4163-8b12-22b73f008f33 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:27.194016 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76adbda-02ce-4163-8b12-22b73f008f33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:27.194324 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76adbda-02ce-4163-8b12-22b73f008f33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:27.195693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76adbda-02ce-4163-8b12-22b73f008f33 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:27.198608 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:27.205311 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 437/861] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:27.205981 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d589c9e-12f5-4fa6-a907-d53469806867 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:27.211945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 425/862] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:27.213018 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76adbda-02ce-4163-8b12-22b73f008f33 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:27.317931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:27.321878 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76adbda-02ce-4163-8b12-22b73f008f33 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:27.322092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d589c9e-12f5-4fa6-a907-d53469806867 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:27.360115 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44292fa0-5735-4462-82d1-2a21291c0080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:27.360942 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44292fa0-5735-4462-82d1-2a21291c0080 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:27.361223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44292fa0-5735-4462-82d1-2a21291c0080 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:27.361493 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44292fa0-5735-4462-82d1-2a21291c0080 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:27.365376 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea960dd1-8e94-4290-bf03-f624a951ddbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:27.366155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea960dd1-8e94-4290-bf03-f624a951ddbd None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:27.366827 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea960dd1-8e94-4290-bf03-f624a951ddbd None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:27.367574 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea960dd1-8e94-4290-bf03-f624a951ddbd None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:27.368952 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea960dd1-8e94-4290-bf03-f624a951ddbd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:27.369060 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44292fa0-5735-4462-82d1-2a21291c0080 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:27.369269 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea960dd1-8e94-4290-bf03-f624a951ddbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:27.370393 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44292fa0-5735-4462-82d1-2a21291c0080 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:27.370766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea960dd1-8e94-4290-bf03-f624a951ddbd None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:27.384766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-44292fa0-5735-4462-82d1-2a21291c0080 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:27.384766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:27.384766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:27.384766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:27.384766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:27.384766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:27.384766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:27.384766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:27.384766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:27.384766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:27.384766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:27.384766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:27.384766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:27.384766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:27.384766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:27.385719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:27.385719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:27.385719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:27.385719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:27.385719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:27.385719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:27.385719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:27.385719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:27.385719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:27.385719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:27.385719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:27.385719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:27.385719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:27.385719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:27.385719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:27.385719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:27.385719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:27.386640 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:27.386640 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:27.386640 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:27.386640 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:27.386640 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:27.386640 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:27.386640 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:27.386640 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:27.386640 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 426/863] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:27.389263 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44292fa0-5735-4462-82d1-2a21291c0080 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:27.391687 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 438/864] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jul 5 12:42:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:27.392638 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea960dd1-8e94-4290-bf03-f624a951ddbd None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:27.451182 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:27.496371 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44292fa0-5735-4462-82d1-2a21291c0080 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:27.505769 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea960dd1-8e94-4290-bf03-f624a951ddbd None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:27.535621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655970c-95d6-4a92-b007-857cd499fff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:27.536533 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655970c-95d6-4a92-b007-857cd499fff9 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:27.536852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655970c-95d6-4a92-b007-857cd499fff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:27.537129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655970c-95d6-4a92-b007-857cd499fff9 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:27.537852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655970c-95d6-4a92-b007-857cd499fff9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:27.539211 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655970c-95d6-4a92-b007-857cd499fff9 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:27.546807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d3d78-8196-4bbe-aa8d-50a33b0f568b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:27.547480 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d3d78-8196-4bbe-aa8d-50a33b0f568b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:27.547764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d3d78-8196-4bbe-aa8d-50a33b0f568b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:27.548044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d3d78-8196-4bbe-aa8d-50a33b0f568b None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:27.548866 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d3d78-8196-4bbe-aa8d-50a33b0f568b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:27.549178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d3d78-8196-4bbe-aa8d-50a33b0f568b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:27.551206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d3d78-8196-4bbe-aa8d-50a33b0f568b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:27.563233 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 439/865] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:27.564075 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d3d78-8196-4bbe-aa8d-50a33b0f568b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:27.583867 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:27.630865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 427/866] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jul 5 12:42:27 2022] POST /identity/v3/services => generated 269 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:42:27.633326 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655970c-95d6-4a92-b007-857cd499fff9 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:27.682598 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d3d78-8196-4bbe-aa8d-50a33b0f568b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:27.739547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f6ab2-747e-4ba6-ba3c-4dade19a5314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:27.740360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f6ab2-747e-4ba6-ba3c-4dade19a5314 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:27.740786 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f6ab2-747e-4ba6-ba3c-4dade19a5314 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:27.741182 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f6ab2-747e-4ba6-ba3c-4dade19a5314 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:27.787632 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655970c-95d6-4a92-b007-857cd499fff9 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:27.810955 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:27.830811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f6ab2-747e-4ba6-ba3c-4dade19a5314 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:27.832520 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531df20-a1b9-4209-9f4f-5e9bef1ab29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:27.832885 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f6ab2-747e-4ba6-ba3c-4dade19a5314 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:27.832988 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531df20-a1b9-4209-9f4f-5e9bef1ab29c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:27.833174 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531df20-a1b9-4209-9f4f-5e9bef1ab29c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:27.833457 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531df20-a1b9-4209-9f4f-5e9bef1ab29c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:27.834290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531df20-a1b9-4209-9f4f-5e9bef1ab29c None admin] RBAC: Adding query filter params (role.id=fb140b8a852547a5b8f339dce8d3440e, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=ab47c91ba7854bc09f656607dbb41cfc) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:27.834603 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531df20-a1b9-4209-9f4f-5e9bef1ab29c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:27.837136 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531df20-a1b9-4209-9f4f-5e9bef1ab29c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:27.845379 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 428/867] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:42:27 2022] GET /identity/v3/role_assignments?user.id=ab47c91ba7854bc09f656607dbb41cfc&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=fb140b8a852547a5b8f339dce8d3440e => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:27.847740 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6264a7-a1c4-4839-ad42-790bc6a4b57b None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:27.848283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6264a7-a1c4-4839-ad42-790bc6a4b57b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:27.848799 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6264a7-a1c4-4839-ad42-790bc6a4b57b None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:27.851223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 429/868] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:27.853173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:27.856962 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85243108-568f-45a3-9cda-29bfd9ba3f4a None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:27.857567 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85243108-568f-45a3-9cda-29bfd9ba3f4a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:27.858074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85243108-568f-45a3-9cda-29bfd9ba3f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:27.876336 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-85243108-568f-45a3-9cda-29bfd9ba3f4a None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:27.878018 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-85243108-568f-45a3-9cda-29bfd9ba3f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:27.961470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 430/869] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:27 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:27.964644 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 440/870] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:42:27 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:42:27.972626 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85243108-568f-45a3-9cda-29bfd9ba3f4a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:27.986411 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f6ab2-747e-4ba6-ba3c-4dade19a5314 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:28.090498 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85243108-568f-45a3-9cda-29bfd9ba3f4a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:28.103215 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:28.120204 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f6ab2-747e-4ba6-ba3c-4dade19a5314 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:28.132650 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad7dea-543a-4acc-b91b-6b75403aa228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:28.134014 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad7dea-543a-4acc-b91b-6b75403aa228 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:28.134489 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad7dea-543a-4acc-b91b-6b75403aa228 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:28.135115 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad7dea-543a-4acc-b91b-6b75403aa228 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:28.135795 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:28.148166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad7dea-543a-4acc-b91b-6b75403aa228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:28.149679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad7dea-543a-4acc-b91b-6b75403aa228 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:28.162288 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd47b4-e34a-41e8-ac48-18ff488ef173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:28.162967 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd47b4-e34a-41e8-ac48-18ff488ef173 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:28.163246 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd47b4-e34a-41e8-ac48-18ff488ef173 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:28.163517 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd47b4-e34a-41e8-ac48-18ff488ef173 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:28.164238 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd47b4-e34a-41e8-ac48-18ff488ef173 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:28.166235 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd47b4-e34a-41e8-ac48-18ff488ef173 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:28.169350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-0fad7dea-543a-4acc-b91b-6b75403aa228 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:28.169350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:28.169350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:28.169350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:28.169350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:28.169350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:28.169350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:28.169350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:28.169350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:28.169350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:28.169350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:28.169350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:28.169350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:28.169350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:28.169350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:28.170247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:28.170247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:28.170247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:28.170247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:28.170247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:28.170247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:28.170247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:28.170247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:28.170247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:28.170247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:28.170247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:28.170247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:28.170247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:28.170247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:28.170247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:28.170247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:28.170247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:28.171160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:28.171160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:28.171160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:28.171160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:28.172689 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 431/871] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:28.176447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad7dea-543a-4acc-b91b-6b75403aa228 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:28.279665 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad7dea-543a-4acc-b91b-6b75403aa228 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:28.301972 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 441/872] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jul 5 12:42:27 2022] POST /identity/v3/services => generated 251 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:42:28.336662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1141e-a301-4ac9-a19a-514ce92acfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:28.337355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1141e-a301-4ac9-a19a-514ce92acfbf None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:28.337719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1141e-a301-4ac9-a19a-514ce92acfbf None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:28.338000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1141e-a301-4ac9-a19a-514ce92acfbf None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:28.338749 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1141e-a301-4ac9-a19a-514ce92acfbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:28.339056 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1141e-a301-4ac9-a19a-514ce92acfbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:28.340552 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1141e-a301-4ac9-a19a-514ce92acfbf None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:28.354553 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 432/873] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:28.360248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd47b4-e34a-41e8-ac48-18ff488ef173 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:28.478698 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd47b4-e34a-41e8-ac48-18ff488ef173 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:28.514448 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b026c3-c4fe-46a2-864f-113aec3cefe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:28.515251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b026c3-c4fe-46a2-864f-113aec3cefe6 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:28.515534 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b026c3-c4fe-46a2-864f-113aec3cefe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:28.515812 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b026c3-c4fe-46a2-864f-113aec3cefe6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:28.523123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b026c3-c4fe-46a2-864f-113aec3cefe6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:28.524612 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b026c3-c4fe-46a2-864f-113aec3cefe6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:28.539210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-59b026c3-c4fe-46a2-864f-113aec3cefe6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:28.539210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:28.539210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:28.539210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:28.539210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:28.539210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:28.539210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:28.539210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:28.539210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:28.539210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:28.539210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:28.539210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:28.539210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:28.539210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:28.539210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:28.540106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:28.540106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:28.540106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:28.540106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:28.540106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:28.540106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:28.540106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:28.540106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:28.540106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:28.540106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:28.540106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:28.540106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:28.540106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:28.540106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:28.540106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:28.540106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:28.540106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:28.541058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:28.541058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:28.541058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:28.541058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:28.541058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:28.541058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:28.541058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:28.541058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:28.543507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 442/874] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:28.546497 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1141e-a301-4ac9-a19a-514ce92acfbf None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:28.567345 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:28.657527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1141e-a301-4ac9-a19a-514ce92acfbf None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:28.694164 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cced28-c176-4180-83be-731ddc22a7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:28.695210 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cced28-c176-4180-83be-731ddc22a7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:28.695692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cced28-c176-4180-83be-731ddc22a7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:28.696181 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cced28-c176-4180-83be-731ddc22a7c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:28.697206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cced28-c176-4180-83be-731ddc22a7c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:28.697730 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cced28-c176-4180-83be-731ddc22a7c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:28.699347 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cced28-c176-4180-83be-731ddc22a7c0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:28.712635 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 433/875] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:28.718367 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b026c3-c4fe-46a2-864f-113aec3cefe6 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:28.761528 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:28.827270 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b026c3-c4fe-46a2-864f-113aec3cefe6 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:28.864872 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a5630-153c-4942-8e5c-b5c12c4ddbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:28.866138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a5630-153c-4942-8e5c-b5c12c4ddbfa None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:28.866426 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a5630-153c-4942-8e5c-b5c12c4ddbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:28.866707 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a5630-153c-4942-8e5c-b5c12c4ddbfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:28.867552 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a5630-153c-4942-8e5c-b5c12c4ddbfa None admin] RBAC: Adding query filter params (role.id=868c7a356c674ded875dd079f5a9f5e0, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=1fb7db02f8e945a7af39cb30c3d606f8) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:28.867871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a5630-153c-4942-8e5c-b5c12c4ddbfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:28.869347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a5630-153c-4942-8e5c-b5c12c4ddbfa None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:28.875812 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 443/876] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:42:28 2022] GET /identity/v3/role_assignments?user.id=1fb7db02f8e945a7af39cb30c3d606f8&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=868c7a356c674ded875dd079f5a9f5e0 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:29.797128 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e1f57-12ae-460c-838e-90d50aec55a2 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:29.797660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e1f57-12ae-460c-838e-90d50aec55a2 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:29.797660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e1f57-12ae-460c-838e-90d50aec55a2 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:29.799313 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 434/877] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:29.804426 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26491009-59ef-4f27-86c3-5aa105b9fae8 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:29.804839 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26491009-59ef-4f27-86c3-5aa105b9fae8 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:29.805035 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26491009-59ef-4f27-86c3-5aa105b9fae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:29.822535 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-26491009-59ef-4f27-86c3-5aa105b9fae8 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:29.823741 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-26491009-59ef-4f27-86c3-5aa105b9fae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:29.894408 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 444/878] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:29.916807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e1f57-12ae-460c-838e-90d50aec55a2 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:30.007073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:30.032183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e1f57-12ae-460c-838e-90d50aec55a2 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:30.069497 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca311ee-b7c8-42e2-a1bb-f41fb277733f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:30.070310 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca311ee-b7c8-42e2-a1bb-f41fb277733f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:30.070590 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca311ee-b7c8-42e2-a1bb-f41fb277733f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:30.070859 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca311ee-b7c8-42e2-a1bb-f41fb277733f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:30.071511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca311ee-b7c8-42e2-a1bb-f41fb277733f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:30.072902 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca311ee-b7c8-42e2-a1bb-f41fb277733f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:30.085279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-3ca311ee-b7c8-42e2-a1bb-f41fb277733f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 12:42:30.085279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:30.085279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:30.085279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:30.085279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:30.085279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:30.085279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:30.085279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:30.085279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 12:42:30.085279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:30.085279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:30.085279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:30.085279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:30.085279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:30.085279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:30.085279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:30.086255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:30.086255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:30.086255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:30.086255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:30.086255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:30.086255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:30.086255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:30.086255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:30.086255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:30.086255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:30.086255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:30.086255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:30.086255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:30.086255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:30.086255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:30.086255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:30.087102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:30.087102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:30.087102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:30.087102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:30.087102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:30.087102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:30.087102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:30.087102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:30.087102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:30.087102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:30.087102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:30.087102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:30.087102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:30.087102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 12:42:30.087102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:30.087102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 435/879] 10.222.0.36 () {56 vars in 1132 bytes} [Tue Jul 5 12:42:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:30.092877 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26491009-59ef-4f27-86c3-5aa105b9fae8 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:30.121015 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:30.128393 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873bbb1-0505-412f-b4ec-59b226afb4b1 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:30.128719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873bbb1-0505-412f-b4ec-59b226afb4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:30.128998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873bbb1-0505-412f-b4ec-59b226afb4b1 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:30.130608 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 436/880] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:30.135669 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c81569-e463-4d33-9005-b92ec98bb493 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:30.138359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c81569-e463-4d33-9005-b92ec98bb493 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:30.138359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c81569-e463-4d33-9005-b92ec98bb493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:30.153114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-21c81569-e463-4d33-9005-b92ec98bb493 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:30.154296 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-21c81569-e463-4d33-9005-b92ec98bb493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:30.196308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26491009-59ef-4f27-86c3-5aa105b9fae8 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:30.228681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 437/881] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:42:30.235076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c724d-d305-4c97-95d1-5071e2ce2b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:30.235806 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c724d-d305-4c97-95d1-5071e2ce2b4e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:30.236095 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c724d-d305-4c97-95d1-5071e2ce2b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:30.236430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c724d-d305-4c97-95d1-5071e2ce2b4e None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:30.237705 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c724d-d305-4c97-95d1-5071e2ce2b4e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:30.238020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c724d-d305-4c97-95d1-5071e2ce2b4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:30.239397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c724d-d305-4c97-95d1-5071e2ce2b4e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:30.244506 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 445/882] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jul 5 12:42:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:30.249795 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c81569-e463-4d33-9005-b92ec98bb493 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:30.249927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c724d-d305-4c97-95d1-5071e2ce2b4e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:30.325099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:30.355574 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c81569-e463-4d33-9005-b92ec98bb493 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:30.368939 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:30.375277 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c724d-d305-4c97-95d1-5071e2ce2b4e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:30.391743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91326b04-28e7-44c1-9475-82d2f21dc633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:30.392554 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91326b04-28e7-44c1-9475-82d2f21dc633 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:30.392880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91326b04-28e7-44c1-9475-82d2f21dc633 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:30.393156 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91326b04-28e7-44c1-9475-82d2f21dc633 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:30.405397 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91326b04-28e7-44c1-9475-82d2f21dc633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:30.412570 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c1706-5b45-4bc6-8815-73a7065969ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:30.413270 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c1706-5b45-4bc6-8815-73a7065969ed None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:30.413559 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c1706-5b45-4bc6-8815-73a7065969ed None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:30.413840 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c1706-5b45-4bc6-8815-73a7065969ed None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:30.414554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c1706-5b45-4bc6-8815-73a7065969ed None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:30.414863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-91326b04-28e7-44c1-9475-82d2f21dc633 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:42:30.414863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:30.414863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:30.414863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:30.414863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:30.414863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:30.414863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:30.414863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:30.414863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:30.414863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:30.414863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:30.414863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:30.414863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:30.414863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:30.414863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:30.414863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:30.415763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:30.415763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:30.415763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:30.415763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:30.415763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:30.415763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:30.415763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:30.415763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:30.415763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:30.415763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:30.415763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:30.415763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:30.415763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:30.415763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:30.415763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:30.415763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:30.416634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:30.416634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:30.416634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:30.416634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:30.416634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:30.416634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:30.416634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:30.416634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:30.416634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:30.416634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:30.416634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:42:30.416634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:30.417305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c1706-5b45-4bc6-8815-73a7065969ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:30.417305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c1706-5b45-4bc6-8815-73a7065969ed None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:30.421023 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 438/883] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jul 5 12:42:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:30.422026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91326b04-28e7-44c1-9475-82d2f21dc633 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:30.426961 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 446/884] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jul 5 12:42:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:30.428013 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c1706-5b45-4bc6-8815-73a7065969ed None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:30.529850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91326b04-28e7-44c1-9475-82d2f21dc633 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:30.537038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c1706-5b45-4bc6-8815-73a7065969ed None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:30.561780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:30.567029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896d9ba-4e50-4bad-a49b-81fa35de54a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:30.567798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896d9ba-4e50-4bad-a49b-81fa35de54a5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:30.568031 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896d9ba-4e50-4bad-a49b-81fa35de54a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:30.568312 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896d9ba-4e50-4bad-a49b-81fa35de54a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:30.569111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896d9ba-4e50-4bad-a49b-81fa35de54a5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:30.569546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896d9ba-4e50-4bad-a49b-81fa35de54a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:30.573085 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896d9ba-4e50-4bad-a49b-81fa35de54a5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:30.575056 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2070f63-94d3-4594-ac7a-7df923f4ab8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:30.575777 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2070f63-94d3-4594-ac7a-7df923f4ab8a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:30.576454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2070f63-94d3-4594-ac7a-7df923f4ab8a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:30.576771 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2070f63-94d3-4594-ac7a-7df923f4ab8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:30.577860 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2070f63-94d3-4594-ac7a-7df923f4ab8a None admin] RBAC: Adding query filter params (interface=public, service_id=a4e8ce90b677471491454ba9daca40b2, region_id=RegionOne) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:30.578180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2070f63-94d3-4594-ac7a-7df923f4ab8a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:30.584240 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 439/885] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jul 5 12:42:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:30.584379 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2070f63-94d3-4594-ac7a-7df923f4ab8a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:30.584478 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fbf65-db65-4117-937c-eeabf5c4bf94 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:30.584478 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fbf65-db65-4117-937c-eeabf5c4bf94 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:30.584478 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fbf65-db65-4117-937c-eeabf5c4bf94 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:30.584478 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 440/886] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:30.587204 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fbf65-db65-4117-937c-eeabf5c4bf94 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:30.592873 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 447/887] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jul 5 12:42:30 2022] GET /identity/v3/endpoints?service_id=a4e8ce90b677471491454ba9daca40b2&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:30.594037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a50ca5-a85c-4366-920c-1c8dfda19053 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:30.594324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a50ca5-a85c-4366-920c-1c8dfda19053 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:30.594601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a50ca5-a85c-4366-920c-1c8dfda19053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:30.616150 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-35a50ca5-a85c-4366-920c-1c8dfda19053 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:30.617800 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-35a50ca5-a85c-4366-920c-1c8dfda19053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:30.640873 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:30.704070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fbf65-db65-4117-937c-eeabf5c4bf94 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:30.706960 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 448/888] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:30.707870 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a50ca5-a85c-4366-920c-1c8dfda19053 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:30.756753 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf73b07-c4e4-45c9-b644-6a3054ae4d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:30.757646 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf73b07-c4e4-45c9-b644-6a3054ae4d80 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:30.757936 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf73b07-c4e4-45c9-b644-6a3054ae4d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:30.758217 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf73b07-c4e4-45c9-b644-6a3054ae4d80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:30.770546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf73b07-c4e4-45c9-b644-6a3054ae4d80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:30.772004 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf73b07-c4e4-45c9-b644-6a3054ae4d80 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:30.790565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-5bf73b07-c4e4-45c9-b644-6a3054ae4d80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:30.790565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:30.790565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:30.790565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:30.790565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:30.790565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:30.790565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:30.790565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:30.790565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:30.790565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:30.790565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:30.790565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:30.790565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:30.790565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:30.790565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:30.791470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:30.791470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:30.791470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:30.791470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:30.791470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:30.791470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:30.791470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:30.791470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:30.791470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:30.791470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:30.791470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:30.791470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:30.791470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:30.791470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:30.791470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:30.791470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:30.791470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:30.796895 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:30.796895 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:30.796895 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:30.796895 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:30.796895 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 441/889] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:30.796895 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf73b07-c4e4-45c9-b644-6a3054ae4d80 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:30.824189 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a50ca5-a85c-4366-920c-1c8dfda19053 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:30.844537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:30.861330 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d44c8c-7577-4598-aed4-144842e6c344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:30.862003 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d44c8c-7577-4598-aed4-144842e6c344 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:30.862316 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d44c8c-7577-4598-aed4-144842e6c344 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:30.862657 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d44c8c-7577-4598-aed4-144842e6c344 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:30.863354 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d44c8c-7577-4598-aed4-144842e6c344 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:30.864817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d44c8c-7577-4598-aed4-144842e6c344 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:30.870618 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 449/890] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jul 5 12:42:30 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:42:30.871420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d44c8c-7577-4598-aed4-144842e6c344 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:30.902717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf73b07-c4e4-45c9-b644-6a3054ae4d80 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:30.904305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:30.953525 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f59e1-25af-4eaf-bdf5-25984107d844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:30.954401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f59e1-25af-4eaf-bdf5-25984107d844 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:30.954766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f59e1-25af-4eaf-bdf5-25984107d844 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:30.955150 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f59e1-25af-4eaf-bdf5-25984107d844 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:30.956400 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f59e1-25af-4eaf-bdf5-25984107d844 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:30.958041 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f59e1-25af-4eaf-bdf5-25984107d844 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:30.971481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-f47f59e1-25af-4eaf-bdf5-25984107d844 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 12:42:30.971481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:30.971481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:30.971481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:30.971481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:30.971481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:30.971481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:30.971481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:30.971481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 12:42:30.971481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:30.971481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:30.971481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:30.971481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:30.971481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:30.971481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:30.971481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:30.971481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:30.973094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:30.973094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:30.973094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:30.973094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:30.973094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:30.973094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:30.973094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:30.973094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:30.973094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:30.973094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:30.973094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:30.973094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:30.973094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:30.973094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:30.973094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:30.973094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:30.975214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:30.975214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:30.975214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:30.975214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:30.975214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:30.975214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:30.975214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:30.975214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:30.975214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:30.975214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:30.975214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:30.975214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:30.975214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 12:42:30.975214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:30.975214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 442/891] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jul 5 12:42:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:30.976024 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46c59b-e61d-4af5-bea5-ca163c2eef53 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:30.976024 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46c59b-e61d-4af5-bea5-ca163c2eef53 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:30.976024 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46c59b-e61d-4af5-bea5-ca163c2eef53 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:30.977240 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 443/892] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:30.981973 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46c59b-e61d-4af5-bea5-ca163c2eef53 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:31.006405 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d44c8c-7577-4598-aed4-144842e6c344 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:31.046301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecad40-087e-45f9-b3fe-254fa8a1a159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:31.047095 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecad40-087e-45f9-b3fe-254fa8a1a159 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:31.047392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecad40-087e-45f9-b3fe-254fa8a1a159 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:31.047694 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecad40-087e-45f9-b3fe-254fa8a1a159 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:31.048404 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecad40-087e-45f9-b3fe-254fa8a1a159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:31.049129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecad40-087e-45f9-b3fe-254fa8a1a159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:31.050182 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecad40-087e-45f9-b3fe-254fa8a1a159 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:31.068674 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 450/893] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:31.069817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c50ded-cb32-47d9-9511-b6130b6fd908 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:31.070114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c50ded-cb32-47d9-9511-b6130b6fd908 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:31.070397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c50ded-cb32-47d9-9511-b6130b6fd908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:31.088383 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-61c50ded-cb32-47d9-9511-b6130b6fd908 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:31.090051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-61c50ded-cb32-47d9-9511-b6130b6fd908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:31.103728 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46c59b-e61d-4af5-bea5-ca163c2eef53 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:31.114209 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:31.139622 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a7438-5827-4cc8-b680-b73f78a98e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:31.140300 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a7438-5827-4cc8-b680-b73f78a98e18 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:31.140731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a7438-5827-4cc8-b680-b73f78a98e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:31.141037 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a7438-5827-4cc8-b680-b73f78a98e18 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:31.141852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a7438-5827-4cc8-b680-b73f78a98e18 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:31.142164 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a7438-5827-4cc8-b680-b73f78a98e18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:31.144104 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a7438-5827-4cc8-b680-b73f78a98e18 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:31.153957 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 444/894] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jul 5 12:42:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:31.155044 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a7438-5827-4cc8-b680-b73f78a98e18 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:31.161994 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 451/895] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:31.162753 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c50ded-cb32-47d9-9511-b6130b6fd908 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:31.179794 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:31.266870 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a7438-5827-4cc8-b680-b73f78a98e18 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:31.275572 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c50ded-cb32-47d9-9511-b6130b6fd908 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:31.302299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3d6a4-e526-40af-8701-063dff4c9747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:31.303111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3d6a4-e526-40af-8701-063dff4c9747 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:31.303393 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3d6a4-e526-40af-8701-063dff4c9747 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:31.303663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3d6a4-e526-40af-8701-063dff4c9747 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:31.312398 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3d6a4-e526-40af-8701-063dff4c9747 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:31.312525 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9b006-8506-4fd1-a33c-fb2d9ed7c047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:31.313103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9b006-8506-4fd1-a33c-fb2d9ed7c047 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:31.313386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9b006-8506-4fd1-a33c-fb2d9ed7c047 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:31.313664 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9b006-8506-4fd1-a33c-fb2d9ed7c047 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:31.313864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3d6a4-e526-40af-8701-063dff4c9747 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:31.314368 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9b006-8506-4fd1-a33c-fb2d9ed7c047 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:31.314676 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9b006-8506-4fd1-a33c-fb2d9ed7c047 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:31.316562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9b006-8506-4fd1-a33c-fb2d9ed7c047 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:31.326266 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 452/896] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jul 5 12:42:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:31.326266 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9b006-8506-4fd1-a33c-fb2d9ed7c047 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:31.329270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-58f3d6a4-e526-40af-8701-063dff4c9747 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:42:31.329270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:31.329270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:31.329270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:31.329270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:31.329270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:31.329270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:31.329270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:31.329270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:31.329270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:31.329270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:31.329270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:31.329270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:31.329270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:31.329270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:31.329270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:31.330201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:31.330201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:31.330201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:31.330201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:31.330201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:31.330201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:31.330201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:31.330201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:31.330201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:31.330201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:31.330201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:31.330201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:31.330201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:31.330201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:31.330201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:31.330201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:31.330201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:31.330201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:31.331734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:31.331734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:31.331734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:31.331734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:31.331734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:31.331734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:31.331734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:31.331734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:31.331734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:42:31.331734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:31.331734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 445/897] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jul 5 12:42:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:31.332328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3d6a4-e526-40af-8701-063dff4c9747 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:31.370575 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:31.409028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:31.442398 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3d6a4-e526-40af-8701-063dff4c9747 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:31.446942 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9b006-8506-4fd1-a33c-fb2d9ed7c047 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:31.479099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806b183-b842-45fb-a0df-5f98a169d254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:31.480184 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806b183-b842-45fb-a0df-5f98a169d254 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:31.480844 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806b183-b842-45fb-a0df-5f98a169d254 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:31.481330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806b183-b842-45fb-a0df-5f98a169d254 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:31.481731 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ceff6f-4170-408a-b9d1-bb3147437872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:31.482533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ceff6f-4170-408a-b9d1-bb3147437872 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:31.482779 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806b183-b842-45fb-a0df-5f98a169d254 None admin] RBAC: Adding query filter params (interface=public, service_id=06ff8a8accc84defa76d6c89a378250f, region_id=RegionOne) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:31.482881 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ceff6f-4170-408a-b9d1-bb3147437872 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:31.483075 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ceff6f-4170-408a-b9d1-bb3147437872 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:31.483552 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806b183-b842-45fb-a0df-5f98a169d254 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:31.483720 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ceff6f-4170-408a-b9d1-bb3147437872 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:31.485134 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ceff6f-4170-408a-b9d1-bb3147437872 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:31.485514 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806b183-b842-45fb-a0df-5f98a169d254 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:31.492142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 446/898] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jul 5 12:42:31 2022] GET /identity/v3/endpoints?service_id=06ff8a8accc84defa76d6c89a378250f&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:31.493194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806b183-b842-45fb-a0df-5f98a169d254 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:31.498088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-54ceff6f-4170-408a-b9d1-bb3147437872 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:42:31.498088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:31.498088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:31.498088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:31.498088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:31.498088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:31.498088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:31.498088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:31.498088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:42:31.498088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:31.498088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:31.498088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:31.498088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:31.498088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:31.498088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:31.498088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:31.498088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:31.499353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:31.499353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:31.499353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:31.499353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:31.499353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:31.499353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:31.499353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:31.499353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:31.499353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:31.499353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:31.499353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:31.499353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:31.499353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:31.499353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:31.499353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:31.499353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:31.500410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:31.500410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:31.500410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:31.500410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:31.500410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:31.500410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:31.500410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:31.500410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:31.500410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:31.500410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:31.500410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:31.500410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:31.500410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:42:31.500410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:31.504533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 453/899] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jul 5 12:42:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:31.505426 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ceff6f-4170-408a-b9d1-bb3147437872 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:31.605367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:31.609384 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806b183-b842-45fb-a0df-5f98a169d254 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:31.614566 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ceff6f-4170-408a-b9d1-bb3147437872 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:31.644019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:31.646568 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6585067-f965-4ac3-9434-582632593ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:31.647234 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6585067-f965-4ac3-9434-582632593ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:31.647518 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6585067-f965-4ac3-9434-582632593ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:31.647794 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6585067-f965-4ac3-9434-582632593ab1 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:31.648646 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6585067-f965-4ac3-9434-582632593ab1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:31.648958 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6585067-f965-4ac3-9434-582632593ab1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:31.650033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134726a-b7e9-4f95-98ff-957ee1f27392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:31.650365 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6585067-f965-4ac3-9434-582632593ab1 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:31.650793 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134726a-b7e9-4f95-98ff-957ee1f27392 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:31.651085 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134726a-b7e9-4f95-98ff-957ee1f27392 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:31.651362 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134726a-b7e9-4f95-98ff-957ee1f27392 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:31.652050 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134726a-b7e9-4f95-98ff-957ee1f27392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:31.653462 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134726a-b7e9-4f95-98ff-957ee1f27392 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:31.659246 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 454/900] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jul 5 12:42:31 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:42:31.659968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134726a-b7e9-4f95-98ff-957ee1f27392 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:31.684952 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 447/901] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jul 5 12:42:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:31.686477 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6585067-f965-4ac3-9434-582632593ab1 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:31.807465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6585067-f965-4ac3-9434-582632593ab1 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:31.807715 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134726a-b7e9-4f95-98ff-957ee1f27392 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:31.851607 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242761d-3e9c-4de8-89bc-689bbccf14b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:31.852375 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242761d-3e9c-4de8-89bc-689bbccf14b3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:31.852760 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242761d-3e9c-4de8-89bc-689bbccf14b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:31.853104 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242761d-3e9c-4de8-89bc-689bbccf14b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:31.856271 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110b047-fc3c-4742-ad35-258805397a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:31.857845 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110b047-fc3c-4742-ad35-258805397a72 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:31.858132 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110b047-fc3c-4742-ad35-258805397a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:31.858406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110b047-fc3c-4742-ad35-258805397a72 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:31.859119 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110b047-fc3c-4742-ad35-258805397a72 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:31.859426 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110b047-fc3c-4742-ad35-258805397a72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:31.860821 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110b047-fc3c-4742-ad35-258805397a72 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:31.872686 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 455/902] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jul 5 12:42:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:31.873935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110b047-fc3c-4742-ad35-258805397a72 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:31.893978 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:31.945762 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:31.954725 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242761d-3e9c-4de8-89bc-689bbccf14b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:31.956313 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242761d-3e9c-4de8-89bc-689bbccf14b3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:32.006220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110b047-fc3c-4742-ad35-258805397a72 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:32.056675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e053aa-d5eb-46ef-a547-fcec2b65f21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:32.057357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e053aa-d5eb-46ef-a547-fcec2b65f21d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:32.057639 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e053aa-d5eb-46ef-a547-fcec2b65f21d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:32.057914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e053aa-d5eb-46ef-a547-fcec2b65f21d None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:32.058623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e053aa-d5eb-46ef-a547-fcec2b65f21d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:32.058929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e053aa-d5eb-46ef-a547-fcec2b65f21d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:32.060300 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e053aa-d5eb-46ef-a547-fcec2b65f21d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:32.071188 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 456/903] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jul 5 12:42:31 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:32.083358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 448/904] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:42:31 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:42:32.084832 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e053aa-d5eb-46ef-a547-fcec2b65f21d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:32.198435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e053aa-d5eb-46ef-a547-fcec2b65f21d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:32.223452 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:32.239058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296973b-0d9d-4898-b2d8-752abd472604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:32.240968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296973b-0d9d-4898-b2d8-752abd472604 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:32.240968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296973b-0d9d-4898-b2d8-752abd472604 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:32.240968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296973b-0d9d-4898-b2d8-752abd472604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:32.253770 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296973b-0d9d-4898-b2d8-752abd472604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:32.255234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296973b-0d9d-4898-b2d8-752abd472604 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:32.273295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-6296973b-0d9d-4898-b2d8-752abd472604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:32.273295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:32.273295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:32.273295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:32.273295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:32.273295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:32.273295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:32.273295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:32.273295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:32.273295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:32.273295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:32.273295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:32.273295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:32.273295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:32.273295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:32.274278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:32.274278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:32.274278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:32.274278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:32.274278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:32.274278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:32.274278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:32.274278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:32.274278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:32.274278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:32.274278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:32.274278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:32.274278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:32.274278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:32.274278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:32.274278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:32.274278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:32.275241 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:32.275241 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:32.275241 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:32.275241 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:32.275241 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 457/905] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:32.280336 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242761d-3e9c-4de8-89bc-689bbccf14b3 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:32.337257 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:32.381481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242761d-3e9c-4de8-89bc-689bbccf14b3 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:32.418687 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe469c6-3bf1-4a9a-8753-757a50ce04a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:32.419347 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe469c6-3bf1-4a9a-8753-757a50ce04a2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:32.419634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe469c6-3bf1-4a9a-8753-757a50ce04a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:32.419902 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe469c6-3bf1-4a9a-8753-757a50ce04a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:32.420718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe469c6-3bf1-4a9a-8753-757a50ce04a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:32.421024 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe469c6-3bf1-4a9a-8753-757a50ce04a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:32.422378 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe469c6-3bf1-4a9a-8753-757a50ce04a2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:32.434603 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 449/906] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:32.440149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296973b-0d9d-4898-b2d8-752abd472604 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:32.544339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296973b-0d9d-4898-b2d8-752abd472604 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:32.580535 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ca5ae-bef0-4761-900f-e4a5347cdb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:32.581930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ca5ae-bef0-4761-900f-e4a5347cdb7f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:32.582217 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ca5ae-bef0-4761-900f-e4a5347cdb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:32.582497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ca5ae-bef0-4761-900f-e4a5347cdb7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:32.589529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ca5ae-bef0-4761-900f-e4a5347cdb7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:32.591001 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ca5ae-bef0-4761-900f-e4a5347cdb7f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:32.606243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-545ca5ae-bef0-4761-900f-e4a5347cdb7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:32.606243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:32.606243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:32.606243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:32.606243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:32.606243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:32.606243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:32.606243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:32.606243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:32.606243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:32.606243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:32.606243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:32.606243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:32.606243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:32.606243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:32.607149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:32.607149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:32.607149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:32.607149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:32.607149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:32.607149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:32.607149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:32.607149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:32.607149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:32.607149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:32.607149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:32.607149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:32.607149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:32.607149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:32.607149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:32.607149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:32.607149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:32.608037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:32.608037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:32.608037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:32.608037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:32.608037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:32.608037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:32.608037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:32.608037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:32.608037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 458/907] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:32.615082 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe469c6-3bf1-4a9a-8753-757a50ce04a2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:32.718470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe469c6-3bf1-4a9a-8753-757a50ce04a2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:32.735412 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:32.754088 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d21ff0-55f9-43a4-b24a-ba5f2942a797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:32.754741 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d21ff0-55f9-43a4-b24a-ba5f2942a797 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:32.755021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d21ff0-55f9-43a4-b24a-ba5f2942a797 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:32.755292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d21ff0-55f9-43a4-b24a-ba5f2942a797 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:32.756083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d21ff0-55f9-43a4-b24a-ba5f2942a797 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:32.756387 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d21ff0-55f9-43a4-b24a-ba5f2942a797 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:32.757850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d21ff0-55f9-43a4-b24a-ba5f2942a797 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:32.770745 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 450/908] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:32.776636 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ca5ae-bef0-4761-900f-e4a5347cdb7f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:32.811734 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:32.882778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ca5ae-bef0-4761-900f-e4a5347cdb7f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:32.917964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edecb8-a36b-4d5f-9a28-dd476fab2616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:32.918640 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edecb8-a36b-4d5f-9a28-dd476fab2616 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:32.918923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edecb8-a36b-4d5f-9a28-dd476fab2616 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:32.919202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edecb8-a36b-4d5f-9a28-dd476fab2616 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:32.920036 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edecb8-a36b-4d5f-9a28-dd476fab2616 None admin] RBAC: Adding query filter params (role.id=0376afc6fefb4532b4c0510d40c6c290, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=ab47c91ba7854bc09f656607dbb41cfc) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:32.920347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edecb8-a36b-4d5f-9a28-dd476fab2616 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:32.921829 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edecb8-a36b-4d5f-9a28-dd476fab2616 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:32.928410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 459/909] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:42:32 2022] GET /identity/v3/role_assignments?user.id=ab47c91ba7854bc09f656607dbb41cfc&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=0376afc6fefb4532b4c0510d40c6c290 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:33.030525 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b570de6-44c0-4bc1-a6c3-3ba6db1d43ea None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:33.030525 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b570de6-44c0-4bc1-a6c3-3ba6db1d43ea None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:33.030525 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b570de6-44c0-4bc1-a6c3-3ba6db1d43ea None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:33.031603 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 451/910] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:33.037998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4592e2-0a56-4396-8fd7-189bfa89c1a5 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:33.038324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4592e2-0a56-4396-8fd7-189bfa89c1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:33.038571 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4592e2-0a56-4396-8fd7-189bfa89c1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:33.056213 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-6f4592e2-0a56-4396-8fd7-189bfa89c1a5 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:33.057585 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6f4592e2-0a56-4396-8fd7-189bfa89c1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:33.128558 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 460/911] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:33.151067 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b570de6-44c0-4bc1-a6c3-3ba6db1d43ea None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:33.263415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b570de6-44c0-4bc1-a6c3-3ba6db1d43ea None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:33.300639 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174f752-b47d-4cbf-91fd-7752b7090040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:33.300639 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174f752-b47d-4cbf-91fd-7752b7090040 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:33.300639 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174f752-b47d-4cbf-91fd-7752b7090040 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:33.300639 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174f752-b47d-4cbf-91fd-7752b7090040 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:33.301103 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174f752-b47d-4cbf-91fd-7752b7090040 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:33.301911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174f752-b47d-4cbf-91fd-7752b7090040 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:33.317515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-c174f752-b47d-4cbf-91fd-7752b7090040 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 12:42:33.317515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:33.317515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:33.317515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:33.317515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:33.317515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:33.317515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:33.317515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:33.317515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 12:42:33.317515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:33.317515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:33.317515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:33.317515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:33.317515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:33.317515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:33.317515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:33.318469 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:33.318469 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:33.318469 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:33.318469 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:33.318469 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:33.318469 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:33.318469 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:33.318469 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:33.318469 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:33.318469 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:33.318469 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:33.318469 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:33.318469 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:33.318469 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:33.318469 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:33.318469 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:33.319335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:33.319335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:33.319335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:33.319335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:33.319335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:33.319335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:33.319335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:33.319335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:33.319335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:33.319335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:33.319335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:33.319335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:33.319335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:33.319335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 12:42:33.319335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:33.319335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 452/912] 10.222.0.36 () {56 vars in 1132 bytes} [Tue Jul 5 12:42:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:33.325203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4592e2-0a56-4396-8fd7-189bfa89c1a5 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:33.417238 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:33.576350 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4592e2-0a56-4396-8fd7-189bfa89c1a5 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:33.643667 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9040a20-9890-4902-a907-8a44716f3df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:33.644338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9040a20-9890-4902-a907-8a44716f3df7 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:33.644653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9040a20-9890-4902-a907-8a44716f3df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:33.644938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9040a20-9890-4902-a907-8a44716f3df7 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:33.645656 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9040a20-9890-4902-a907-8a44716f3df7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:33.645963 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9040a20-9890-4902-a907-8a44716f3df7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:33.647352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9040a20-9890-4902-a907-8a44716f3df7 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:33.662302 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 461/913] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jul 5 12:42:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:33.678434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174f752-b47d-4cbf-91fd-7752b7090040 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:33.747194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:33.808548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174f752-b47d-4cbf-91fd-7752b7090040 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:33.843467 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61df467-1411-4b7e-a122-036db2959cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:33.844054 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61df467-1411-4b7e-a122-036db2959cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:33.844338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61df467-1411-4b7e-a122-036db2959cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:33.844639 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61df467-1411-4b7e-a122-036db2959cb2 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:33.845354 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61df467-1411-4b7e-a122-036db2959cb2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:33.845663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61df467-1411-4b7e-a122-036db2959cb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:33.847615 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61df467-1411-4b7e-a122-036db2959cb2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:33.857671 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 453/914] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jul 5 12:42:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:33.861659 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9040a20-9890-4902-a907-8a44716f3df7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:33.881926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef17522-1de9-40fd-8c0a-cf82b0351ff3 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:33.882214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef17522-1de9-40fd-8c0a-cf82b0351ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:33.882494 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef17522-1de9-40fd-8c0a-cf82b0351ff3 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:33.883842 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 454/915] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:42:33.888769 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed1bfa-654c-4f1d-95f4-f179d927f220 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:33.889056 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed1bfa-654c-4f1d-95f4-f179d927f220 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:33.889336 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed1bfa-654c-4f1d-95f4-f179d927f220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:33.906355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f6ed1bfa-654c-4f1d-95f4-f179d927f220 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:33.907548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f6ed1bfa-654c-4f1d-95f4-f179d927f220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:33.976651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:33.985134 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 455/916] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:42:33.998796 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9040a20-9890-4902-a907-8a44716f3df7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:34.011251 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed1bfa-654c-4f1d-95f4-f179d927f220 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:34.039030 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f68fe9-cc59-43ae-bef1-896984c5f0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:34.040088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f68fe9-cc59-43ae-bef1-896984c5f0cf None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:34.040579 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f68fe9-cc59-43ae-bef1-896984c5f0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:34.041146 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f68fe9-cc59-43ae-bef1-896984c5f0cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:34.042084 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f68fe9-cc59-43ae-bef1-896984c5f0cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:34.043669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f68fe9-cc59-43ae-bef1-896984c5f0cf None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:34.046787 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:34.115497 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed1bfa-654c-4f1d-95f4-f179d927f220 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:34.151704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d8813-0901-4264-8aa2-8e036a62835d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:34.152534 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d8813-0901-4264-8aa2-8e036a62835d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:34.152857 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d8813-0901-4264-8aa2-8e036a62835d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:34.153138 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d8813-0901-4264-8aa2-8e036a62835d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:34.153789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d8813-0901-4264-8aa2-8e036a62835d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:34.155183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d8813-0901-4264-8aa2-8e036a62835d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:34.171428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-9c9d8813-0901-4264-8aa2-8e036a62835d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 12:42:34.171428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:34.171428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:34.171428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:34.171428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:34.171428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:34.171428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:34.171428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:34.171428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 12:42:34.171428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:34.171428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:34.171428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:34.171428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:34.171428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:34.171428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:34.171428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:34.171428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:34.172511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:34.172511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:34.172511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:34.172511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:34.172511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:34.172511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:34.172511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:34.172511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:34.172511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:34.172511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:34.172511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:34.172511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:34.172511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:34.172511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:34.172511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:34.172511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:34.173389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:34.173389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:34.173389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:34.173389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:34.173389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:34.173389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:34.173389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:34.173389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:34.173389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:34.173389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:34.173389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:34.173389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:34.173389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 12:42:34.173389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:34.173389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 456/917] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jul 5 12:42:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:34.177610 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 462/918] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jul 5 12:42:33 2022] POST /identity/v3/endpoints => generated 347 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:42:34.179226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d8813-0901-4264-8aa2-8e036a62835d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:34.284504 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c746360-b7e3-41bf-be81-2c6190b654c5 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:34.286145 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c746360-b7e3-41bf-be81-2c6190b654c5 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:34.286145 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c746360-b7e3-41bf-be81-2c6190b654c5 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:34.287154 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 463/919] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:34.289929 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:34.293251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84c239-d8c8-4546-a83b-9c0ecbf1451f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:34.293251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84c239-d8c8-4546-a83b-9c0ecbf1451f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:34.293581 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84c239-d8c8-4546-a83b-9c0ecbf1451f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:34.295964 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d8813-0901-4264-8aa2-8e036a62835d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:34.311418 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-2f84c239-d8c8-4546-a83b-9c0ecbf1451f None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:34.312691 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2f84c239-d8c8-4546-a83b-9c0ecbf1451f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:34.345853 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a328f-6aad-4273-82ba-da7d81d3338a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:34.347586 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a328f-6aad-4273-82ba-da7d81d3338a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:34.348130 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a328f-6aad-4273-82ba-da7d81d3338a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:34.348637 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a328f-6aad-4273-82ba-da7d81d3338a None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:34.349867 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a328f-6aad-4273-82ba-da7d81d3338a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:34.350279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a328f-6aad-4273-82ba-da7d81d3338a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:34.351771 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a328f-6aad-4273-82ba-da7d81d3338a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:34.361805 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 457/920] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jul 5 12:42:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:34.363457 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a328f-6aad-4273-82ba-da7d81d3338a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:34.396684 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 464/921] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:42:34.416404 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84c239-d8c8-4546-a83b-9c0ecbf1451f None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:34.477747 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a328f-6aad-4273-82ba-da7d81d3338a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:34.512907 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f38f3-fb2c-4dc4-8360-759d7a79c827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:34.513574 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f38f3-fb2c-4dc4-8360-759d7a79c827 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:34.513860 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f38f3-fb2c-4dc4-8360-759d7a79c827 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:34.514139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f38f3-fb2c-4dc4-8360-759d7a79c827 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:34.514855 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f38f3-fb2c-4dc4-8360-759d7a79c827 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:34.515165 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f38f3-fb2c-4dc4-8360-759d7a79c827 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:34.516538 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f38f3-fb2c-4dc4-8360-759d7a79c827 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:34.522669 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 458/922] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jul 5 12:42:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:34.528434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f38f3-fb2c-4dc4-8360-759d7a79c827 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:34.532952 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:34.557843 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84c239-d8c8-4546-a83b-9c0ecbf1451f None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:34.562595 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:34.603605 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668ff56-66bf-4a5c-bef2-bb56f83e9306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:34.604442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668ff56-66bf-4a5c-bef2-bb56f83e9306 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:34.605066 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668ff56-66bf-4a5c-bef2-bb56f83e9306 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:34.605415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668ff56-66bf-4a5c-bef2-bb56f83e9306 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:34.606229 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668ff56-66bf-4a5c-bef2-bb56f83e9306 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:34.608507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668ff56-66bf-4a5c-bef2-bb56f83e9306 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:34.660340 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f38f3-fb2c-4dc4-8360-759d7a79c827 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:34.695301 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f58dd-45e4-4fdf-8b92-0bde9ef361bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:34.695968 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f58dd-45e4-4fdf-8b92-0bde9ef361bf None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:34.696253 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f58dd-45e4-4fdf-8b92-0bde9ef361bf None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:34.696533 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f58dd-45e4-4fdf-8b92-0bde9ef361bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:34.697303 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f58dd-45e4-4fdf-8b92-0bde9ef361bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:34.698673 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f58dd-45e4-4fdf-8b92-0bde9ef361bf None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:34.713316 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 465/923] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jul 5 12:42:34 2022] POST /identity/v3/services => generated 241 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:42:34.827453 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 459/924] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jul 5 12:42:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:42:35.058400 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7afcb0-6ac2-4f14-aca5-8aad058b49bf None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:35.058945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7afcb0-6ac2-4f14-aca5-8aad058b49bf None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:35.058945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7afcb0-6ac2-4f14-aca5-8aad058b49bf None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:35.063525 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 466/925] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:35.069536 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57547ce-5d59-4e6b-bd80-fef47e20f4e4 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:35.069977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57547ce-5d59-4e6b-bd80-fef47e20f4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:35.070175 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57547ce-5d59-4e6b-bd80-fef47e20f4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:35.092059 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-a57547ce-5d59-4e6b-bd80-fef47e20f4e4 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:35.093603 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a57547ce-5d59-4e6b-bd80-fef47e20f4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:35.172302 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 460/926] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:35.195234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7afcb0-6ac2-4f14-aca5-8aad058b49bf None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:35.303903 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7afcb0-6ac2-4f14-aca5-8aad058b49bf None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:35.339768 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cb17c-6a36-467d-8dca-6743e37b02c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:35.340558 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cb17c-6a36-467d-8dca-6743e37b02c0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:35.340875 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cb17c-6a36-467d-8dca-6743e37b02c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:35.341151 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cb17c-6a36-467d-8dca-6743e37b02c0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:35.352521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205cb17c-6a36-467d-8dca-6743e37b02c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:35.360115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:35.362533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-205cb17c-6a36-467d-8dca-6743e37b02c0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:42:35.362533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:35.362533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:35.362533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:35.362533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:35.362533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:35.362533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:35.362533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:35.362533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:35.362533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:35.362533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:35.362533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:35.362533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:35.362533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:35.362533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:35.362533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:35.363481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:35.363481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:35.363481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:35.363481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:35.363481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:35.363481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:35.363481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:35.363481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:35.363481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:35.363481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:35.363481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:35.363481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:35.363481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:35.363481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:35.363481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:35.363481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:35.364334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:35.364334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:35.364334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:35.364334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:35.364334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:35.364334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:35.364334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:35.364334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:35.364334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:35.364334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:35.364334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:42:35.364334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:35.364334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 467/927] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jul 5 12:42:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:35.371649 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57547ce-5d59-4e6b-bd80-fef47e20f4e4 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:35.375217 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:35.481254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57547ce-5d59-4e6b-bd80-fef47e20f4e4 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:35.516952 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be61f5-60e7-4753-80e5-0b58e6e4038c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:35.517937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be61f5-60e7-4753-80e5-0b58e6e4038c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:35.518930 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be61f5-60e7-4753-80e5-0b58e6e4038c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:35.519374 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be61f5-60e7-4753-80e5-0b58e6e4038c None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:35.520268 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be61f5-60e7-4753-80e5-0b58e6e4038c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:35.520771 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be61f5-60e7-4753-80e5-0b58e6e4038c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:35.522288 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be61f5-60e7-4753-80e5-0b58e6e4038c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:35.531143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 461/928] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jul 5 12:42:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:35.537096 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cb17c-6a36-467d-8dca-6743e37b02c0 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:35.639058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cb17c-6a36-467d-8dca-6743e37b02c0 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:35.672610 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14030b3b-a992-47d6-8743-ee5fd483df6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:35.673470 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14030b3b-a992-47d6-8743-ee5fd483df6a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:35.673751 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14030b3b-a992-47d6-8743-ee5fd483df6a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:35.674026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14030b3b-a992-47d6-8743-ee5fd483df6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:35.684961 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14030b3b-a992-47d6-8743-ee5fd483df6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:35.686412 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14030b3b-a992-47d6-8743-ee5fd483df6a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:35.702914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-14030b3b-a992-47d6-8743-ee5fd483df6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:35.702914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:35.702914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:35.702914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:35.702914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:35.702914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:35.702914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:35.702914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:35.702914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:35.702914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:35.702914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:35.702914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:35.702914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:35.702914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:35.702914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:35.703799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:35.703799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:35.703799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:35.703799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:35.703799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:35.703799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:35.703799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:35.703799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:35.703799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:35.703799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:35.703799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:35.703799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:35.703799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:35.703799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:35.703799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:35.703799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:35.703799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:35.704732 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:35.704732 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:35.704732 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:35.704732 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:35.704732 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 468/929] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:35.710025 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be61f5-60e7-4753-80e5-0b58e6e4038c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:35.777003 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:35.811424 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be61f5-60e7-4753-80e5-0b58e6e4038c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:35.844952 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844eabd-c817-4b46-92e4-ee02d609cd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:35.845615 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844eabd-c817-4b46-92e4-ee02d609cd0e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:35.845897 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844eabd-c817-4b46-92e4-ee02d609cd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:35.846720 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844eabd-c817-4b46-92e4-ee02d609cd0e None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:35.847500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844eabd-c817-4b46-92e4-ee02d609cd0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:35.848073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844eabd-c817-4b46-92e4-ee02d609cd0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:35.849525 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844eabd-c817-4b46-92e4-ee02d609cd0e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:35.863154 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 462/930] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:35.868734 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14030b3b-a992-47d6-8743-ee5fd483df6a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:35.925303 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:35.976233 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14030b3b-a992-47d6-8743-ee5fd483df6a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:36.011886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fb056-a278-4a63-8c43-3839b35b0608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:36.012773 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fb056-a278-4a63-8c43-3839b35b0608 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:36.013061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fb056-a278-4a63-8c43-3839b35b0608 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:36.013345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fb056-a278-4a63-8c43-3839b35b0608 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:36.021436 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fb056-a278-4a63-8c43-3839b35b0608 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:36.022896 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fb056-a278-4a63-8c43-3839b35b0608 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:36.038113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-dd2fb056-a278-4a63-8c43-3839b35b0608 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:42:36.038113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:36.038113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:36.038113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:36.038113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:36.038113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:36.038113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:36.038113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:36.038113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:36.038113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:36.038113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:36.038113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:36.038113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:36.038113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:36.038113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:36.038113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:36.039123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:36.039123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:36.039123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:36.039123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:36.039123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:36.039123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:36.039123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:36.039123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:36.039123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:36.039123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:36.039123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:36.039123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:36.039123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:36.039123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:36.039123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:36.039123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:36.039123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:36.039123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:36.040061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:36.040061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:36.040061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:36.040061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:36.040061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:36.040061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:36.040061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:36.040061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:36.040061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:42:36.040061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:36.040061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 469/931] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jul 5 12:42:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:36.045763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844eabd-c817-4b46-92e4-ee02d609cd0e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:36.151034 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844eabd-c817-4b46-92e4-ee02d609cd0e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:36.180972 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:36.185704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bded6c-abd7-4159-91c1-1480a0f0547b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:36.186373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bded6c-abd7-4159-91c1-1480a0f0547b None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:36.186714 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bded6c-abd7-4159-91c1-1480a0f0547b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:36.186993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bded6c-abd7-4159-91c1-1480a0f0547b None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:36.187883 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bded6c-abd7-4159-91c1-1480a0f0547b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:36.188194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bded6c-abd7-4159-91c1-1480a0f0547b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:36.189689 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bded6c-abd7-4159-91c1-1480a0f0547b None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:36.207902 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 463/932] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jul 5 12:42:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:36.213689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fb056-a278-4a63-8c43-3839b35b0608 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:36.314547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fb056-a278-4a63-8c43-3839b35b0608 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:36.328124 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:36.356370 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb6375-93b9-44d6-bf6f-73a7e588efce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:36.357305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb6375-93b9-44d6-bf6f-73a7e588efce None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:36.357592 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb6375-93b9-44d6-bf6f-73a7e588efce None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:36.357867 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb6375-93b9-44d6-bf6f-73a7e588efce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:36.358504 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bbcb5-d5ed-4426-bd9d-56143f724ddc None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:36.358795 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bbcb5-d5ed-4426-bd9d-56143f724ddc None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:36.359072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bbcb5-d5ed-4426-bd9d-56143f724ddc None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:36.364775 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 464/933] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:42:36.365933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46258029-b0c5-4d8c-b173-264899a5961c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:36.366468 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46258029-b0c5-4d8c-b173-264899a5961c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:36.366673 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46258029-b0c5-4d8c-b173-264899a5961c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:36.370187 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb6375-93b9-44d6-bf6f-73a7e588efce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:36.371782 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb6375-93b9-44d6-bf6f-73a7e588efce None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:36.384217 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-46258029-b0c5-4d8c-b173-264899a5961c None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:36.385516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-46258029-b0c5-4d8c-b173-264899a5961c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:36.392601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-0beb6375-93b9-44d6-bf6f-73a7e588efce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:36.392601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:36.392601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:36.392601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:36.392601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:36.392601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:36.392601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:36.392601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:36.392601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:36.392601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:36.392601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:36.392601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:36.392601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:36.392601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:36.392601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:36.394178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:36.394178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:36.394178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:36.394178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:36.394178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:36.394178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:36.394178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:36.394178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:36.394178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:36.394178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:36.394178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:36.394178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:36.394178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:36.394178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:36.394178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:36.394178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:36.394178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:36.395064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:36.395064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:36.395064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:36.395064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:36.395287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 470/934] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:36.400291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb6375-93b9-44d6-bf6f-73a7e588efce None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:36.464746 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 465/935] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:42:36.486386 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46258029-b0c5-4d8c-b173-264899a5961c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:36.523691 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb6375-93b9-44d6-bf6f-73a7e588efce None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:36.573343 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c7f34-7035-4b69-bfae-10855a6566e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:36.574319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c7f34-7035-4b69-bfae-10855a6566e1 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:36.574988 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c7f34-7035-4b69-bfae-10855a6566e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:36.575365 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c7f34-7035-4b69-bfae-10855a6566e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:36.576239 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c7f34-7035-4b69-bfae-10855a6566e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:36.576683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c7f34-7035-4b69-bfae-10855a6566e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:36.578870 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c7f34-7035-4b69-bfae-10855a6566e1 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:36.589492 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46258029-b0c5-4d8c-b173-264899a5961c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:36.596933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 471/936] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:36.598011 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c7f34-7035-4b69-bfae-10855a6566e1 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:36.607329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:36.624831 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:36.625790 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e1f79-caea-46f2-852e-3d8e10f2118e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:36.626588 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e1f79-caea-46f2-852e-3d8e10f2118e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:36.626869 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e1f79-caea-46f2-852e-3d8e10f2118e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:36.627141 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e1f79-caea-46f2-852e-3d8e10f2118e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:36.628364 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e1f79-caea-46f2-852e-3d8e10f2118e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:36.629870 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e1f79-caea-46f2-852e-3d8e10f2118e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:36.642147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-319e1f79-caea-46f2-852e-3d8e10f2118e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 12:42:36.642147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:36.642147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:36.642147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:36.642147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:36.642147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:36.642147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:36.642147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:36.642147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 12:42:36.642147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:36.642147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:36.642147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:36.642147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:36.642147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:36.642147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:36.642147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:36.642147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:36.643925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:36.643925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:36.643925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:36.643925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:36.643925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:36.643925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:36.643925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:36.643925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:36.643925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:36.643925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:36.643925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:36.643925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:36.643925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:36.643925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:36.643925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:36.643925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:36.645006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:36.645006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:36.645006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:36.645006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:36.645006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:36.645006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:36.645006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:36.645006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:36.645006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:36.645006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:36.645006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:36.645006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:36.645006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 12:42:36.645006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:36.649501 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 466/937] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:36.650654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e1f79-caea-46f2-852e-3d8e10f2118e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:36.709336 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c7f34-7035-4b69-bfae-10855a6566e1 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:36.746890 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eea16c-cdf0-420a-9168-6f83629e53d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:36.747855 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eea16c-cdf0-420a-9168-6f83629e53d0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:36.748207 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eea16c-cdf0-420a-9168-6f83629e53d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:36.748554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eea16c-cdf0-420a-9168-6f83629e53d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:36.757027 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eea16c-cdf0-420a-9168-6f83629e53d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:36.757384 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e1f79-caea-46f2-852e-3d8e10f2118e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:36.758625 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eea16c-cdf0-420a-9168-6f83629e53d0 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:36.773754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-e2eea16c-cdf0-420a-9168-6f83629e53d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:36.773754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:36.773754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:36.773754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:36.773754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:36.773754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:36.773754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:36.773754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:36.773754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:36.773754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:36.773754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:36.773754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:36.773754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:36.773754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:36.773754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:36.774653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:36.774653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:36.774653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:36.774653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:36.774653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:36.774653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:36.774653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:36.774653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:36.774653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:36.774653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:36.774653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:36.774653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:36.774653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:36.774653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:36.774653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:36.774653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:36.774653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:36.775546 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:36.775546 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:36.775546 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:36.775546 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:36.775546 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:36.775546 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:36.775546 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:36.775546 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:36.780081 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 472/938] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:36.781194 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eea16c-cdf0-420a-9168-6f83629e53d0 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:36.792407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c585c-e354-426d-b2d0-327c36be9727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:36.793103 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c585c-e354-426d-b2d0-327c36be9727 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:36.793384 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c585c-e354-426d-b2d0-327c36be9727 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:36.793659 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c585c-e354-426d-b2d0-327c36be9727 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:36.794366 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c585c-e354-426d-b2d0-327c36be9727 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:36.794672 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c585c-e354-426d-b2d0-327c36be9727 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:36.796043 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c585c-e354-426d-b2d0-327c36be9727 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:36.805979 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 467/939] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jul 5 12:42:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:36.807514 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c585c-e354-426d-b2d0-327c36be9727 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:36.853989 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:36.873702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:36.892535 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eea16c-cdf0-420a-9168-6f83629e53d0 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:36.912336 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c585c-e354-426d-b2d0-327c36be9727 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:36.930027 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc7629-5e58-4c2b-b3b9-651765269288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:36.931055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc7629-5e58-4c2b-b3b9-651765269288 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:36.931582 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc7629-5e58-4c2b-b3b9-651765269288 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:36.932010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc7629-5e58-4c2b-b3b9-651765269288 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:36.932979 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc7629-5e58-4c2b-b3b9-651765269288 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:36.933447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc7629-5e58-4c2b-b3b9-651765269288 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:36.935309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc7629-5e58-4c2b-b3b9-651765269288 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:36.947392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 473/940] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:36.949146 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa1a45-7ca0-41fb-8c2f-74d41b28b2a1 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:36.949359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38573b6-f4c9-4e8c-8696-6b9a67438196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:36.949746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa1a45-7ca0-41fb-8c2f-74d41b28b2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:36.950025 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38573b6-f4c9-4e8c-8696-6b9a67438196 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:36.950287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa1a45-7ca0-41fb-8c2f-74d41b28b2a1 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:36.950403 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38573b6-f4c9-4e8c-8696-6b9a67438196 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:36.950572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38573b6-f4c9-4e8c-8696-6b9a67438196 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:36.951279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38573b6-f4c9-4e8c-8696-6b9a67438196 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:36.951584 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38573b6-f4c9-4e8c-8696-6b9a67438196 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:36.952287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 474/941] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:36.952966 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38573b6-f4c9-4e8c-8696-6b9a67438196 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:36.958797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0142e-2b1d-4ad4-a167-79fe12dbc633 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:36.959085 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0142e-2b1d-4ad4-a167-79fe12dbc633 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:36.959366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0142e-2b1d-4ad4-a167-79fe12dbc633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:36.961573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 468/942] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jul 5 12:42:36 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:36.962618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38573b6-f4c9-4e8c-8696-6b9a67438196 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:36.985765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-abb0142e-2b1d-4ad4-a167-79fe12dbc633 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:36.988026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-abb0142e-2b1d-4ad4-a167-79fe12dbc633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:37.084143 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 475/943] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:37.085657 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab9697-6391-4ecd-a3e0-1e214bd74f04 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:37.086010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab9697-6391-4ecd-a3e0-1e214bd74f04 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:37.086293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab9697-6391-4ecd-a3e0-1e214bd74f04 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:37.091917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 476/944] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:37.093352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a591b5-dd9e-49d7-8a8e-39aa08de9477 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:37.093650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a591b5-dd9e-49d7-8a8e-39aa08de9477 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:37.093936 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a591b5-dd9e-49d7-8a8e-39aa08de9477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:37.110750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38573b6-f4c9-4e8c-8696-6b9a67438196 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:37.115133 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-70a591b5-dd9e-49d7-8a8e-39aa08de9477 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:37.116342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-70a591b5-dd9e-49d7-8a8e-39aa08de9477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:37.118677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:37.149722 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffa24b-7ffb-4a47-a3d9-a13629f5f732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:37.150919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffa24b-7ffb-4a47-a3d9-a13629f5f732 None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:37.151199 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffa24b-7ffb-4a47-a3d9-a13629f5f732 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:37.151773 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffa24b-7ffb-4a47-a3d9-a13629f5f732 None admin] PATH_INFO: `/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/ab47c91ba7854bc09f656607dbb41cfc/roles/0376afc6fefb4532b4c0510d40c6c290` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:37.154205 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffa24b-7ffb-4a47-a3d9-a13629f5f732 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4190347294b48c096d7aa9d3a479d12, user_id=ab47c91ba7854bc09f656607dbb41cfc, role_id=0376afc6fefb4532b4c0510d40c6c290)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:37.155631 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffa24b-7ffb-4a47-a3d9-a13629f5f732 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:37.186895 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 477/945] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:37.190509 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a591b5-dd9e-49d7-8a8e-39aa08de9477 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:37.190806 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:37.271480 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 469/946] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:42:36 2022] PUT /identity/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/ab47c91ba7854bc09f656607dbb41cfc/roles/0376afc6fefb4532b4c0510d40c6c290 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:42:37.272502 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffa24b-7ffb-4a47-a3d9-a13629f5f732 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:37.302465 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a591b5-dd9e-49d7-8a8e-39aa08de9477 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:37.353743 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817a0c8-b517-4c28-bca2-90e94cd4c03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:37.355259 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817a0c8-b517-4c28-bca2-90e94cd4c03d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:37.355988 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817a0c8-b517-4c28-bca2-90e94cd4c03d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:37.356542 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817a0c8-b517-4c28-bca2-90e94cd4c03d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:37.358307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817a0c8-b517-4c28-bca2-90e94cd4c03d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:37.360679 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817a0c8-b517-4c28-bca2-90e94cd4c03d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:37.378766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-b817a0c8-b517-4c28-bca2-90e94cd4c03d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:42:37.378766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:37.378766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:37.378766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:37.378766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:37.378766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:37.378766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:37.378766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:37.378766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:42:37.378766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:37.378766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:37.378766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:37.378766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:37.378766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:37.378766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:37.378766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:37.378766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:37.379865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:37.379865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:37.379865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:37.379865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:37.379865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:37.379865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:37.379865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:37.379865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:37.379865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:37.379865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:37.379865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:37.379865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:37.379865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:37.379865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:37.379865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:37.379865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:37.381251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:37.381251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:37.381251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:37.381251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:37.381251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:37.381251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:37.381251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:37.381251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:37.381251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:37.381251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:37.381251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:37.381251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:37.381251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:42:37.381251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:37.385292 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 478/947] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jul 5 12:42:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:37.386853 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817a0c8-b517-4c28-bca2-90e94cd4c03d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:37.416802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffa24b-7ffb-4a47-a3d9-a13629f5f732 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:37.460533 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64cf27-38b6-47fd-96b8-59deecf81664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:37.461201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64cf27-38b6-47fd-96b8-59deecf81664 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:37.461486 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64cf27-38b6-47fd-96b8-59deecf81664 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:37.461767 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64cf27-38b6-47fd-96b8-59deecf81664 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:37.462479 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64cf27-38b6-47fd-96b8-59deecf81664 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:37.464106 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64cf27-38b6-47fd-96b8-59deecf81664 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:37.465371 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: WARNING keystone.server.flask.common [None req-de64cf27-38b6-47fd-96b8-59deecf81664 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 05 12:42:37.468012 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:37.505741 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817a0c8-b517-4c28-bca2-90e94cd4c03d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:37.527231 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.sql.core [None req-de64cf27-38b6-47fd-96b8-59deecf81664 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 12:42:37.527231 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 05 12:42:37.527231 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [parameters: {'id': '672834436c3c4d6a93d88da449641b42', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 05 12:42:37.527231 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80374) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 12:42:37.543890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-de64cf27-38b6-47fd-96b8-59deecf81664 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 672834436c3c4d6a93d88da449641b42.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 672834436c3c4d6a93d88da449641b42. Jul 05 12:42:37.543890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:37.543890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 12:42:37.543890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 12:42:37.543890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 12:42:37.543890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 12:42:37.543890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 12:42:37.543890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 12:42:37.543890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 12:42:37.543890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application conn.query(q) Jul 05 12:42:37.543890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 12:42:37.543890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 12:42:37.543890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 12:42:37.544819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application result.read() Jul 05 12:42:37.544819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 12:42:37.544819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 12:42:37.544819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 12:42:37.544819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 12:42:37.544819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 12:42:37.544819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 12:42:37.544819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 12:42:37.544819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 12:42:37.544819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 12:42:37.544819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:37.544819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 12:42:37.544819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:37.544819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:37.544819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 12:42:37.544819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 12:42:37.544819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 05 12:42:37.544819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 05 12:42:37.545977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 12:42:37.545977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application next(self.gen) Jul 05 12:42:37.545977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 12:42:37.545977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application yield resource Jul 05 12:42:37.545977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 12:42:37.545977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application next(self.gen) Jul 05 12:42:37.545977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 12:42:37.545977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 12:42:37.545977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 12:42:37.545977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 12:42:37.545977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 12:42:37.545977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise self.value Jul 05 12:42:37.545977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 12:42:37.545977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 12:42:37.545977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 12:42:37.545977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application session.commit() Jul 05 12:42:37.545977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 12:42:37.547083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 12:42:37.547083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 12:42:37.547083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 12:42:37.547083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 12:42:37.547083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self.session.flush() Jul 05 12:42:37.547083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 12:42:37.547083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 12:42:37.547083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 12:42:37.547083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 12:42:37.547083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 12:42:37.547083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application compat.raise_( Jul 05 12:42:37.547083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 12:42:37.547083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception Jul 05 12:42:37.547083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 12:42:37.547083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 12:42:37.547083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 12:42:37.547083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 12:42:37.548330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 12:42:37.548330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 12:42:37.548330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 12:42:37.548330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 12:42:37.548330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 05 12:42:37.548330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 05 12:42:37.548330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 12:42:37.548330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 12:42:37.548330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 12:42:37.548330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 12:42:37.548330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 12:42:37.548330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 12:42:37.548330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 12:42:37.548330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 12:42:37.548330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 12:42:37.549865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 12:42:37.549865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 12:42:37.549865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception Jul 05 12:42:37.549865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 12:42:37.549865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 12:42:37.549865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 12:42:37.549865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 12:42:37.549865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 12:42:37.549865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 12:42:37.549865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 12:42:37.549865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application conn.query(q) Jul 05 12:42:37.549865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 12:42:37.549865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 12:42:37.549865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 12:42:37.549865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application result.read() Jul 05 12:42:37.549865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 12:42:37.549865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 12:42:37.550960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 12:42:37.550960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 12:42:37.550960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 12:42:37.550960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 12:42:37.550960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 12:42:37.550960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 12:42:37.550960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 12:42:37.550960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 05 12:42:37.550960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [parameters: {'id': '672834436c3c4d6a93d88da449641b42', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 05 12:42:37.550960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 12:42:37.550960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:37.550960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:37.550960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:37.550960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:37.550960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 05 12:42:37.551931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 05 12:42:37.551931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 12:42:37.551931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 12:42:37.551931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 05 12:42:37.551931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:37.551931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:37.551931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:37.551931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:37.551931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:37.551931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:37.551931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:37.551931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:37.551931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:37.551931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:37.551931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:37.551931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:37.551931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:37.558160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:37.558160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 05 12:42:37.558160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 05 12:42:37.558160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:37.558160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:37.558160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 05 12:42:37.558160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 05 12:42:37.558160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 672834436c3c4d6a93d88da449641b42. Jul 05 12:42:37.558160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:37.558160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 470/948] 10.222.0.36 () {60 vars in 1140 bytes} [Tue Jul 5 12:42:37 2022] POST /identity/v3/projects => generated 262 bytes in 273 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:37.559422 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cada1f2-aec5-4653-85a1-a24bd931e9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:37.559422 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cada1f2-aec5-4653-85a1-a24bd931e9ad None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:37.559422 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cada1f2-aec5-4653-85a1-a24bd931e9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:37.559422 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cada1f2-aec5-4653-85a1-a24bd931e9ad None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:37.559943 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cada1f2-aec5-4653-85a1-a24bd931e9ad None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:37.559943 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cada1f2-aec5-4653-85a1-a24bd931e9ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:37.559943 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cada1f2-aec5-4653-85a1-a24bd931e9ad None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:37.559943 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 479/949] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jul 5 12:42:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:37.560407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64cf27-38b6-47fd-96b8-59deecf81664 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:37.566776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cada1f2-aec5-4653-85a1-a24bd931e9ad None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:37.589808 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:37.671532 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64cf27-38b6-47fd-96b8-59deecf81664 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:37.684094 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cada1f2-aec5-4653-85a1-a24bd931e9ad None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:37.707157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0252e0-c12d-49fc-b480-85ecc4a9ce08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:37.707799 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0252e0-c12d-49fc-b480-85ecc4a9ce08 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:37.708085 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0252e0-c12d-49fc-b480-85ecc4a9ce08 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:37.708365 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0252e0-c12d-49fc-b480-85ecc4a9ce08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:37.715378 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0252e0-c12d-49fc-b480-85ecc4a9ce08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:37.717060 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0252e0-c12d-49fc-b480-85ecc4a9ce08 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:37.717837 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:37.725357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103c678-5e1d-40f9-90a8-1ffabf0a5e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:37.726288 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103c678-5e1d-40f9-90a8-1ffabf0a5e89 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:37.726730 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103c678-5e1d-40f9-90a8-1ffabf0a5e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:37.727167 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103c678-5e1d-40f9-90a8-1ffabf0a5e89 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:37.729475 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103c678-5e1d-40f9-90a8-1ffabf0a5e89 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:37.729475 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103c678-5e1d-40f9-90a8-1ffabf0a5e89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:37.730118 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103c678-5e1d-40f9-90a8-1ffabf0a5e89 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:37.732682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-fe0252e0-c12d-49fc-b480-85ecc4a9ce08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:37.732682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:37.732682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:37.732682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:37.732682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:37.732682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:37.732682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:37.732682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:37.732682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:37.732682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:37.732682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:37.732682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:37.732682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:37.732682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:37.732682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:37.733707 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:37.733707 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:37.733707 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:37.733707 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:37.733707 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:37.733707 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:37.733707 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:37.733707 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:37.733707 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:37.733707 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:37.733707 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:37.733707 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:37.733707 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:37.733707 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:37.733707 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:37.733707 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:37.733707 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:37.734663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:37.734663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:37.734663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:37.734663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:37.734663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:37.734663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:37.734663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:37.734663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:37.734663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 471/950] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:37.740846 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0252e0-c12d-49fc-b480-85ecc4a9ce08 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:37.743356 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 480/951] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jul 5 12:42:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:37.750176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103c678-5e1d-40f9-90a8-1ffabf0a5e89 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:37.830620 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:37.861072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0252e0-c12d-49fc-b480-85ecc4a9ce08 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:37.864768 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103c678-5e1d-40f9-90a8-1ffabf0a5e89 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:37.903169 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f848b97-20e7-417b-a4e9-e89482815b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:37.904264 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f848b97-20e7-417b-a4e9-e89482815b20 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:37.904731 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f848b97-20e7-417b-a4e9-e89482815b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:37.905165 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f848b97-20e7-417b-a4e9-e89482815b20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:37.906203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f848b97-20e7-417b-a4e9-e89482815b20 None admin] RBAC: Adding query filter params (interface=public, service_id=398117790cd04980acc7122b1c2cc744, region_id=RegionOne) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:37.906382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545b10e-40ba-46f1-80c5-78436854cea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:37.906829 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f848b97-20e7-417b-a4e9-e89482815b20 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:37.907225 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545b10e-40ba-46f1-80c5-78436854cea5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:37.907606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545b10e-40ba-46f1-80c5-78436854cea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:37.907981 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545b10e-40ba-46f1-80c5-78436854cea5 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:37.908870 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f848b97-20e7-417b-a4e9-e89482815b20 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:37.909000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545b10e-40ba-46f1-80c5-78436854cea5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:37.909410 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545b10e-40ba-46f1-80c5-78436854cea5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:37.911257 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545b10e-40ba-46f1-80c5-78436854cea5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:37.919644 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 481/952] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jul 5 12:42:37 2022] GET /identity/v3/endpoints?service_id=398117790cd04980acc7122b1c2cc744&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:37.920728 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f848b97-20e7-417b-a4e9-e89482815b20 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:37.936704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 472/953] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jul 5 12:42:37 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:37.997410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:38.046098 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f848b97-20e7-417b-a4e9-e89482815b20 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:38.087785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47e557-6238-4b12-8fda-13893076ef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:38.088890 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47e557-6238-4b12-8fda-13893076ef33 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:38.089499 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47e557-6238-4b12-8fda-13893076ef33 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:38.089993 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47e557-6238-4b12-8fda-13893076ef33 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:38.090990 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47e557-6238-4b12-8fda-13893076ef33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:38.092762 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47e557-6238-4b12-8fda-13893076ef33 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:38.100846 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 482/954] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jul 5 12:42:37 2022] GET /identity/v3/services => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:42:39.050769 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc387b3c-1acc-4f65-bbb4-6ace711b1170 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:39.051281 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc387b3c-1acc-4f65-bbb4-6ace711b1170 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:39.051390 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc387b3c-1acc-4f65-bbb4-6ace711b1170 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:39.052998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 473/955] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:39.058133 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fd8a1-193f-4aa3-af9a-0a4cde9b0e87 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:39.058584 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fd8a1-193f-4aa3-af9a-0a4cde9b0e87 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:39.058781 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fd8a1-193f-4aa3-af9a-0a4cde9b0e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:39.076273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-288fd8a1-193f-4aa3-af9a-0a4cde9b0e87 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:39.077502 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-288fd8a1-193f-4aa3-af9a-0a4cde9b0e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:39.147498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 483/956] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:39.170152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc387b3c-1acc-4f65-bbb4-6ace711b1170 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:39.277858 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc387b3c-1acc-4f65-bbb4-6ace711b1170 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:39.330099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3353cd0-586c-4df6-bbee-e9dd0ca55bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:39.330772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3353cd0-586c-4df6-bbee-e9dd0ca55bea None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:39.331056 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3353cd0-586c-4df6-bbee-e9dd0ca55bea None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:39.331336 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3353cd0-586c-4df6-bbee-e9dd0ca55bea None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:39.332126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3353cd0-586c-4df6-bbee-e9dd0ca55bea None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:39.333528 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3353cd0-586c-4df6-bbee-e9dd0ca55bea None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:39.437965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038f68c-6524-4e66-b845-04e8cc14eedb None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:39.438316 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038f68c-6524-4e66-b845-04e8cc14eedb None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:39.438542 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038f68c-6524-4e66-b845-04e8cc14eedb None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:39.440863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 484/957] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:39.444971 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 474/958] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jul 5 12:42:39 2022] POST /identity/v3/services => generated 242 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:42:39.447340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a46bb-0f39-41fe-8956-b1d5d92037a3 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:39.447715 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a46bb-0f39-41fe-8956-b1d5d92037a3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:39.448069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a46bb-0f39-41fe-8956-b1d5d92037a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:39.470008 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-736a46bb-0f39-41fe-8956-b1d5d92037a3 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:39.471551 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-736a46bb-0f39-41fe-8956-b1d5d92037a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:39.528178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:39.559823 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 485/959] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:39.585183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3353cd0-586c-4df6-bbee-e9dd0ca55bea None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:39.588378 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:39.696775 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3353cd0-586c-4df6-bbee-e9dd0ca55bea None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:39.732364 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ae78f-2f7f-427f-8e73-5397d8ee4c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:39.733269 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ae78f-2f7f-427f-8e73-5397d8ee4c73 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:39.733566 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ae78f-2f7f-427f-8e73-5397d8ee4c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:39.733839 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ae78f-2f7f-427f-8e73-5397d8ee4c73 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:39.745368 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ae78f-2f7f-427f-8e73-5397d8ee4c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:39.754629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-705ae78f-2f7f-427f-8e73-5397d8ee4c73 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:42:39.754629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:39.754629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:39.754629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:39.754629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:39.754629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:39.754629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:39.754629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:39.754629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:39.754629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:39.754629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:39.754629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:39.754629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:39.754629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:39.754629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:39.754629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:39.755645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:39.755645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:39.755645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:39.755645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:39.755645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:39.755645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:39.755645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:39.755645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:39.755645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:39.755645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:39.755645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:39.755645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:39.755645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:39.755645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:39.755645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:39.755645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:39.756495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:39.756495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:39.756495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:39.756495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:39.756495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:39.756495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:39.756495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:39.756495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:39.756495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:39.756495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:39.756495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:42:39.756495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:39.756495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 475/960] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jul 5 12:42:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:39.762493 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a46bb-0f39-41fe-8956-b1d5d92037a3 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:39.871835 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a46bb-0f39-41fe-8956-b1d5d92037a3 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:39.907624 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a764f07-134b-4c1a-990a-e62db5a8cbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:39.908311 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a764f07-134b-4c1a-990a-e62db5a8cbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:39.908677 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a764f07-134b-4c1a-990a-e62db5a8cbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:39.908921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a764f07-134b-4c1a-990a-e62db5a8cbe9 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:39.909682 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a764f07-134b-4c1a-990a-e62db5a8cbe9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:39.910036 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a764f07-134b-4c1a-990a-e62db5a8cbe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:39.911483 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a764f07-134b-4c1a-990a-e62db5a8cbe9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:39.920318 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 486/961] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jul 5 12:42:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:39.926554 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ae78f-2f7f-427f-8e73-5397d8ee4c73 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:39.992805 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:40.034376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ae78f-2f7f-427f-8e73-5397d8ee4c73 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:40.081201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d28335-c58f-4979-b1eb-92298833a5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:40.082005 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d28335-c58f-4979-b1eb-92298833a5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:40.082293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d28335-c58f-4979-b1eb-92298833a5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:40.082574 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d28335-c58f-4979-b1eb-92298833a5b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:40.093934 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d28335-c58f-4979-b1eb-92298833a5b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:40.095398 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d28335-c58f-4979-b1eb-92298833a5b8 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:40.114315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-24d28335-c58f-4979-b1eb-92298833a5b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:40.114315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:40.114315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:40.114315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:40.114315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:40.114315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:40.114315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:40.114315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:40.114315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:40.114315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:40.114315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:40.114315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:40.114315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:40.114315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:40.114315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:40.115254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:40.115254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:40.115254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:40.115254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:40.115254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:40.115254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:40.115254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:40.115254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:40.115254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:40.115254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:40.115254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:40.115254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:40.115254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:40.115254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:40.115254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:40.115254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:40.115254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:40.116163 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:40.116163 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:40.116163 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:40.116163 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:40.116163 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 476/962] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:40.122619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a764f07-134b-4c1a-990a-e62db5a8cbe9 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:40.166698 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:40.227232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a764f07-134b-4c1a-990a-e62db5a8cbe9 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:40.261734 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f200242-1899-42c3-b8fa-6cf7efc2efaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:40.262778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f200242-1899-42c3-b8fa-6cf7efc2efaf None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:40.263329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f200242-1899-42c3-b8fa-6cf7efc2efaf None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:40.263838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f200242-1899-42c3-b8fa-6cf7efc2efaf None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:40.264869 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f200242-1899-42c3-b8fa-6cf7efc2efaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:40.265436 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f200242-1899-42c3-b8fa-6cf7efc2efaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:40.267020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f200242-1899-42c3-b8fa-6cf7efc2efaf None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:40.284675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 487/963] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:40.290216 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d28335-c58f-4979-b1eb-92298833a5b8 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:40.354971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825342df-c350-462b-8abb-2219e5a6e51f None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:40.355308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825342df-c350-462b-8abb-2219e5a6e51f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:40.355539 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825342df-c350-462b-8abb-2219e5a6e51f None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:40.357223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 488/964] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:40.362959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2931db0-6048-4424-8420-1b33de5b6b18 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:40.363242 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2931db0-6048-4424-8420-1b33de5b6b18 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:40.363518 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2931db0-6048-4424-8420-1b33de5b6b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:40.380941 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-f2931db0-6048-4424-8420-1b33de5b6b18 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:40.382062 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f2931db0-6048-4424-8420-1b33de5b6b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:40.400012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d28335-c58f-4979-b1eb-92298833a5b8 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:40.415262 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:40.439834 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6cad2-1189-44bc-9367-f197c8f53a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:40.440849 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6cad2-1189-44bc-9367-f197c8f53a74 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:40.441235 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6cad2-1189-44bc-9367-f197c8f53a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:40.441616 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6cad2-1189-44bc-9367-f197c8f53a74 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:40.449845 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6cad2-1189-44bc-9367-f197c8f53a74 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:40.451917 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6cad2-1189-44bc-9367-f197c8f53a74 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:40.467142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-3bf6cad2-1189-44bc-9367-f197c8f53a74 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:42:40.467142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:40.467142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:40.467142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:40.467142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:40.467142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:40.467142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:40.467142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:40.467142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:40.467142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:40.467142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:40.467142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:40.467142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:40.467142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:40.467142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:40.467142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:40.468837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:40.468837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:40.468837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:40.468837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:40.468837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:40.468837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:40.468837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:40.468837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:40.468837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:40.468837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:40.468837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:40.468837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:40.468837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:40.468837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:40.468837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:40.468837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:40.468837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:40.468837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:40.470358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:40.470358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:40.470358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:40.470358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:40.470358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:40.470358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:40.470358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:40.470358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:40.470358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 12:42:40.470358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:40.472427 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 477/965] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jul 5 12:42:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:40.477971 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6cad2-1189-44bc-9367-f197c8f53a74 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:40.497765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 489/966] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:42:40.520889 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2931db0-6048-4424-8420-1b33de5b6b18 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:40.563518 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:40.593926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6cad2-1189-44bc-9367-f197c8f53a74 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:40.638904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdc2eb-d9fd-4388-9e01-f25429423a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:40.639654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdc2eb-d9fd-4388-9e01-f25429423a80 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:40.639945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdc2eb-d9fd-4388-9e01-f25429423a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:40.640229 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdc2eb-d9fd-4388-9e01-f25429423a80 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:40.641369 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cdc2eb-d9fd-4388-9e01-f25429423a80 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:40.642084 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cdc2eb-d9fd-4388-9e01-f25429423a80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:40.644376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cdc2eb-d9fd-4388-9e01-f25429423a80 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:40.653895 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2931db0-6048-4424-8420-1b33de5b6b18 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:40.668739 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 478/967] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jul 5 12:42:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:40.670490 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf06c12-22e3-47fb-aa00-b2c2ec0b5b0e None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:40.670847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf06c12-22e3-47fb-aa00-b2c2ec0b5b0e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:40.671504 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf06c12-22e3-47fb-aa00-b2c2ec0b5b0e None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:40.672982 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 479/968] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:40.673739 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf06c12-22e3-47fb-aa00-b2c2ec0b5b0e None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:40.703315 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4983e-ac2b-4118-8860-c9406f232dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:40.704162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4983e-ac2b-4118-8860-c9406f232dae None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:40.704449 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4983e-ac2b-4118-8860-c9406f232dae None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:40.704772 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4983e-ac2b-4118-8860-c9406f232dae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:40.705947 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4983e-ac2b-4118-8860-c9406f232dae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:40.707000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:40.707390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4983e-ac2b-4118-8860-c9406f232dae None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:40.720313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-4ea4983e-ac2b-4118-8860-c9406f232dae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:42:40.720313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:40.720313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:40.720313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:40.720313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:40.720313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:40.720313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:40.720313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:40.720313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:42:40.720313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:40.720313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:40.720313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:40.720313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:40.720313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:40.720313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:40.720313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:40.720313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:40.728492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:40.728492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:40.728492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:40.728492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:40.728492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:40.728492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:40.728492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:40.728492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:40.728492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:40.728492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:40.728492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:40.728492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:40.728492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:40.728492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:40.728492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:40.728492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:40.729423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:40.729423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:40.729423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:40.729423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:40.729423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:40.729423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:40.729423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:40.729423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:40.729423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:40.729423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:40.729423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:40.729423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:40.729423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:42:40.729423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:40.729423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 490/969] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jul 5 12:42:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:40.730393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103358a6-f6ab-46f8-ba4c-744d7fc69eac None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:40.730393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103358a6-f6ab-46f8-ba4c-744d7fc69eac None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:40.730393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103358a6-f6ab-46f8-ba4c-744d7fc69eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:40.743007 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-103358a6-f6ab-46f8-ba4c-744d7fc69eac None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:40.744292 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-103358a6-f6ab-46f8-ba4c-744d7fc69eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:40.798790 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf06c12-22e3-47fb-aa00-b2c2ec0b5b0e None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:40.832918 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 491/970] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:40.833686 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103358a6-f6ab-46f8-ba4c-744d7fc69eac None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:40.846681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a574d-986f-4648-af45-d9cf26265d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:40.847842 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a574d-986f-4648-af45-d9cf26265d2d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:40.848178 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a574d-986f-4648-af45-d9cf26265d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:40.848632 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a574d-986f-4648-af45-d9cf26265d2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:40.861194 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:40.933755 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a574d-986f-4648-af45-d9cf26265d2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:40.935111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a574d-986f-4648-af45-d9cf26265d2d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:40.938311 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103358a6-f6ab-46f8-ba4c-744d7fc69eac None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:40.969804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:40.973952 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc4029-4bce-48e7-99ce-ce124c82c790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:40.974897 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc4029-4bce-48e7-99ce-ce124c82c790 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:40.975181 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc4029-4bce-48e7-99ce-ce124c82c790 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:40.975458 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc4029-4bce-48e7-99ce-ce124c82c790 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:40.976162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc4029-4bce-48e7-99ce-ce124c82c790 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:40.976466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc4029-4bce-48e7-99ce-ce124c82c790 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:40.977873 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc4029-4bce-48e7-99ce-ce124c82c790 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:40.983613 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 492/971] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jul 5 12:42:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:40.985212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc4029-4bce-48e7-99ce-ce124c82c790 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:41.045638 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 480/972] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:42:40 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:42:41.046610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a574d-986f-4648-af45-d9cf26265d2d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:41.100988 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:41.113313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc4029-4bce-48e7-99ce-ce124c82c790 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:41.151659 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505641d-995d-48d9-8767-e45bbd4c199b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:41.152601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505641d-995d-48d9-8767-e45bbd4c199b None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:41.153019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505641d-995d-48d9-8767-e45bbd4c199b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:41.153411 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505641d-995d-48d9-8767-e45bbd4c199b None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:41.154427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505641d-995d-48d9-8767-e45bbd4c199b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:41.156505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505641d-995d-48d9-8767-e45bbd4c199b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:41.158391 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: WARNING keystone.server.flask.common [None req-0505641d-995d-48d9-8767-e45bbd4c199b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 05 12:42:41.171239 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a574d-986f-4648-af45-d9cf26265d2d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:41.202179 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:41.207091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9df0a3-1b65-4a34-aaab-654681e3b25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:41.207611 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.sql.core [None req-0505641d-995d-48d9-8767-e45bbd4c199b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 12:42:41.207611 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 05 12:42:41.207611 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [parameters: {'user_id': '0738e26c897e499594fa8696730d67d4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 05 12:42:41.207611 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80375) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 12:42:41.208055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9df0a3-1b65-4a34-aaab-654681e3b25c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:41.208055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9df0a3-1b65-4a34-aaab-654681e3b25c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:41.208358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9df0a3-1b65-4a34-aaab-654681e3b25c None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:41.209033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9df0a3-1b65-4a34-aaab-654681e3b25c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:41.209343 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9df0a3-1b65-4a34-aaab-654681e3b25c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:41.210714 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9df0a3-1b65-4a34-aaab-654681e3b25c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:41.215657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 481/973] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jul 5 12:42:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:41.216439 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9df0a3-1b65-4a34-aaab-654681e3b25c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:41.222175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-0505641d-995d-48d9-8767-e45bbd4c199b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 05 12:42:41.222175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:41.222175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 12:42:41.222175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 12:42:41.222175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 12:42:41.222175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 12:42:41.222175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 12:42:41.222175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 12:42:41.222175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 12:42:41.222175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application conn.query(q) Jul 05 12:42:41.222175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 12:42:41.222175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 12:42:41.222175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 12:42:41.222175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application result.read() Jul 05 12:42:41.222175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 12:42:41.223554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 12:42:41.223554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 12:42:41.223554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 12:42:41.223554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 12:42:41.223554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 12:42:41.223554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 12:42:41.223554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 12:42:41.223554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 12:42:41.223554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:41.223554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 12:42:41.223554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:41.223554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:41.223554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 12:42:41.223554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 12:42:41.223554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 05 12:42:41.223554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 05 12:42:41.223554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 12:42:41.223554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application next(self.gen) Jul 05 12:42:41.225352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 12:42:41.225352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application yield resource Jul 05 12:42:41.225352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 12:42:41.225352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application next(self.gen) Jul 05 12:42:41.225352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 12:42:41.225352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 12:42:41.225352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 12:42:41.225352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 12:42:41.225352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 12:42:41.225352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise self.value Jul 05 12:42:41.225352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 12:42:41.225352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 12:42:41.225352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 12:42:41.225352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application session.commit() Jul 05 12:42:41.225352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 12:42:41.225352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 12:42:41.225352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 12:42:41.226844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 12:42:41.226844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 12:42:41.226844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.session.flush() Jul 05 12:42:41.226844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 12:42:41.226844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 12:42:41.226844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 12:42:41.226844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 12:42:41.226844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 12:42:41.226844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application compat.raise_( Jul 05 12:42:41.226844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 12:42:41.226844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception Jul 05 12:42:41.226844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 12:42:41.226844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 12:42:41.226844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 12:42:41.226844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 12:42:41.226844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 12:42:41.226844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 12:42:41.228252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 12:42:41.228252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 12:42:41.228252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 05 12:42:41.228252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 05 12:42:41.228252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 12:42:41.228252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 12:42:41.228252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 12:42:41.228252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 12:42:41.228252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 12:42:41.228252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 12:42:41.228252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 12:42:41.228252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 12:42:41.228252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 12:42:41.228252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 12:42:41.228252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 12:42:41.228252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception Jul 05 12:42:41.232485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 12:42:41.232485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 12:42:41.232485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 12:42:41.232485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 12:42:41.232485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 12:42:41.232485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 12:42:41.232485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 12:42:41.232485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application conn.query(q) Jul 05 12:42:41.232485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 12:42:41.232485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 12:42:41.232485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 12:42:41.232485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application result.read() Jul 05 12:42:41.232485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 12:42:41.232485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 12:42:41.232485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 12:42:41.232485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 12:42:41.239054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 12:42:41.239054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 12:42:41.239054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 12:42:41.239054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 12:42:41.239054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 12:42:41.239054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 05 12:42:41.239054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [parameters: {'user_id': '0738e26c897e499594fa8696730d67d4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 05 12:42:41.239054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 12:42:41.239054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:41.239054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:41.239054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:41.239054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:41.239054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:41.239054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:41.239054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:41.241923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:41.241923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:41.241923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:41.241923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:41.241923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:41.241923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:41.241923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:41.241923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 05 12:42:41.241923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 05 12:42:41.241923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:41.241923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:41.241923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:41.241923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:41.241923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:41.241923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:41.241923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 05 12:42:41.241923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 05 12:42:41.244925 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 05 12:42:41.244925 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 05 12:42:41.244925 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 12:42:41.244925 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 12:42:41.244925 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 05 12:42:41.244925 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:41.244925 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 493/974] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Jul 5 12:42:40 2022] POST /identity/v3/users => generated 160 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:41.244925 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505641d-995d-48d9-8767-e45bbd4c199b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:41.338417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9df0a3-1b65-4a34-aaab-654681e3b25c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:41.357960 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505641d-995d-48d9-8767-e45bbd4c199b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:41.374907 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b3288-44b4-44ec-a054-870a9104010f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:41.375755 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b3288-44b4-44ec-a054-870a9104010f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:41.376045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b3288-44b4-44ec-a054-870a9104010f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:41.376321 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b3288-44b4-44ec-a054-870a9104010f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:41.388144 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b3288-44b4-44ec-a054-870a9104010f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:41.389957 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b3288-44b4-44ec-a054-870a9104010f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:41.403695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44267b4a-578b-4ca7-b91b-7fd3cc0b2633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:41.404639 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44267b4a-578b-4ca7-b91b-7fd3cc0b2633 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:41.405043 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44267b4a-578b-4ca7-b91b-7fd3cc0b2633 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:41.405436 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44267b4a-578b-4ca7-b91b-7fd3cc0b2633 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:41.406533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44267b4a-578b-4ca7-b91b-7fd3cc0b2633 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:41.408653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-d26b3288-44b4-44ec-a054-870a9104010f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:41.408653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:41.408653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:41.408653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:41.408653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:41.408653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:41.408653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:41.408653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:41.408653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:41.408653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:41.408653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:41.408653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:41.408653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:41.408653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:41.408653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:41.409511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:41.409511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:41.409511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:41.409511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:41.409511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:41.409511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:41.409511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:41.409511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:41.409511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:41.409511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:41.409511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:41.409511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:41.409511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:41.409511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:41.409511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:41.409511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:41.409511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:41.415233 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:41.415233 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:41.415233 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:41.415233 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:41.415457 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44267b4a-578b-4ca7-b91b-7fd3cc0b2633 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:41.415531 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 482/975] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:41.415531 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b3288-44b4-44ec-a054-870a9104010f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:41.468795 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:41.508632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 494/976] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jul 5 12:42:41 2022] POST /identity/v3/endpoints => generated 349 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:42:41.508632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44267b4a-578b-4ca7-b91b-7fd3cc0b2633 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:41.516894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:41.566598 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b3288-44b4-44ec-a054-870a9104010f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:41.644107 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a6fec-32ff-4321-9c30-414a2fcc5846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:41.644935 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a6fec-32ff-4321-9c30-414a2fcc5846 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:41.645223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a6fec-32ff-4321-9c30-414a2fcc5846 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:41.645502 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a6fec-32ff-4321-9c30-414a2fcc5846 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:41.648525 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44267b4a-578b-4ca7-b91b-7fd3cc0b2633 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:41.654123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a6fec-32ff-4321-9c30-414a2fcc5846 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:41.655600 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a6fec-32ff-4321-9c30-414a2fcc5846 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:41.672921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-0a0a6fec-32ff-4321-9c30-414a2fcc5846 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 12:42:41.672921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:41.672921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:41.672921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:41.672921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:41.672921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:41.672921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:41.672921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:41.672921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:41.672921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:41.672921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:41.672921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:41.672921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:41.672921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:41.672921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:41.672921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:41.674606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:41.674606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:41.674606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:41.674606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:41.674606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:41.674606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:41.674606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:41.674606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:41.674606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:41.674606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:41.674606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:41.674606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:41.674606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:41.674606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:41.674606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:41.674606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:41.674606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:41.674606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:41.675571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:41.675571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:41.675571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:41.675571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:41.675571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:41.675571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:41.675571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:41.675571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:41.675571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 12:42:41.675571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:41.675571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 483/977] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:42:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:41.676182 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f81fdb-d96f-4d5f-a9d8-72fd855861cc None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:41.676259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f81fdb-d96f-4d5f-a9d8-72fd855861cc None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:41.677637 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f81fdb-d96f-4d5f-a9d8-72fd855861cc None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:41.677836 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 484/978] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:41.682691 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f81fdb-d96f-4d5f-a9d8-72fd855861cc None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:41.688511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df882d7-7226-40e1-97d0-bdf117deba96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:41.689997 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df882d7-7226-40e1-97d0-bdf117deba96 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:41.690287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df882d7-7226-40e1-97d0-bdf117deba96 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:41.690566 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df882d7-7226-40e1-97d0-bdf117deba96 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:41.691306 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df882d7-7226-40e1-97d0-bdf117deba96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:41.691719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df882d7-7226-40e1-97d0-bdf117deba96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:41.693165 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df882d7-7226-40e1-97d0-bdf117deba96 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:41.707163 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 495/979] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:41.708821 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f93fc-f667-4dc3-88c0-9b78d80a6ce9 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:41.709277 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f93fc-f667-4dc3-88c0-9b78d80a6ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:41.709563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f93fc-f667-4dc3-88c0-9b78d80a6ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:41.727568 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-796f93fc-f667-4dc3-88c0-9b78d80a6ce9 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:41.729052 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-796f93fc-f667-4dc3-88c0-9b78d80a6ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:41.802890 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:41.815595 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f81fdb-d96f-4d5f-a9d8-72fd855861cc None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:41.820327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:41.825042 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 496/980] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:41 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:41.826217 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f93fc-f667-4dc3-88c0-9b78d80a6ce9 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:41.869072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05112e2-fd99-4a77-b411-60cf35d53d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:41.870443 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05112e2-fd99-4a77-b411-60cf35d53d57 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:41.872986 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05112e2-fd99-4a77-b411-60cf35d53d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:41.873275 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05112e2-fd99-4a77-b411-60cf35d53d57 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:41.874123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05112e2-fd99-4a77-b411-60cf35d53d57 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:41.874440 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05112e2-fd99-4a77-b411-60cf35d53d57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:41.876442 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05112e2-fd99-4a77-b411-60cf35d53d57 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:41.928209 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 485/981] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jul 5 12:42:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:41.929129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05112e2-fd99-4a77-b411-60cf35d53d57 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:41.960342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f93fc-f667-4dc3-88c0-9b78d80a6ce9 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:42.002476 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97aa4a-09f7-4033-9943-4910c198134a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:42.003286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97aa4a-09f7-4033-9943-4910c198134a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:42.003490 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97aa4a-09f7-4033-9943-4910c198134a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:42.003766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97aa4a-09f7-4033-9943-4910c198134a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:42.011685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97aa4a-09f7-4033-9943-4910c198134a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:42.013283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97aa4a-09f7-4033-9943-4910c198134a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:42.029299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-2e97aa4a-09f7-4033-9943-4910c198134a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:42.029299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:42.029299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:42.029299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:42.029299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:42.029299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:42.029299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:42.029299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:42.029299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:42.029299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:42.029299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:42.029299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:42.029299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:42.029299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:42.029299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:42.030361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:42.030361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:42.030361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:42.030361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:42.030361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:42.030361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:42.030361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:42.030361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:42.030361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:42.030361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:42.030361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:42.030361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:42.030361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:42.030361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:42.030361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:42.030361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:42.030361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:42.031881 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:42.031881 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:42.031881 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:42.031881 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:42.031881 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:42.031881 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:42.031881 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:42.031881 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:42.031881 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 497/982] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:42.037725 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97aa4a-09f7-4033-9943-4910c198134a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:42.108854 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05112e2-fd99-4a77-b411-60cf35d53d57 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:42.138104 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:42.170030 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f66e09-4ade-4222-8cbf-0797c13ac85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:42.171462 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f66e09-4ade-4222-8cbf-0797c13ac85e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:42.171462 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f66e09-4ade-4222-8cbf-0797c13ac85e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:42.171462 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f66e09-4ade-4222-8cbf-0797c13ac85e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:42.172143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f66e09-4ade-4222-8cbf-0797c13ac85e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:42.173439 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f66e09-4ade-4222-8cbf-0797c13ac85e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:42.188223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-e5f66e09-4ade-4222-8cbf-0797c13ac85e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 12:42:42.188223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:42.188223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:42.188223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:42.188223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:42.188223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:42.188223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:42.188223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:42.188223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 12:42:42.188223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:42.188223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:42.188223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:42.188223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:42.188223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:42.188223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:42.188223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:42.188223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:42.189814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:42.189814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:42.189814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:42.189814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:42.189814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:42.189814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:42.189814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:42.189814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:42.189814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:42.189814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:42.189814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:42.189814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:42.189814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:42.189814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:42.189814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:42.189814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:42.191125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:42.191125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:42.191125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:42.191125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:42.191125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:42.191125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:42.191125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:42.191125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:42.191125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:42.191125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:42.191125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:42.191125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:42.191125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 12:42:42.191125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:42.193464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 486/983] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:42.199403 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f66e09-4ade-4222-8cbf-0797c13ac85e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:42.208037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97aa4a-09f7-4033-9943-4910c198134a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:42.231622 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:42.260844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a41b8b-76ca-4a19-99d6-f2fac9fad694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:42.261440 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a41b8b-76ca-4a19-99d6-f2fac9fad694 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:42.261729 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a41b8b-76ca-4a19-99d6-f2fac9fad694 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:42.262016 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a41b8b-76ca-4a19-99d6-f2fac9fad694 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:42.262811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a41b8b-76ca-4a19-99d6-f2fac9fad694 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:42.263123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a41b8b-76ca-4a19-99d6-f2fac9fad694 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:42.264570 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a41b8b-76ca-4a19-99d6-f2fac9fad694 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:42.278212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 498/984] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:42.283949 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a41b8b-76ca-4a19-99d6-f2fac9fad694 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:42.326484 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f66e09-4ade-4222-8cbf-0797c13ac85e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:42.364704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fa871-5293-4b7f-b440-9880f26abc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:42.365476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fa871-5293-4b7f-b440-9880f26abc2e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:42.365722 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fa871-5293-4b7f-b440-9880f26abc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:42.365930 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fa871-5293-4b7f-b440-9880f26abc2e None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:42.366642 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fa871-5293-4b7f-b440-9880f26abc2e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:42.367027 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fa871-5293-4b7f-b440-9880f26abc2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:42.368392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fa871-5293-4b7f-b440-9880f26abc2e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:42.373297 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 487/985] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jul 5 12:42:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:42.378793 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fa871-5293-4b7f-b440-9880f26abc2e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:42.399668 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a41b8b-76ca-4a19-99d6-f2fac9fad694 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:42.417720 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:42.438265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca222f-8579-432c-ba0d-d7ba536b7048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:42.439045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca222f-8579-432c-ba0d-d7ba536b7048 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:42.439331 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca222f-8579-432c-ba0d-d7ba536b7048 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:42.439826 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca222f-8579-432c-ba0d-d7ba536b7048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:42.440712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca222f-8579-432c-ba0d-d7ba536b7048 None admin] RBAC: Adding query filter params (role.id=0376afc6fefb4532b4c0510d40c6c290, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=ab47c91ba7854bc09f656607dbb41cfc) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:42.441029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca222f-8579-432c-ba0d-d7ba536b7048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:42.442683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca222f-8579-432c-ba0d-d7ba536b7048 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:42.460617 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 499/986] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:42:42 2022] GET /identity/v3/role_assignments?user.id=ab47c91ba7854bc09f656607dbb41cfc&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=0376afc6fefb4532b4c0510d40c6c290 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:42.486008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:42.496787 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fa871-5293-4b7f-b440-9880f26abc2e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:42.535414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b9a99-58fe-4270-b608-e040cd77fa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:42.536108 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b9a99-58fe-4270-b608-e040cd77fa0a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:42.536397 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b9a99-58fe-4270-b608-e040cd77fa0a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:42.536711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b9a99-58fe-4270-b608-e040cd77fa0a None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:42.537439 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b9a99-58fe-4270-b608-e040cd77fa0a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:42.537752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b9a99-58fe-4270-b608-e040cd77fa0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:42.539266 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b9a99-58fe-4270-b608-e040cd77fa0a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:42.551799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca222f-8579-432c-ba0d-d7ba536b7048 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:42.552256 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 488/987] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jul 5 12:42:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:42.660430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca222f-8579-432c-ba0d-d7ba536b7048 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:42.694819 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6a4cb-d755-4c25-8bec-1953ec54f2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:42.695541 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6a4cb-d755-4c25-8bec-1953ec54f2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:42.695826 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6a4cb-d755-4c25-8bec-1953ec54f2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:42.696102 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6a4cb-d755-4c25-8bec-1953ec54f2c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:42.696933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6a4cb-d755-4c25-8bec-1953ec54f2c5 None admin] RBAC: Adding query filter params (interface=public, service_id=31449159641d441f8bec82a9926ab560, region_id=RegionOne) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:42.697250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6a4cb-d755-4c25-8bec-1953ec54f2c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:42.698643 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6a4cb-d755-4c25-8bec-1953ec54f2c5 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:42.709193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 500/988] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jul 5 12:42:42 2022] GET /identity/v3/endpoints?service_id=31449159641d441f8bec82a9926ab560&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:42.710951 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b9a99-58fe-4270-b608-e040cd77fa0a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:42.820305 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b9a99-58fe-4270-b608-e040cd77fa0a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:42.862167 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e573d-00e7-4e94-8af6-579afbf8b6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:42.862831 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e573d-00e7-4e94-8af6-579afbf8b6fb None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:42.863116 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e573d-00e7-4e94-8af6-579afbf8b6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:42.863393 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e573d-00e7-4e94-8af6-579afbf8b6fb None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:42.864075 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e573d-00e7-4e94-8af6-579afbf8b6fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:42.865458 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e573d-00e7-4e94-8af6-579afbf8b6fb None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:42.880674 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 489/989] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jul 5 12:42:42 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:42:43.642742 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0979f-1571-45f8-9a41-2cdeb4b4c477 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:43.643281 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0979f-1571-45f8-9a41-2cdeb4b4c477 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:43.643383 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0979f-1571-45f8-9a41-2cdeb4b4c477 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:43.644843 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 501/990] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:43.649747 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e796c07-3b0a-4d16-a554-e5eaa89c0ef4 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:43.650127 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e796c07-3b0a-4d16-a554-e5eaa89c0ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:43.650307 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e796c07-3b0a-4d16-a554-e5eaa89c0ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:43.669298 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-3e796c07-3b0a-4d16-a554-e5eaa89c0ef4 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:43.670817 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3e796c07-3b0a-4d16-a554-e5eaa89c0ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:43.685148 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:43.739391 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 490/991] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:43.762839 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0979f-1571-45f8-9a41-2cdeb4b4c477 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:43.814895 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:43.876933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0979f-1571-45f8-9a41-2cdeb4b4c477 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:43.912041 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c78cbc-5183-4cae-8b56-d13d2bb1e5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:43.913080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c78cbc-5183-4cae-8b56-d13d2bb1e5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:43.913526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c78cbc-5183-4cae-8b56-d13d2bb1e5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:43.913942 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c78cbc-5183-4cae-8b56-d13d2bb1e5b0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:43.914757 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c78cbc-5183-4cae-8b56-d13d2bb1e5b0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:43.916320 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c78cbc-5183-4cae-8b56-d13d2bb1e5b0 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:43.928814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-d5c78cbc-5183-4cae-8b56-d13d2bb1e5b0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:42:43.928814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:43.928814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:43.928814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:43.928814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:43.928814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:43.928814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:43.928814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:43.928814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:42:43.928814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:43.928814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:43.928814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:43.928814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:43.928814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:43.928814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:43.928814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:43.928814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:43.930024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:43.930024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:43.930024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:43.930024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:43.930024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:43.930024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:43.930024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:43.930024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:43.930024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:43.930024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:43.930024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:43.930024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:43.930024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:43.930024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:43.930024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:43.930024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:43.931069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:43.931069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:43.931069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:43.931069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:43.931069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:43.931069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:43.931069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:43.931069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:43.931069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:43.931069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:43.931069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:43.931069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:43.931069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:42:43.931069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:43.933527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 502/992] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jul 5 12:42:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:43.939379 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e796c07-3b0a-4d16-a554-e5eaa89c0ef4 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:44.044075 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e796c07-3b0a-4d16-a554-e5eaa89c0ef4 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:44.084072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484ce15-4c1a-47d5-9c7b-c529e27227df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:44.084771 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484ce15-4c1a-47d5-9c7b-c529e27227df None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:44.085059 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484ce15-4c1a-47d5-9c7b-c529e27227df None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:44.085336 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484ce15-4c1a-47d5-9c7b-c529e27227df None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:44.086040 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484ce15-4c1a-47d5-9c7b-c529e27227df None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:44.086346 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484ce15-4c1a-47d5-9c7b-c529e27227df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:44.087704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484ce15-4c1a-47d5-9c7b-c529e27227df None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:44.096799 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 491/993] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jul 5 12:42:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:44.099056 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c78cbc-5183-4cae-8b56-d13d2bb1e5b0 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:44.208377 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c78cbc-5183-4cae-8b56-d13d2bb1e5b0 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:44.217226 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:44.242370 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeeba7b-2fb9-4963-a0a1-a5eb9bb72a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:44.243093 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeeba7b-2fb9-4963-a0a1-a5eb9bb72a94 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:44.243377 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeeba7b-2fb9-4963-a0a1-a5eb9bb72a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:44.243654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeeba7b-2fb9-4963-a0a1-a5eb9bb72a94 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:44.244363 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeeba7b-2fb9-4963-a0a1-a5eb9bb72a94 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:44.244773 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeeba7b-2fb9-4963-a0a1-a5eb9bb72a94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:44.246111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeeba7b-2fb9-4963-a0a1-a5eb9bb72a94 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:44.257221 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 503/994] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jul 5 12:42:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:44.257380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484ce15-4c1a-47d5-9c7b-c529e27227df None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:44.272375 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:44.356932 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484ce15-4c1a-47d5-9c7b-c529e27227df None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:44.390254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed806ab0-02e4-4eaa-a56b-ac2fa63e4f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:44.390913 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed806ab0-02e4-4eaa-a56b-ac2fa63e4f6a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:44.391197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed806ab0-02e4-4eaa-a56b-ac2fa63e4f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:44.391474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed806ab0-02e4-4eaa-a56b-ac2fa63e4f6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:44.392268 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed806ab0-02e4-4eaa-a56b-ac2fa63e4f6a None admin] RBAC: Adding query filter params (interface=admin, service_id=398117790cd04980acc7122b1c2cc744, region_id=RegionOne) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:44.393144 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed806ab0-02e4-4eaa-a56b-ac2fa63e4f6a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:44.394495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed806ab0-02e4-4eaa-a56b-ac2fa63e4f6a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:44.404239 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 492/995] 10.222.0.36 () {56 vars in 1249 bytes} [Tue Jul 5 12:42:44 2022] GET /identity/v3/endpoints?service_id=398117790cd04980acc7122b1c2cc744&interface=admin®ion_id=RegionOne => generated 193 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:44.405466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeeba7b-2fb9-4963-a0a1-a5eb9bb72a94 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:44.510755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeeba7b-2fb9-4963-a0a1-a5eb9bb72a94 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:44.544409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1033536-7ae2-4b5f-bdb8-35477e9fdc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:44.545106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1033536-7ae2-4b5f-bdb8-35477e9fdc7b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:44.545392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1033536-7ae2-4b5f-bdb8-35477e9fdc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:44.545667 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1033536-7ae2-4b5f-bdb8-35477e9fdc7b None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:44.546350 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1033536-7ae2-4b5f-bdb8-35477e9fdc7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:44.547722 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1033536-7ae2-4b5f-bdb8-35477e9fdc7b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:44.551329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5c7db-cdf4-492c-8e8e-1094f40838a1 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:44.551613 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5c7db-cdf4-492c-8e8e-1094f40838a1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:44.551888 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5c7db-cdf4-492c-8e8e-1094f40838a1 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:44.553491 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 493/996] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:42:44.557699 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 504/997] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jul 5 12:42:44 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:42:44.558699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429707e6-e4cc-4138-88b2-b231f623b6de None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:44.558995 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429707e6-e4cc-4138-88b2-b231f623b6de None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:44.559274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429707e6-e4cc-4138-88b2-b231f623b6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:44.581542 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-429707e6-e4cc-4138-88b2-b231f623b6de None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:44.582777 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-429707e6-e4cc-4138-88b2-b231f623b6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:44.658813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 494/998] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:42:44.681716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1033536-7ae2-4b5f-bdb8-35477e9fdc7b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:44.719076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:44.785309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1033536-7ae2-4b5f-bdb8-35477e9fdc7b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:44.819668 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa38b1c-2ebd-4211-87e3-c750d14fe7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:44.820472 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa38b1c-2ebd-4211-87e3-c750d14fe7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:44.820788 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa38b1c-2ebd-4211-87e3-c750d14fe7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:44.821069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa38b1c-2ebd-4211-87e3-c750d14fe7e9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:44.821720 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa38b1c-2ebd-4211-87e3-c750d14fe7e9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:44.823106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa38b1c-2ebd-4211-87e3-c750d14fe7e9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:44.834683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-4fa38b1c-2ebd-4211-87e3-c750d14fe7e9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 12:42:44.834683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:44.834683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:44.834683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:44.834683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:44.834683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:44.834683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:44.834683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:44.834683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 12:42:44.834683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:44.834683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:44.834683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:44.834683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:44.834683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:44.834683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:44.834683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:44.834683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:44.835663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:44.835663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:44.835663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:44.835663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:44.835663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:44.835663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:44.835663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:44.835663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:44.835663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:44.835663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:44.835663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:44.835663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:44.835663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:44.835663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:44.835663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:44.835663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:44.836531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:44.836531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:44.836531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:44.836531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:44.836531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:44.836531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:44.836531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:44.836531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:44.836531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:44.836531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:44.836531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:44.836531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:44.836531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 12:42:44.836531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:44.836531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 505/999] 10.222.0.36 () {56 vars in 1105 bytes} [Tue Jul 5 12:42:44 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:44.841973 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429707e6-e4cc-4138-88b2-b231f623b6de None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:44.851370 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:44.942447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f1570-9fb4-4b84-b3e8-25c100552d45 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:44.942779 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f1570-9fb4-4b84-b3e8-25c100552d45 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:44.943008 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f1570-9fb4-4b84-b3e8-25c100552d45 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:44.944129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429707e6-e4cc-4138-88b2-b231f623b6de None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:44.947958 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 506/1000] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:42:44.949663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb7bb6-6cc2-47ed-b94d-99e86c525fe4 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:44.949956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb7bb6-6cc2-47ed-b94d-99e86c525fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:44.950243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb7bb6-6cc2-47ed-b94d-99e86c525fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:44.968825 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-78bb7bb6-6cc2-47ed-b94d-99e86c525fe4 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:44.970179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-78bb7bb6-6cc2-47ed-b94d-99e86c525fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:44.983072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13535c-4ce2-49d0-93af-339e37b35840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:44.983746 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13535c-4ce2-49d0-93af-339e37b35840 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:44.984036 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13535c-4ce2-49d0-93af-339e37b35840 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:44.984318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13535c-4ce2-49d0-93af-339e37b35840 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:44.985061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13535c-4ce2-49d0-93af-339e37b35840 None admin] RBAC: Adding query filter params (name=image) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:44.985376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13535c-4ce2-49d0-93af-339e37b35840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:44.986809 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13535c-4ce2-49d0-93af-339e37b35840 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:44.992134 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 495/1001] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:44.997656 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13535c-4ce2-49d0-93af-339e37b35840 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:45.046383 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 507/1002] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:42:45.069173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb7bb6-6cc2-47ed-b94d-99e86c525fe4 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:45.081622 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:45.100644 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:45.119788 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13535c-4ce2-49d0-93af-339e37b35840 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:45.163252 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9817da-dea1-4198-9163-eae29c7981f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:45.164062 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9817da-dea1-4198-9163-eae29c7981f3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:45.164687 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9817da-dea1-4198-9163-eae29c7981f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:45.164977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9817da-dea1-4198-9163-eae29c7981f3 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:45.165962 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9817da-dea1-4198-9163-eae29c7981f3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:45.166271 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9817da-dea1-4198-9163-eae29c7981f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:45.168363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9817da-dea1-4198-9163-eae29c7981f3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:45.169974 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb7bb6-6cc2-47ed-b94d-99e86c525fe4 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:45.180832 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 496/1003] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:44 2022] GET /identity/v3/services?type=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:45.216110 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37219c-2a37-441b-945b-7dd498135c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:45.217242 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37219c-2a37-441b-945b-7dd498135c88 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:45.217526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37219c-2a37-441b-945b-7dd498135c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:45.217801 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37219c-2a37-441b-945b-7dd498135c88 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:45.218461 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37219c-2a37-441b-945b-7dd498135c88 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:45.219878 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37219c-2a37-441b-945b-7dd498135c88 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:45.233147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-2d37219c-2a37-441b-945b-7dd498135c88 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 12:42:45.233147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:45.233147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:45.233147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:45.233147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:45.233147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:45.233147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:45.233147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:45.233147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 12:42:45.233147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:45.233147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:45.233147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:45.233147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:45.233147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:45.233147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:45.233147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:45.233147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:45.234223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:45.234223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:45.234223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:45.234223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:45.234223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:45.234223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:45.234223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:45.234223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:45.234223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:45.234223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:45.234223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:45.234223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:45.234223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:45.234223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:45.234223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:45.234223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:45.235077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:45.235077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:45.235077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:45.235077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:45.235077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:45.235077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:45.235077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:45.235077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:45.235077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:45.235077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:45.235077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:45.235077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:45.235077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 12:42:45.235077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:45.240124 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 508/1004] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:45.241474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9817da-dea1-4198-9163-eae29c7981f3 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:45.351053 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9817da-dea1-4198-9163-eae29c7981f3 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:45.385733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b3f82-5506-437c-abd9-f230144cb357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:45.386389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b3f82-5506-437c-abd9-f230144cb357 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:45.386671 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b3f82-5506-437c-abd9-f230144cb357 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:45.386944 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b3f82-5506-437c-abd9-f230144cb357 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:45.387637 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b3f82-5506-437c-abd9-f230144cb357 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:45.387939 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b3f82-5506-437c-abd9-f230144cb357 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:45.389319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b3f82-5506-437c-abd9-f230144cb357 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:45.390487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:45.399047 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 497/1005] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jul 5 12:42:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:45.400241 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37219c-2a37-441b-945b-7dd498135c88 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:45.496119 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:45.503471 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37219c-2a37-441b-945b-7dd498135c88 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:45.543340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27746aa0-0c9a-4196-bfd5-e4c2b46b7218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:45.544015 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27746aa0-0c9a-4196-bfd5-e4c2b46b7218 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:45.544294 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27746aa0-0c9a-4196-bfd5-e4c2b46b7218 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:45.544653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27746aa0-0c9a-4196-bfd5-e4c2b46b7218 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:45.545363 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27746aa0-0c9a-4196-bfd5-e4c2b46b7218 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:45.545717 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27746aa0-0c9a-4196-bfd5-e4c2b46b7218 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:45.547149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27746aa0-0c9a-4196-bfd5-e4c2b46b7218 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:45.556844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 509/1006] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jul 5 12:42:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:45.558243 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b3f82-5506-437c-abd9-f230144cb357 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:45.667082 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b3f82-5506-437c-abd9-f230144cb357 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:45.703677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb86ba-46db-461c-9808-22c13f349638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:45.704353 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb86ba-46db-461c-9808-22c13f349638 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:45.704678 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb86ba-46db-461c-9808-22c13f349638 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:45.704962 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb86ba-46db-461c-9808-22c13f349638 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:45.705752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb86ba-46db-461c-9808-22c13f349638 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:45.707126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb86ba-46db-461c-9808-22c13f349638 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:45.802545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 498/1007] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jul 5 12:42:45 2022] POST /identity/v3/endpoints => generated 334 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:42:46.622634 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fcd17-6578-4cf6-9de2-e1d83a3b95bf None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:46.623164 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fcd17-6578-4cf6-9de2-e1d83a3b95bf None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:46.623164 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fcd17-6578-4cf6-9de2-e1d83a3b95bf None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:46.624709 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 510/1008] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:46.629673 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4684cd1-7d2b-44d7-b89e-f0101d9467f1 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:46.629966 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4684cd1-7d2b-44d7-b89e-f0101d9467f1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:46.630245 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4684cd1-7d2b-44d7-b89e-f0101d9467f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:46.647418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c4684cd1-7d2b-44d7-b89e-f0101d9467f1 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:46.648627 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c4684cd1-7d2b-44d7-b89e-f0101d9467f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:46.699683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:46.723136 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 499/1009] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:46 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:46.746716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fcd17-6578-4cf6-9de2-e1d83a3b95bf None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:46.849451 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fcd17-6578-4cf6-9de2-e1d83a3b95bf None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:46.884184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16374ca8-b893-4f11-858d-4d6045bbb7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:46.884935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16374ca8-b893-4f11-858d-4d6045bbb7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:46.885217 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16374ca8-b893-4f11-858d-4d6045bbb7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:46.885490 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16374ca8-b893-4f11-858d-4d6045bbb7d3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:46.886138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16374ca8-b893-4f11-858d-4d6045bbb7d3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:46.887602 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16374ca8-b893-4f11-858d-4d6045bbb7d3 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:46.899456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-16374ca8-b893-4f11-858d-4d6045bbb7d3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:42:46.899456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:46.899456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:46.899456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:46.899456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:46.899456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:46.899456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:46.899456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:46.899456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:42:46.899456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:46.899456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:46.899456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:46.899456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:46.899456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:46.899456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:46.899456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:46.899456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:46.900447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:46.900447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:46.900447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:46.900447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:46.900447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:46.900447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:46.900447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:46.900447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:46.900447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:46.900447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:46.900447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:46.900447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:46.900447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:46.900447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:46.900447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:46.900447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:46.901347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:46.901347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:46.901347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:46.901347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:46.901347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:46.901347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:46.901347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:46.901347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:46.901347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:46.901347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:46.901347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:46.901347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:46.901347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 12:42:46.901347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:46.904898 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 511/1010] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jul 5 12:42:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:46.906609 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4684cd1-7d2b-44d7-b89e-f0101d9467f1 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:47.009530 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4684cd1-7d2b-44d7-b89e-f0101d9467f1 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:47.045237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fb7e6-2f93-4437-a78e-1b149af4ecb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:47.045912 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fb7e6-2f93-4437-a78e-1b149af4ecb5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:47.046200 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fb7e6-2f93-4437-a78e-1b149af4ecb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:47.046480 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fb7e6-2f93-4437-a78e-1b149af4ecb5 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:47.047193 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fb7e6-2f93-4437-a78e-1b149af4ecb5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:47.047501 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fb7e6-2f93-4437-a78e-1b149af4ecb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:47.051267 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fb7e6-2f93-4437-a78e-1b149af4ecb5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:47.062227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 500/1011] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jul 5 12:42:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:47.063913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16374ca8-b893-4f11-858d-4d6045bbb7d3 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:47.090567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:47.168134 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16374ca8-b893-4f11-858d-4d6045bbb7d3 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:47.202797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06387d0-709f-47de-84cf-700c737c1857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:47.203494 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06387d0-709f-47de-84cf-700c737c1857 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:47.220183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06387d0-709f-47de-84cf-700c737c1857 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:47.220183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06387d0-709f-47de-84cf-700c737c1857 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:47.220183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06387d0-709f-47de-84cf-700c737c1857 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:47.220183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06387d0-709f-47de-84cf-700c737c1857 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:47.220183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06387d0-709f-47de-84cf-700c737c1857 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:47.220183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 512/1012] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jul 5 12:42:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:47.221201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fb7e6-2f93-4437-a78e-1b149af4ecb5 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:47.237074 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa010d24-750f-4f37-9ab5-168cdb75ade2 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:47.237366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa010d24-750f-4f37-9ab5-168cdb75ade2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:47.237648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa010d24-750f-4f37-9ab5-168cdb75ade2 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:47.239139 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 513/1013] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:42:47.243871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af31e3-d8f1-4846-9a51-5ab65e83b8df None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:47.244158 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af31e3-d8f1-4846-9a51-5ab65e83b8df None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:47.244424 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af31e3-d8f1-4846-9a51-5ab65e83b8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:47.261139 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-e9af31e3-d8f1-4846-9a51-5ab65e83b8df None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:47.262311 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e9af31e3-d8f1-4846-9a51-5ab65e83b8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:47.271562 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:47.322137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fb7e6-2f93-4437-a78e-1b149af4ecb5 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:47.329843 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 514/1014] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:47 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:42:47.353930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af31e3-d8f1-4846-9a51-5ab65e83b8df None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:47.360198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9189bf-4df0-46e4-9a23-f05692fe756a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:47.361219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9189bf-4df0-46e4-9a23-f05692fe756a None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:47.361855 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9189bf-4df0-46e4-9a23-f05692fe756a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:47.362143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9189bf-4df0-46e4-9a23-f05692fe756a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:47.362899 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9189bf-4df0-46e4-9a23-f05692fe756a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:47.364574 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9189bf-4df0-46e4-9a23-f05692fe756a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:47.370831 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:47.448775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af31e3-d8f1-4846-9a51-5ab65e83b8df None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:47.480618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 501/1015] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jul 5 12:42:47 2022] POST /identity/v3/endpoints => generated 325 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:42:47.502406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da33c71-1c54-4768-85e1-7ac42da61301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:47.503098 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da33c71-1c54-4768-85e1-7ac42da61301 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:47.503379 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da33c71-1c54-4768-85e1-7ac42da61301 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:47.503696 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da33c71-1c54-4768-85e1-7ac42da61301 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:47.504499 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da33c71-1c54-4768-85e1-7ac42da61301 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:47.505989 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da33c71-1c54-4768-85e1-7ac42da61301 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:47.602933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 515/1016] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jul 5 12:42:47 2022] POST /identity/v3/services => generated 242 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:42:47.950908 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58431fb-f68e-404a-a5cb-46fc416b866c None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:47.951470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58431fb-f68e-404a-a5cb-46fc416b866c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:47.951470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58431fb-f68e-404a-a5cb-46fc416b866c None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:47.952896 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 502/1017] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:47.958497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa99bd-cdb0-4061-a909-d2b199a0610f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:47.958891 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa99bd-cdb0-4061-a909-d2b199a0610f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:47.959072 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa99bd-cdb0-4061-a909-d2b199a0610f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:47.977608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-53aa99bd-cdb0-4061-a909-d2b199a0610f None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:47.978800 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-53aa99bd-cdb0-4061-a909-d2b199a0610f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:48.044999 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:48.055054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 516/1018] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:48.078577 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58431fb-f68e-404a-a5cb-46fc416b866c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:48.182837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58431fb-f68e-404a-a5cb-46fc416b866c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:48.185221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:48.216944 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc101e47-5ad8-45fa-a153-67a6a2ae395d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:48.217892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc101e47-5ad8-45fa-a153-67a6a2ae395d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:48.218212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc101e47-5ad8-45fa-a153-67a6a2ae395d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:48.218656 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc101e47-5ad8-45fa-a153-67a6a2ae395d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:48.230085 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc101e47-5ad8-45fa-a153-67a6a2ae395d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:48.238323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-dc101e47-5ad8-45fa-a153-67a6a2ae395d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:42:48.238323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:48.238323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:48.238323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:48.238323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:48.238323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:48.238323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:48.238323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:48.238323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:48.238323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:48.238323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:48.238323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:48.238323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:48.238323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:48.238323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:48.238323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:48.239277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:48.239277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:48.239277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:48.239277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:48.239277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:48.239277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:48.239277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:48.239277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:48.239277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:48.239277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:48.239277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:48.239277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:48.239277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:48.239277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:48.239277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:48.239277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:48.240212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:48.240212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:48.240212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:48.240212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:48.240212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:48.240212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:48.240212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:48.240212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:48.240212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:48.240212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:48.240212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:42:48.240212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:48.244534 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 503/1019] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jul 5 12:42:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:48.245573 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa99bd-cdb0-4061-a909-d2b199a0610f None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:48.344340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa99bd-cdb0-4061-a909-d2b199a0610f None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:48.378164 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bff4e0-e5eb-4952-8556-ab2f4219c7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:48.378834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bff4e0-e5eb-4952-8556-ab2f4219c7ac None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:48.379116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bff4e0-e5eb-4952-8556-ab2f4219c7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:48.379393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bff4e0-e5eb-4952-8556-ab2f4219c7ac None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:48.380134 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bff4e0-e5eb-4952-8556-ab2f4219c7ac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:48.380441 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bff4e0-e5eb-4952-8556-ab2f4219c7ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:48.381831 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bff4e0-e5eb-4952-8556-ab2f4219c7ac None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:48.394851 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 517/1020] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jul 5 12:42:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:48.396120 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc101e47-5ad8-45fa-a153-67a6a2ae395d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:48.495889 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc101e47-5ad8-45fa-a153-67a6a2ae395d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:48.529358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23ea58-13ae-4959-829d-4648cb537ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:48.530147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23ea58-13ae-4959-829d-4648cb537ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:48.530427 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23ea58-13ae-4959-829d-4648cb537ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:48.530698 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23ea58-13ae-4959-829d-4648cb537ad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:48.541820 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23ea58-13ae-4959-829d-4648cb537ad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:48.543249 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23ea58-13ae-4959-829d-4648cb537ad3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:48.559937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-ed23ea58-13ae-4959-829d-4648cb537ad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:48.559937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:48.559937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:48.559937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:48.559937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:48.559937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:48.559937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:48.559937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:48.559937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:48.559937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:48.559937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:48.559937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:48.559937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:48.559937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:48.559937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:48.561125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:48.561125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:48.561125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:48.561125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:48.561125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:48.561125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:48.561125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:48.561125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:48.561125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:48.561125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:48.561125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:48.561125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:48.561125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:48.561125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:48.561125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:48.561125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:48.561125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:48.562030 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:48.562030 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:48.562030 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:48.562030 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:48.562030 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 504/1021] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:48.568421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bff4e0-e5eb-4952-8556-ab2f4219c7ac None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:48.630016 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:48.671365 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bff4e0-e5eb-4952-8556-ab2f4219c7ac None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:48.705989 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1c726-e6ef-4501-b14a-fa71c3e932f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:48.706794 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1c726-e6ef-4501-b14a-fa71c3e932f8 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:48.707193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1c726-e6ef-4501-b14a-fa71c3e932f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:48.707561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1c726-e6ef-4501-b14a-fa71c3e932f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:48.708377 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1c726-e6ef-4501-b14a-fa71c3e932f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:48.708812 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1c726-e6ef-4501-b14a-fa71c3e932f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:48.710268 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1c726-e6ef-4501-b14a-fa71c3e932f8 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:48.728075 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 518/1022] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:48.729684 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23ea58-13ae-4959-829d-4648cb537ad3 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:48.749117 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:48.831516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23ea58-13ae-4959-829d-4648cb537ad3 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:48.865605 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074c1f9-ef08-47cc-9233-c7f6bf578098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:48.866532 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074c1f9-ef08-47cc-9233-c7f6bf578098 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:48.866911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074c1f9-ef08-47cc-9233-c7f6bf578098 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:48.867283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074c1f9-ef08-47cc-9233-c7f6bf578098 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:48.874755 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074c1f9-ef08-47cc-9233-c7f6bf578098 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:48.876286 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074c1f9-ef08-47cc-9233-c7f6bf578098 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:48.890046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-b074c1f9-ef08-47cc-9233-c7f6bf578098 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:42:48.890046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:48.890046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:48.890046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:48.890046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:48.890046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:48.890046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:48.890046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:48.890046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:48.890046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:48.890046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:48.890046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:48.890046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:48.890046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:48.890046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:48.890046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:48.891198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:48.891198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:48.891198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:48.891198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:48.891198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:48.891198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:48.891198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:48.891198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:48.891198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:48.891198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:48.891198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:48.891198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:48.891198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:48.891198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:48.891198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:48.891198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:48.891198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:48.891198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:48.892955 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:48.892955 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:48.892955 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:48.892955 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:48.892955 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:48.892955 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:48.892955 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:48.892955 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:48.892955 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:42:48.892955 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:48.898989 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 505/1023] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jul 5 12:42:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:48.900473 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1c726-e6ef-4501-b14a-fa71c3e932f8 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:49.003160 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1c726-e6ef-4501-b14a-fa71c3e932f8 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:49.023309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:49.037383 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0289de-5df3-4866-921e-92ff56835638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:49.038061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0289de-5df3-4866-921e-92ff56835638 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:49.038347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0289de-5df3-4866-921e-92ff56835638 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:49.038630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0289de-5df3-4866-921e-92ff56835638 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:49.039467 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0289de-5df3-4866-921e-92ff56835638 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:49.039834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0289de-5df3-4866-921e-92ff56835638 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:49.041317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0289de-5df3-4866-921e-92ff56835638 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:49.071649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 519/1024] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jul 5 12:42:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:49.072606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074c1f9-ef08-47cc-9233-c7f6bf578098 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:49.152394 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:49.175098 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074c1f9-ef08-47cc-9233-c7f6bf578098 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:49.210037 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc5218-8953-48da-ab25-445e2f57e410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:49.210694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc5218-8953-48da-ab25-445e2f57e410 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:49.210983 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc5218-8953-48da-ab25-445e2f57e410 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:49.211264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc5218-8953-48da-ab25-445e2f57e410 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:49.279068 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc5218-8953-48da-ab25-445e2f57e410 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:49.280526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc5218-8953-48da-ab25-445e2f57e410 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:49.356312 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:49.384715 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 506/1025] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:42:49 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 12:42:49.386528 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0289de-5df3-4866-921e-92ff56835638 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:49.490136 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0289de-5df3-4866-921e-92ff56835638 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:49.525926 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f019c-47aa-4800-853c-4080b37fb899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:49.527001 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f019c-47aa-4800-853c-4080b37fb899 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:49.527438 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f019c-47aa-4800-853c-4080b37fb899 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:49.527856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f019c-47aa-4800-853c-4080b37fb899 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:49.539613 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f019c-47aa-4800-853c-4080b37fb899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:49.541051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f019c-47aa-4800-853c-4080b37fb899 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:49.542416 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e594aa6-706a-4c96-b799-40ec465c3c5a None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:49.542777 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e594aa6-706a-4c96-b799-40ec465c3c5a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:49.543127 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e594aa6-706a-4c96-b799-40ec465c3c5a None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:49.544841 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 507/1026] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:42:49.550572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677462b-729a-4ba7-ac73-960d3682077e None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:49.550864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677462b-729a-4ba7-ac73-960d3682077e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:49.551148 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677462b-729a-4ba7-ac73-960d3682077e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:49.567918 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-b60f019c-47aa-4800-853c-4080b37fb899 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:49.567918 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:49.567918 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:49.567918 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:49.567918 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:49.567918 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:49.567918 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:49.567918 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:49.567918 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:49.567918 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:49.567918 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:49.567918 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:49.567918 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:49.567918 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:49.567918 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:49.569059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:49.569059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:49.569059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:49.569059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:49.569059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:49.569059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:49.569059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:49.569059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:49.569059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:49.569059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:49.569059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:49.569059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:49.569059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:49.569059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:49.569059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:49.569059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:49.569059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:49.569971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:49.569971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:49.569971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:49.569971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:49.570995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 520/1027] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:49.571313 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-7677462b-729a-4ba7-ac73-960d3682077e None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:49.572513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7677462b-729a-4ba7-ac73-960d3682077e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:49.574987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f019c-47aa-4800-853c-4080b37fb899 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:49.607921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:49.642046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 508/1028] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:42:49.658132 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8c7a8-f178-4200-bbeb-78885c9bcbb1 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:49.658449 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8c7a8-f178-4200-bbeb-78885c9bcbb1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:49.658706 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8c7a8-f178-4200-bbeb-78885c9bcbb1 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:49.660609 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 509/1029] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:42:49.665060 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8c7a8-f178-4200-bbeb-78885c9bcbb1 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:49.685128 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f019c-47aa-4800-853c-4080b37fb899 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:49.718384 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84648832-236e-4fe1-ac93-73d92fd87270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:49.719048 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84648832-236e-4fe1-ac93-73d92fd87270 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:49.719329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84648832-236e-4fe1-ac93-73d92fd87270 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:49.719606 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84648832-236e-4fe1-ac93-73d92fd87270 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:49.720326 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84648832-236e-4fe1-ac93-73d92fd87270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:49.720699 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84648832-236e-4fe1-ac93-73d92fd87270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:49.722068 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84648832-236e-4fe1-ac93-73d92fd87270 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:49.733241 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 521/1030] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:49.734431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06fb0e-d3c1-4d55-bf12-edd9aa24440a None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:49.734718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06fb0e-d3c1-4d55-bf12-edd9aa24440a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:49.734998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06fb0e-d3c1-4d55-bf12-edd9aa24440a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:49.750995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-ff06fb0e-d3c1-4d55-bf12-edd9aa24440a None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:49.752769 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ff06fb0e-d3c1-4d55-bf12-edd9aa24440a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:49.765543 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8c7a8-f178-4200-bbeb-78885c9bcbb1 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:49.773447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:49.799833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55521627-5ccd-468f-a9a0-1d0972a067b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:49.800554 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55521627-5ccd-468f-a9a0-1d0972a067b2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:49.800861 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55521627-5ccd-468f-a9a0-1d0972a067b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:49.801138 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55521627-5ccd-468f-a9a0-1d0972a067b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:49.802301 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55521627-5ccd-468f-a9a0-1d0972a067b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:49.803729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55521627-5ccd-468f-a9a0-1d0972a067b2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:49.805370 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 510/1031] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:49.806134 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55521627-5ccd-468f-a9a0-1d0972a067b2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:49.822761 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 522/1032] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:49.823569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06fb0e-d3c1-4d55-bf12-edd9aa24440a None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:49.847859 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:49.915978 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55521627-5ccd-468f-a9a0-1d0972a067b2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:49.931980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06fb0e-d3c1-4d55-bf12-edd9aa24440a None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:49.951072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456ab71-085f-4ee8-8e5c-7f5ffcdffa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:49.951861 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456ab71-085f-4ee8-8e5c-7f5ffcdffa65 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:49.952143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456ab71-085f-4ee8-8e5c-7f5ffcdffa65 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:49.952422 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456ab71-085f-4ee8-8e5c-7f5ffcdffa65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:49.959196 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456ab71-085f-4ee8-8e5c-7f5ffcdffa65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:49.960657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456ab71-085f-4ee8-8e5c-7f5ffcdffa65 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:49.964790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89107c99-a3db-45fc-9082-76e0bc177b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:49.965450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89107c99-a3db-45fc-9082-76e0bc177b81 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:49.965732 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89107c99-a3db-45fc-9082-76e0bc177b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:49.966007 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89107c99-a3db-45fc-9082-76e0bc177b81 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:49.966710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89107c99-a3db-45fc-9082-76e0bc177b81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:49.968137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89107c99-a3db-45fc-9082-76e0bc177b81 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:49.975015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-c456ab71-085f-4ee8-8e5c-7f5ffcdffa65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:49.975015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:49.975015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:49.975015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:49.975015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:49.975015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:49.975015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:49.975015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:49.975015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:49.975015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:49.975015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:49.975015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:49.975015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:49.975015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:49.975015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:49.976137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:49.976137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:49.976137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:49.976137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:49.976137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:49.976137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:49.976137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:49.976137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:49.976137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:49.976137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:49.976137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:49.976137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:49.976137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:49.976137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:49.976137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:49.976137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:49.976137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:49.982184 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:49.982184 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:49.982184 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:49.982184 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:49.982184 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:49.982184 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:49.982184 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:49.982184 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:49.982184 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 511/1033] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:49.982184 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456ab71-085f-4ee8-8e5c-7f5ffcdffa65 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:50.010385 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:50.065395 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 523/1034] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jul 5 12:42:49 2022] POST /identity/v3/projects => generated 311 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:42:50.066239 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89107c99-a3db-45fc-9082-76e0bc177b81 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:50.087482 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456ab71-085f-4ee8-8e5c-7f5ffcdffa65 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:50.128300 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4606e5-788f-401b-9bf4-81aa41b75b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:50.129560 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4606e5-788f-401b-9bf4-81aa41b75b96 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:50.130147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4606e5-788f-401b-9bf4-81aa41b75b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:50.130425 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4606e5-788f-401b-9bf4-81aa41b75b96 None admin] PATH_INFO: `/v3/services/image` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:50.131099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4606e5-788f-401b-9bf4-81aa41b75b96 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:50.132697 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4606e5-788f-401b-9bf4-81aa41b75b96 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:50.145042 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:50.146197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-2b4606e5-788f-401b-9bf4-81aa41b75b96 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 12:42:50.146197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:50.146197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:50.146197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:50.146197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:50.146197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:50.146197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:50.146197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:50.146197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 12:42:50.146197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:50.146197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:50.146197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:50.146197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:50.146197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:50.146197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:50.146197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:50.146197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:50.147221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:50.147221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:50.147221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:50.147221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:50.147221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:50.147221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:50.147221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:50.147221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:50.147221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:50.147221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:50.147221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:50.147221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:50.147221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:50.147221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:50.147221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:50.147221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:50.148073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:50.148073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:50.148073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:50.148073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:50.148073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:50.148073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:50.148073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:50.148073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:50.148073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:50.148073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:50.148073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:50.148073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:50.148073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 12:42:50.148073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:50.148073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 512/1035] 10.222.0.36 () {56 vars in 1105 bytes} [Tue Jul 5 12:42:49 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:50.153675 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4606e5-788f-401b-9bf4-81aa41b75b96 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:50.182487 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89107c99-a3db-45fc-9082-76e0bc177b81 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:50.222059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557981fe-2189-498a-bcbc-c018bba68cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:50.222742 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557981fe-2189-498a-bcbc-c018bba68cbf None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:50.223083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557981fe-2189-498a-bcbc-c018bba68cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:50.223355 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557981fe-2189-498a-bcbc-c018bba68cbf None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:50.224206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557981fe-2189-498a-bcbc-c018bba68cbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:50.224863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557981fe-2189-498a-bcbc-c018bba68cbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:50.226328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557981fe-2189-498a-bcbc-c018bba68cbf None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:50.246546 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 524/1036] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:50.247804 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557981fe-2189-498a-bcbc-c018bba68cbf None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:50.265578 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:50.270149 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4606e5-788f-401b-9bf4-81aa41b75b96 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:50.304133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132759b-ee30-4dcb-be3f-a6e020381811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:50.304839 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132759b-ee30-4dcb-be3f-a6e020381811 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:50.305122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132759b-ee30-4dcb-be3f-a6e020381811 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:50.305399 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132759b-ee30-4dcb-be3f-a6e020381811 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:50.306103 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132759b-ee30-4dcb-be3f-a6e020381811 None admin] RBAC: Adding query filter params (name=image) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:50.306410 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132759b-ee30-4dcb-be3f-a6e020381811 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:50.307774 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132759b-ee30-4dcb-be3f-a6e020381811 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:50.312681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 513/1037] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:50.318349 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132759b-ee30-4dcb-be3f-a6e020381811 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:50.353934 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557981fe-2189-498a-bcbc-c018bba68cbf None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:50.388767 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:50.395321 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ababa73-41fa-4719-8c2c-abee1f42f764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:50.396713 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ababa73-41fa-4719-8c2c-abee1f42f764 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:50.397026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ababa73-41fa-4719-8c2c-abee1f42f764 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:50.397314 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ababa73-41fa-4719-8c2c-abee1f42f764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:50.398253 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ababa73-41fa-4719-8c2c-abee1f42f764 None admin] RBAC: Adding query filter params (role.id=0376afc6fefb4532b4c0510d40c6c290, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=cdf37a42279a466b85906b23751f9c22) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:50.398572 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ababa73-41fa-4719-8c2c-abee1f42f764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:50.400020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ababa73-41fa-4719-8c2c-abee1f42f764 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:50.416619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 525/1038] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:42:50 2022] GET /identity/v3/role_assignments?user.id=cdf37a42279a466b85906b23751f9c22&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=0376afc6fefb4532b4c0510d40c6c290 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:50.443615 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132759b-ee30-4dcb-be3f-a6e020381811 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:50.481093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31b062-ac3a-42a3-a646-fa7f082e4eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:50.481771 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31b062-ac3a-42a3-a646-fa7f082e4eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:50.482058 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31b062-ac3a-42a3-a646-fa7f082e4eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:50.482333 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31b062-ac3a-42a3-a646-fa7f082e4eb3 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:50.483049 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31b062-ac3a-42a3-a646-fa7f082e4eb3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:50.483358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31b062-ac3a-42a3-a646-fa7f082e4eb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:50.484770 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31b062-ac3a-42a3-a646-fa7f082e4eb3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:50.495893 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 514/1039] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:50.496974 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ababa73-41fa-4719-8c2c-abee1f42f764 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:50.605611 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ababa73-41fa-4719-8c2c-abee1f42f764 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:50.640069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40dc8f-24c0-443f-992e-60d506973e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:50.640766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40dc8f-24c0-443f-992e-60d506973e80 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:50.641051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40dc8f-24c0-443f-992e-60d506973e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:50.641327 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40dc8f-24c0-443f-992e-60d506973e80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:50.642125 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40dc8f-24c0-443f-992e-60d506973e80 None admin] RBAC: Adding query filter params (interface=public, service_id=9a0f165774094fa89312c0f5b7547e49, region_id=RegionOne) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:50.642470 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40dc8f-24c0-443f-992e-60d506973e80 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:50.643847 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40dc8f-24c0-443f-992e-60d506973e80 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:50.653609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 526/1040] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jul 5 12:42:50 2022] GET /identity/v3/endpoints?service_id=9a0f165774094fa89312c0f5b7547e49&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:50.654666 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31b062-ac3a-42a3-a646-fa7f082e4eb3 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:50.683979 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:50.757809 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31b062-ac3a-42a3-a646-fa7f082e4eb3 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:50.792064 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b44564-e184-4faa-9c18-0025aa6f1135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:50.792761 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b44564-e184-4faa-9c18-0025aa6f1135 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:50.793051 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b44564-e184-4faa-9c18-0025aa6f1135 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:50.793331 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b44564-e184-4faa-9c18-0025aa6f1135 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:50.794015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b44564-e184-4faa-9c18-0025aa6f1135 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:50.795446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b44564-e184-4faa-9c18-0025aa6f1135 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:50.808630 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 515/1041] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jul 5 12:42:50 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:42:52.157227 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5221d9b-3b23-4bb8-9b9c-039ce15e4e4e None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:52.157773 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5221d9b-3b23-4bb8-9b9c-039ce15e4e4e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:52.157853 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5221d9b-3b23-4bb8-9b9c-039ce15e4e4e None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:52.159337 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 527/1042] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:52.164430 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8d6f4-281d-4cf9-ada8-56ce71c330d7 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:52.164852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8d6f4-281d-4cf9-ada8-56ce71c330d7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:52.165050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8d6f4-281d-4cf9-ada8-56ce71c330d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:52.181852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-7df8d6f4-281d-4cf9-ada8-56ce71c330d7 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:52.183048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7df8d6f4-281d-4cf9-ada8-56ce71c330d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:52.250903 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 516/1043] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:52.276265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5221d9b-3b23-4bb8-9b9c-039ce15e4e4e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:52.336777 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:52.378887 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5221d9b-3b23-4bb8-9b9c-039ce15e4e4e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:52.412918 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb25ec7-d806-465d-975b-1935181fb438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:52.413716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb25ec7-d806-465d-975b-1935181fb438 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:52.414000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb25ec7-d806-465d-975b-1935181fb438 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:52.414280 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb25ec7-d806-465d-975b-1935181fb438 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:52.415814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb25ec7-d806-465d-975b-1935181fb438 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:52.416531 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217ae84-522a-44d2-901f-41389ae08489 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:52.416848 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217ae84-522a-44d2-901f-41389ae08489 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:52.417129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217ae84-522a-44d2-901f-41389ae08489 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:52.417312 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb25ec7-d806-465d-975b-1935181fb438 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:52.418633 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 517/1044] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:52.423233 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 528/1045] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:52.424601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765899b-fcfd-4b5f-8f85-b14d6d2e5e7c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:52.424713 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb25ec7-d806-465d-975b-1935181fb438 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:52.424891 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765899b-fcfd-4b5f-8f85-b14d6d2e5e7c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:52.425175 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765899b-fcfd-4b5f-8f85-b14d6d2e5e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:52.442080 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-4765899b-fcfd-4b5f-8f85-b14d6d2e5e7c None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:52.443275 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4765899b-fcfd-4b5f-8f85-b14d6d2e5e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:52.457988 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:52.514171 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 518/1046] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:52.532939 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb25ec7-d806-465d-975b-1935181fb438 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:52.536984 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765899b-fcfd-4b5f-8f85-b14d6d2e5e7c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:52.566137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:52.574354 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ba662-60f8-4e87-a374-a2a85597976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:52.575063 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ba662-60f8-4e87-a374-a2a85597976e None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:52.575351 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ba662-60f8-4e87-a374-a2a85597976e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:52.575631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ba662-60f8-4e87-a374-a2a85597976e None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:52.576368 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ba662-60f8-4e87-a374-a2a85597976e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:52.577856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ba662-60f8-4e87-a374-a2a85597976e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:52.641000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765899b-fcfd-4b5f-8f85-b14d6d2e5e7c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:52.674194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e74cd-1ab9-487e-b671-860ce3f8badb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:52.674999 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e74cd-1ab9-487e-b671-860ce3f8badb None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:52.675282 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e74cd-1ab9-487e-b671-860ce3f8badb None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:52.675557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e74cd-1ab9-487e-b671-860ce3f8badb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:52.685560 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e74cd-1ab9-487e-b671-860ce3f8badb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:52.694259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-8f0e74cd-1ab9-487e-b671-860ce3f8badb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:42:52.694259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:52.694259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:52.694259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:52.694259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:52.694259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:52.694259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:52.694259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:52.694259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:52.694259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:52.694259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:52.694259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:52.694259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:52.694259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:52.694259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:52.694259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:52.695283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:52.695283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:52.695283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:52.695283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:52.695283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:52.695283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:52.695283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:52.695283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:52.695283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:52.695283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:52.695283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:52.695283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:52.695283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:52.695283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:52.695283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:52.695283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:52.696166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:52.696166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:52.696166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:52.696166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:52.696166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:52.696166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:52.696166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:52.696166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:52.696166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:52.696166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:52.696166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:42:52.696166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:52.696166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 519/1047] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jul 5 12:42:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:52.701404 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e74cd-1ab9-487e-b671-860ce3f8badb None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:52.706528 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 529/1048] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jul 5 12:42:52 2022] POST /identity/v3/users => generated 285 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 12:42:52.721441 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:52.819972 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e74cd-1ab9-487e-b671-860ce3f8badb None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:52.844332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88da9e-786e-48d7-ae88-0df3e0c5d235 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:52.844652 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88da9e-786e-48d7-ae88-0df3e0c5d235 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:52.844933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88da9e-786e-48d7-ae88-0df3e0c5d235 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:52.847184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 530/1049] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:42:52.852708 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b5159-4b7a-4fc5-81f5-e43d9f409fbd None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:52.852998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b5159-4b7a-4fc5-81f5-e43d9f409fbd None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:52.853284 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b5159-4b7a-4fc5-81f5-e43d9f409fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:52.862148 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4560e1a-cad6-41b3-b254-58f4ce498f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:52.863954 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4560e1a-cad6-41b3-b254-58f4ce498f4d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:52.863954 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4560e1a-cad6-41b3-b254-58f4ce498f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:52.863954 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4560e1a-cad6-41b3-b254-58f4ce498f4d None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:52.864241 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4560e1a-cad6-41b3-b254-58f4ce498f4d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:52.864424 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4560e1a-cad6-41b3-b254-58f4ce498f4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:52.866005 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4560e1a-cad6-41b3-b254-58f4ce498f4d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:52.873299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-fa6b5159-4b7a-4fc5-81f5-e43d9f409fbd None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:52.874278 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 520/1050] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jul 5 12:42:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:52.874503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-fa6b5159-4b7a-4fc5-81f5-e43d9f409fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:52.880131 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4560e1a-cad6-41b3-b254-58f4ce498f4d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:52.949089 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 531/1051] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:52.960400 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:52.972711 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b5159-4b7a-4fc5-81f5-e43d9f409fbd None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:52.992830 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4560e1a-cad6-41b3-b254-58f4ce498f4d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:53.030238 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5ea8e-2b2e-42bf-aacf-2c75c308233e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:53.031029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5ea8e-2b2e-42bf-aacf-2c75c308233e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:53.031344 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5ea8e-2b2e-42bf-aacf-2c75c308233e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:53.031584 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5ea8e-2b2e-42bf-aacf-2c75c308233e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:53.042894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5ea8e-2b2e-42bf-aacf-2c75c308233e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:53.044335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5ea8e-2b2e-42bf-aacf-2c75c308233e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:53.062048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-a0b5ea8e-2b2e-42bf-aacf-2c75c308233e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:53.062048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:53.062048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:53.062048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:53.062048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:53.062048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:53.062048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:53.062048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:53.062048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:53.062048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:53.062048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:53.062048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:53.062048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:53.062048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:53.062048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:53.063021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:53.063021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:53.063021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:53.063021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:53.063021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:53.063021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:53.063021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:53.063021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:53.063021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:53.063021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:53.063021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:53.063021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:53.063021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:53.063021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:53.063021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:53.063021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:53.063021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:53.065516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:53.065516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:53.065516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:53.065516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:53.065516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 521/1052] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:53.069417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5ea8e-2b2e-42bf-aacf-2c75c308233e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:53.087181 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b5159-4b7a-4fc5-81f5-e43d9f409fbd None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:53.101871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:53.123878 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cbc58-31a0-45ad-80a8-fcf456dda2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:53.124700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cbc58-31a0-45ad-80a8-fcf456dda2aa None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:53.125001 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cbc58-31a0-45ad-80a8-fcf456dda2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:53.125267 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cbc58-31a0-45ad-80a8-fcf456dda2aa None admin] PATH_INFO: `/v3/services/image` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:53.125963 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6cbc58-31a0-45ad-80a8-fcf456dda2aa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:53.127833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6cbc58-31a0-45ad-80a8-fcf456dda2aa None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:53.139220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-9f6cbc58-31a0-45ad-80a8-fcf456dda2aa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 12:42:53.139220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:53.139220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:42:53.139220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:42:53.139220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:42:53.139220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:42:53.139220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:42:53.139220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:53.139220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 12:42:53.139220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:53.139220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:42:53.139220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:53.139220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:53.139220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:53.139220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:53.139220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:53.139220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:53.140219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:53.140219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:53.140219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:53.140219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:53.140219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:53.140219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:53.140219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:42:53.140219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:42:53.140219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:42:53.140219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:42:53.140219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:53.140219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:53.140219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:53.140219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:53.140219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:53.140219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:53.141176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:53.141176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:53.141176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:53.141176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:53.141176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:53.141176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:53.141176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:53.141176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:53.141176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:53.141176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:53.141176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:42:53.141176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:42:53.141176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 12:42:53.141176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:53.141176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 532/1053] 10.222.0.36 () {56 vars in 1105 bytes} [Tue Jul 5 12:42:52 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:53.146608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cbc58-31a0-45ad-80a8-fcf456dda2aa None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:53.186437 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5ea8e-2b2e-42bf-aacf-2c75c308233e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:53.212932 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:53.225767 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de8c58-e9b3-42cb-87ec-5c5fbacb945d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:53.226441 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de8c58-e9b3-42cb-87ec-5c5fbacb945d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:53.228062 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de8c58-e9b3-42cb-87ec-5c5fbacb945d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:53.228062 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de8c58-e9b3-42cb-87ec-5c5fbacb945d None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:53.228062 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de8c58-e9b3-42cb-87ec-5c5fbacb945d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:53.228062 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de8c58-e9b3-42cb-87ec-5c5fbacb945d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:53.229412 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de8c58-e9b3-42cb-87ec-5c5fbacb945d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:53.241857 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 522/1054] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:53.247486 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de8c58-e9b3-42cb-87ec-5c5fbacb945d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:53.259604 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cbc58-31a0-45ad-80a8-fcf456dda2aa None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:53.295822 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d87ea-8a93-420a-b349-c4a65a5a5346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:53.296492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d87ea-8a93-420a-b349-c4a65a5a5346 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:53.296804 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d87ea-8a93-420a-b349-c4a65a5a5346 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:53.297088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d87ea-8a93-420a-b349-c4a65a5a5346 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:53.297796 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d87ea-8a93-420a-b349-c4a65a5a5346 None admin] RBAC: Adding query filter params (name=image) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:53.298107 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d87ea-8a93-420a-b349-c4a65a5a5346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:53.299518 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d87ea-8a93-420a-b349-c4a65a5a5346 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:53.304828 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 533/1055] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:53.310432 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d87ea-8a93-420a-b349-c4a65a5a5346 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:53.356091 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:53.357420 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de8c58-e9b3-42cb-87ec-5c5fbacb945d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:53.391976 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c4a59-9812-4b44-93bc-ef7847b25476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:53.393338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c4a59-9812-4b44-93bc-ef7847b25476 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:53.393629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c4a59-9812-4b44-93bc-ef7847b25476 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:53.393977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c4a59-9812-4b44-93bc-ef7847b25476 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:53.401266 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c4a59-9812-4b44-93bc-ef7847b25476 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:53.402712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c4a59-9812-4b44-93bc-ef7847b25476 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:53.416115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d87ea-8a93-420a-b349-c4a65a5a5346 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:53.417780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-219c4a59-9812-4b44-93bc-ef7847b25476 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:42:53.417780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:53.417780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:53.417780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:53.417780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:53.417780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:53.417780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:53.417780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:53.417780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:53.417780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:53.417780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:53.417780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:53.417780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:53.417780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:53.417780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:53.417780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:53.418718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:53.418718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:53.418718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:53.418718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:53.418718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:53.418718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:53.418718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:53.418718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:53.418718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:53.418718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:53.418718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:53.418718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:53.418718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:53.418718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:53.418718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:53.418718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:53.418718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:53.418718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:53.419683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:53.419683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:53.419683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:53.419683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:53.419683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:53.419683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:53.419683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:53.419683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:53.419683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:42:53.419683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:53.419683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 523/1056] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jul 5 12:42:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:53.424570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c4a59-9812-4b44-93bc-ef7847b25476 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:53.456961 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd51c0e-c8c5-4297-aa41-5389e87e8126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:53.457943 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd51c0e-c8c5-4297-aa41-5389e87e8126 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:53.458491 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd51c0e-c8c5-4297-aa41-5389e87e8126 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:53.458771 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd51c0e-c8c5-4297-aa41-5389e87e8126 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:53.459481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd51c0e-c8c5-4297-aa41-5389e87e8126 None admin] RBAC: Adding query filter params (type=image) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:53.459791 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd51c0e-c8c5-4297-aa41-5389e87e8126 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:53.462160 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd51c0e-c8c5-4297-aa41-5389e87e8126 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:53.472561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 534/1057] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:53.473126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:53.474034 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd51c0e-c8c5-4297-aa41-5389e87e8126 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:53.530971 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c4a59-9812-4b44-93bc-ef7847b25476 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:53.569117 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e34cb2-acad-4f17-b6b7-4c0c7dc8e59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:53.569860 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e34cb2-acad-4f17-b6b7-4c0c7dc8e59f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:53.570219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e34cb2-acad-4f17-b6b7-4c0c7dc8e59f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:53.570564 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e34cb2-acad-4f17-b6b7-4c0c7dc8e59f None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:53.571588 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e34cb2-acad-4f17-b6b7-4c0c7dc8e59f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:53.572076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e34cb2-acad-4f17-b6b7-4c0c7dc8e59f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:53.573732 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e34cb2-acad-4f17-b6b7-4c0c7dc8e59f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:53.581581 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd51c0e-c8c5-4297-aa41-5389e87e8126 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:53.590094 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:53.597903 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 524/1058] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jul 5 12:42:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:53.604342 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e34cb2-acad-4f17-b6b7-4c0c7dc8e59f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:53.619755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefe5cd-134f-4dce-9f46-2f4bc32fbbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:53.620425 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefe5cd-134f-4dce-9f46-2f4bc32fbbbe None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:53.620847 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefe5cd-134f-4dce-9f46-2f4bc32fbbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:53.621136 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefe5cd-134f-4dce-9f46-2f4bc32fbbbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:53.621876 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefe5cd-134f-4dce-9f46-2f4bc32fbbbe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:53.623339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefe5cd-134f-4dce-9f46-2f4bc32fbbbe None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:53.704043 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e34cb2-acad-4f17-b6b7-4c0c7dc8e59f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:53.705626 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:53.739333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 535/1059] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jul 5 12:42:53 2022] POST /identity/v3/endpoints => generated 327 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:42:53.746245 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec10ed9-f8b5-42cd-b88e-bed2cbe88aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:53.747241 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec10ed9-f8b5-42cd-b88e-bed2cbe88aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:53.747656 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec10ed9-f8b5-42cd-b88e-bed2cbe88aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:53.748016 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec10ed9-f8b5-42cd-b88e-bed2cbe88aa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:53.760445 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec10ed9-f8b5-42cd-b88e-bed2cbe88aa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:53.762105 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec10ed9-f8b5-42cd-b88e-bed2cbe88aa0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:53.783330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-4ec10ed9-f8b5-42cd-b88e-bed2cbe88aa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:53.783330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:53.783330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:53.783330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:53.783330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:53.783330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:53.783330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:53.783330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:53.783330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:53.783330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:53.783330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:53.783330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:53.783330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:53.783330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:53.783330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:53.784557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:53.784557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:53.784557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:53.784557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:53.784557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:53.784557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:53.784557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:53.784557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:53.784557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:53.784557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:53.784557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:53.784557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:53.784557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:53.784557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:53.784557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:53.784557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:53.784557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:53.785693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:53.785693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:53.785693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:53.785693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:53.787178 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 525/1060] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:53.792957 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefe5cd-134f-4dce-9f46-2f4bc32fbbbe None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:53.909589 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefe5cd-134f-4dce-9f46-2f4bc32fbbbe None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:53.945919 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81ec39-e825-4f05-b2d7-4385efd4f31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:53.946600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81ec39-e825-4f05-b2d7-4385efd4f31e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:53.946886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81ec39-e825-4f05-b2d7-4385efd4f31e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:53.947172 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81ec39-e825-4f05-b2d7-4385efd4f31e None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:53.947904 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81ec39-e825-4f05-b2d7-4385efd4f31e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:53.948218 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81ec39-e825-4f05-b2d7-4385efd4f31e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:53.949633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81ec39-e825-4f05-b2d7-4385efd4f31e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:53.961883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 536/1061] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:53.967711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec10ed9-f8b5-42cd-b88e-bed2cbe88aa0 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:54.066981 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec10ed9-f8b5-42cd-b88e-bed2cbe88aa0 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:54.101668 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7f2dd-7908-449e-af44-dbacc0c82ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:54.102562 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7f2dd-7908-449e-af44-dbacc0c82ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:54.102912 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7f2dd-7908-449e-af44-dbacc0c82ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:54.103255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7f2dd-7908-449e-af44-dbacc0c82ce9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:54.110050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7f2dd-7908-449e-af44-dbacc0c82ce9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:54.112061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7f2dd-7908-449e-af44-dbacc0c82ce9 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:54.125752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-3ff7f2dd-7908-449e-af44-dbacc0c82ce9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:54.125752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:54.125752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:54.125752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:54.125752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:54.125752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:54.125752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:54.125752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:54.125752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:54.125752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:54.125752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:54.125752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:54.125752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:54.125752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:54.125752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:54.127357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:54.127357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:54.127357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:54.127357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:54.127357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:54.127357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:54.127357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:54.127357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:54.127357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:54.127357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:54.127357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:54.127357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:54.127357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:54.127357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:54.127357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:54.127357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:54.127357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:54.128481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:54.128481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:54.128481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:54.128481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:54.128481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:54.128481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:54.128481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:54.128481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:54.129490 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 526/1062] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:54.134922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81ec39-e825-4f05-b2d7-4385efd4f31e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:54.160267 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:54.237525 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81ec39-e825-4f05-b2d7-4385efd4f31e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:54.272991 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e0f85-5fd1-4b64-ae91-0a95d2b2822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:54.273729 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e0f85-5fd1-4b64-ae91-0a95d2b2822d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:54.273948 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e0f85-5fd1-4b64-ae91-0a95d2b2822d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:54.274229 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e0f85-5fd1-4b64-ae91-0a95d2b2822d None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:54.275023 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e0f85-5fd1-4b64-ae91-0a95d2b2822d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:54.275336 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e0f85-5fd1-4b64-ae91-0a95d2b2822d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:54.276795 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e0f85-5fd1-4b64-ae91-0a95d2b2822d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:54.293297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 537/1063] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:54.294487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7f2dd-7908-449e-af44-dbacc0c82ce9 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:54.307473 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:54.396170 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7f2dd-7908-449e-af44-dbacc0c82ce9 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:54.430322 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600917e-a85f-49d6-9c44-3df59f1a6bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:54.431218 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600917e-a85f-49d6-9c44-3df59f1a6bc0 None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:54.431504 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600917e-a85f-49d6-9c44-3df59f1a6bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:54.431784 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600917e-a85f-49d6-9c44-3df59f1a6bc0 None admin] PATH_INFO: `/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/cdf37a42279a466b85906b23751f9c22/roles/0376afc6fefb4532b4c0510d40c6c290` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:54.434015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600917e-a85f-49d6-9c44-3df59f1a6bc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4190347294b48c096d7aa9d3a479d12, user_id=cdf37a42279a466b85906b23751f9c22, role_id=0376afc6fefb4532b4c0510d40c6c290)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:54.435466 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600917e-a85f-49d6-9c44-3df59f1a6bc0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:54.504633 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 527/1064] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:42:54 2022] PUT /identity/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/cdf37a42279a466b85906b23751f9c22/roles/0376afc6fefb4532b4c0510d40c6c290 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:42:54.789396 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aff85-d8b5-49de-b231-4a17b6e4856d None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:54.789709 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aff85-d8b5-49de-b231-4a17b6e4856d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:54.789965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aff85-d8b5-49de-b231-4a17b6e4856d None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:54.791483 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 538/1065] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:42:54.796453 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89063455-34d2-49ee-a85d-f22d245989ef None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:54.796841 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89063455-34d2-49ee-a85d-f22d245989ef None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:54.797191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89063455-34d2-49ee-a85d-f22d245989ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:54.813914 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-89063455-34d2-49ee-a85d-f22d245989ef None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:54.815142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-89063455-34d2-49ee-a85d-f22d245989ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:54.880629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:54.885344 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 528/1066] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:42:54.909792 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8aff85-d8b5-49de-b231-4a17b6e4856d None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:54.997199 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:55.016066 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8aff85-d8b5-49de-b231-4a17b6e4856d None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:55.050638 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c3865-1aff-4a3c-be0c-479ac20fe3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:55.051355 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c3865-1aff-4a3c-be0c-479ac20fe3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:55.051633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c3865-1aff-4a3c-be0c-479ac20fe3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:55.051914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c3865-1aff-4a3c-be0c-479ac20fe3b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:55.062255 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c3865-1aff-4a3c-be0c-479ac20fe3b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:55.070386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-d07c3865-1aff-4a3c-be0c-479ac20fe3b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:42:55.070386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:55.070386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:55.070386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:55.070386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:55.070386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:55.070386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:55.070386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:55.070386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:55.070386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:55.070386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:55.070386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:55.070386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:55.070386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:55.070386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:55.070386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:55.071297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:55.071297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:55.071297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:55.071297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:55.071297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:55.071297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:55.071297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:55.071297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:55.071297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:55.071297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:55.071297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:55.071297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:55.071297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:55.071297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:55.071297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:55.071297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:55.072148 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:55.072148 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:55.072148 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:55.072148 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:55.072148 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:55.072148 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:55.072148 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:55.072148 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:55.072148 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:55.072148 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:55.072148 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:42:55.072148 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:55.073436 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 539/1067] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:42:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:55.077490 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89063455-34d2-49ee-a85d-f22d245989ef None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:55.177763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89063455-34d2-49ee-a85d-f22d245989ef None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:55.211435 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fe029-b212-4534-a0bf-ffd8f594ac61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:55.212100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fe029-b212-4534-a0bf-ffd8f594ac61 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:55.212383 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fe029-b212-4534-a0bf-ffd8f594ac61 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:55.212685 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fe029-b212-4534-a0bf-ffd8f594ac61 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:55.213431 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557fe029-b212-4534-a0bf-ffd8f594ac61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:55.213737 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557fe029-b212-4534-a0bf-ffd8f594ac61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:55.215096 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557fe029-b212-4534-a0bf-ffd8f594ac61 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:55.228653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 529/1068] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:42:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:55.229924 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c3865-1aff-4a3c-be0c-479ac20fe3b6 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:55.329996 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c3865-1aff-4a3c-be0c-479ac20fe3b6 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:55.364420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf81470-b3d9-468e-bd66-388577635067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:55.365316 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf81470-b3d9-468e-bd66-388577635067 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:55.365595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf81470-b3d9-468e-bd66-388577635067 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:55.365863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf81470-b3d9-468e-bd66-388577635067 None admin] PATH_INFO: `/v3/users/8f68a2b1191a4e35bf4d0739259c8ea9` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:55.377066 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:55.380073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf81470-b3d9-468e-bd66-388577635067 None admin] RBAC: Authorizing `identity:get_user(user_id=8f68a2b1191a4e35bf4d0739259c8ea9)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:55.381550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf81470-b3d9-468e-bd66-388577635067 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:55.387953 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 540/1069] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:42:55 2022] GET /identity/v3/users/8f68a2b1191a4e35bf4d0739259c8ea9 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:55.388945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fe029-b212-4534-a0bf-ffd8f594ac61 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:55.450579 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:55.490460 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fe029-b212-4534-a0bf-ffd8f594ac61 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:55.524415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d67302-bc3c-4405-8773-0f4b0e2b46b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:55.525086 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d67302-bc3c-4405-8773-0f4b0e2b46b0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:55.525374 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d67302-bc3c-4405-8773-0f4b0e2b46b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:55.525650 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d67302-bc3c-4405-8773-0f4b0e2b46b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:55.593702 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d67302-bc3c-4405-8773-0f4b0e2b46b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:55.595126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d67302-bc3c-4405-8773-0f4b0e2b46b0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:55.659859 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:55.704190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 530/1070] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:42:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 12:42:55.705650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf81470-b3d9-468e-bd66-388577635067 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:55.807007 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf81470-b3d9-468e-bd66-388577635067 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:55.833732 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8ea43-5f79-4775-a82f-cc1f1c8b045d None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:55.834022 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8ea43-5f79-4775-a82f-cc1f1c8b045d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:55.834309 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8ea43-5f79-4775-a82f-cc1f1c8b045d None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:55.835820 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 531/1071] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:42:55.840005 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c863c3a-3cd5-4315-9591-390b03a2824b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:55.840551 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e59a4-e296-4f47-a9b3-ee6875f6e0bc None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:55.840874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e59a4-e296-4f47-a9b3-ee6875f6e0bc None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:55.840990 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c863c3a-3cd5-4315-9591-390b03a2824b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:55.841157 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c863c3a-3cd5-4315-9591-390b03a2824b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:55.841251 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e59a4-e296-4f47-a9b3-ee6875f6e0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:55.841413 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c863c3a-3cd5-4315-9591-390b03a2824b None admin] PATH_INFO: `/v3/projects/3132d27beb4e4f069bd9192b6d646d2a` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:55.842573 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c863c3a-3cd5-4315-9591-390b03a2824b None admin] RBAC: Authorizing `identity:get_project(project_id=3132d27beb4e4f069bd9192b6d646d2a)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:55.844065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c863c3a-3cd5-4315-9591-390b03a2824b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:55.851486 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 541/1072] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:42:55 2022] GET /identity/v3/projects/3132d27beb4e4f069bd9192b6d646d2a => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:55.852177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c863c3a-3cd5-4315-9591-390b03a2824b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:55.864080 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-175e59a4-e296-4f47-a9b3-ee6875f6e0bc None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:55.865399 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-175e59a4-e296-4f47-a9b3-ee6875f6e0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:55.921221 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:55.934261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 532/1073] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:42:55.957202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e59a4-e296-4f47-a9b3-ee6875f6e0bc None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:55.957382 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c863c3a-3cd5-4315-9591-390b03a2824b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:55.993826 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7495c90-8da9-4879-bdf9-2d0ff0aeb3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:55.994538 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495c90-8da9-4879-bdf9-2d0ff0aeb3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:55.994822 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495c90-8da9-4879-bdf9-2d0ff0aeb3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:55.995101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495c90-8da9-4879-bdf9-2d0ff0aeb3c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:55.995979 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7495c90-8da9-4879-bdf9-2d0ff0aeb3c0 None admin] RBAC: Adding query filter params (role.id=868c7a356c674ded875dd079f5a9f5e0, scope.project.id=3132d27beb4e4f069bd9192b6d646d2a, user.id=8f68a2b1191a4e35bf4d0739259c8ea9) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:55.996299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7495c90-8da9-4879-bdf9-2d0ff0aeb3c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:55.997771 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7495c90-8da9-4879-bdf9-2d0ff0aeb3c0 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:56.012675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 542/1074] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:42:55 2022] GET /identity/v3/role_assignments?user.id=8f68a2b1191a4e35bf4d0739259c8ea9&scope.project.id=3132d27beb4e4f069bd9192b6d646d2a&role.id=868c7a356c674ded875dd079f5a9f5e0 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:56.075977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:56.085577 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e59a4-e296-4f47-a9b3-ee6875f6e0bc None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:56.122958 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7573c-1900-4de5-b0ab-12e7555fd12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:56.123554 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7573c-1900-4de5-b0ab-12e7555fd12d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:56.123842 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7573c-1900-4de5-b0ab-12e7555fd12d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:56.124126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7573c-1900-4de5-b0ab-12e7555fd12d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:56.197715 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7573c-1900-4de5-b0ab-12e7555fd12d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:56.199227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7573c-1900-4de5-b0ab-12e7555fd12d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:56.290832 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:56.305282 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 533/1075] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:42:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 12:42:56.306565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7495c90-8da9-4879-bdf9-2d0ff0aeb3c0 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:56.409109 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7495c90-8da9-4879-bdf9-2d0ff0aeb3c0 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:56.437712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:56.443161 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b02aa6-9db5-44fa-a302-7e7493a5c678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:56.443964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b02aa6-9db5-44fa-a302-7e7493a5c678 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:56.444250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b02aa6-9db5-44fa-a302-7e7493a5c678 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:56.444527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b02aa6-9db5-44fa-a302-7e7493a5c678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:56.455849 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b02aa6-9db5-44fa-a302-7e7493a5c678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:56.457394 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b02aa6-9db5-44fa-a302-7e7493a5c678 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:56.475733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-53b02aa6-9db5-44fa-a302-7e7493a5c678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:56.475733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:56.475733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:56.475733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:56.475733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:56.475733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:56.475733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:56.475733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:56.475733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:56.475733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:56.475733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:56.475733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:56.475733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:56.475733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:56.475733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:56.476675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:56.476675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:56.476675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:56.476675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:56.476675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:56.476675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:56.476675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:56.476675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:56.476675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:56.476675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:56.476675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:56.476675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:56.476675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:56.476675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:56.476675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:56.476675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:56.476675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:56.477588 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:56.477588 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:56.477588 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:56.477588 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:56.477588 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 543/1076] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:56.482773 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7573c-1900-4de5-b0ab-12e7555fd12d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:56.533736 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def8b18-73db-44b1-931e-294bb9fa10e1 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:56.534308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def8b18-73db-44b1-931e-294bb9fa10e1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:56.534606 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def8b18-73db-44b1-931e-294bb9fa10e1 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:56.536123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 544/1077] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:42:56.541414 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c08f5f-7b03-4eef-bbbb-89c31f9477c1 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:56.541709 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c08f5f-7b03-4eef-bbbb-89c31f9477c1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:56.541993 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c08f5f-7b03-4eef-bbbb-89c31f9477c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:56.559151 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-c1c08f5f-7b03-4eef-bbbb-89c31f9477c1 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:56.560357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c1c08f5f-7b03-4eef-bbbb-89c31f9477c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:56.589172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7573c-1900-4de5-b0ab-12e7555fd12d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:56.623282 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5aab75-9f8c-45e6-983c-45b1e4f45bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:56.623946 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5aab75-9f8c-45e6-983c-45b1e4f45bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:56.624236 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5aab75-9f8c-45e6-983c-45b1e4f45bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:56.624514 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5aab75-9f8c-45e6-983c-45b1e4f45bb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:56.625274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5aab75-9f8c-45e6-983c-45b1e4f45bb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:56.625584 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5aab75-9f8c-45e6-983c-45b1e4f45bb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:56.627519 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5aab75-9f8c-45e6-983c-45b1e4f45bb7 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:56.632855 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 545/1078] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:42:56.642037 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 534/1079] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:56.659729 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c08f5f-7b03-4eef-bbbb-89c31f9477c1 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:56.770106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c08f5f-7b03-4eef-bbbb-89c31f9477c1 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:56.785657 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:56.809750 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99754766-d4f9-4014-9939-b0c717eb8f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:56.810566 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99754766-d4f9-4014-9939-b0c717eb8f39 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:56.810847 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99754766-d4f9-4014-9939-b0c717eb8f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:56.811122 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99754766-d4f9-4014-9939-b0c717eb8f39 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:56.822243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99754766-d4f9-4014-9939-b0c717eb8f39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:56.831317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-99754766-d4f9-4014-9939-b0c717eb8f39 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:42:56.831317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:56.831317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:56.831317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:56.831317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:56.831317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:56.831317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:56.831317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:56.831317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:56.831317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:56.831317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:56.831317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:56.831317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:56.831317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:56.831317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:56.831317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:56.832273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:56.832273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:56.832273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:56.832273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:56.832273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:56.832273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:56.832273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:56.832273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:56.832273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:56.832273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:56.832273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:56.832273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:56.832273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:56.832273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:56.832273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:56.832273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:56.834190 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:56.834190 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:56.834190 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:56.834190 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:56.834190 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:56.834190 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:56.834190 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:56.834190 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:56.834190 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:56.834190 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:56.834190 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 12:42:56.834190 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:56.834190 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 546/1080] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jul 5 12:42:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:56.838502 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5aab75-9f8c-45e6-983c-45b1e4f45bb7 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:56.895367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:56.943556 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5aab75-9f8c-45e6-983c-45b1e4f45bb7 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:56.976390 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb2e20-94b1-41c8-bdd2-c6fc47061bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:56.977090 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb2e20-94b1-41c8-bdd2-c6fc47061bfd None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:56.977379 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb2e20-94b1-41c8-bdd2-c6fc47061bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:56.977655 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb2e20-94b1-41c8-bdd2-c6fc47061bfd None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:56.978393 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb2e20-94b1-41c8-bdd2-c6fc47061bfd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:56.978695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb2e20-94b1-41c8-bdd2-c6fc47061bfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:56.980069 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb2e20-94b1-41c8-bdd2-c6fc47061bfd None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:56.988997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 535/1081] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jul 5 12:42:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:56.995370 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99754766-d4f9-4014-9939-b0c717eb8f39 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:57.094195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99754766-d4f9-4014-9939-b0c717eb8f39 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:57.129463 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef245c-9e6f-41c9-b5e9-752e11dbe031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:57.130251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef245c-9e6f-41c9-b5e9-752e11dbe031 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:57.130530 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef245c-9e6f-41c9-b5e9-752e11dbe031 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:57.130802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef245c-9e6f-41c9-b5e9-752e11dbe031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:57.141028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef245c-9e6f-41c9-b5e9-752e11dbe031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:57.142515 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef245c-9e6f-41c9-b5e9-752e11dbe031 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:57.158907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-4bef245c-9e6f-41c9-b5e9-752e11dbe031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:57.158907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:57.158907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:57.158907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:57.158907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:57.158907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:57.158907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:57.158907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:57.158907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:57.158907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:57.158907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:57.158907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:57.158907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:57.158907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:57.158907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:57.159968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:57.159968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:57.159968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:57.159968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:57.159968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:57.159968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:57.159968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:57.159968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:57.159968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:57.159968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:57.159968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:57.159968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:57.159968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:57.159968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:57.159968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:57.159968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:57.159968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:57.161064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:57.161064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:57.161064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:57.161064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:57.161064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 547/1082] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:57.165762 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb2e20-94b1-41c8-bdd2-c6fc47061bfd None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:57.263246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb2e20-94b1-41c8-bdd2-c6fc47061bfd None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:57.277108 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:57.297114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312c2fd-977d-425d-9a15-3676c30b7200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:57.297768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312c2fd-977d-425d-9a15-3676c30b7200 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:57.298050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312c2fd-977d-425d-9a15-3676c30b7200 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:57.298920 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312c2fd-977d-425d-9a15-3676c30b7200 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:57.299630 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312c2fd-977d-425d-9a15-3676c30b7200 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:57.299932 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312c2fd-977d-425d-9a15-3676c30b7200 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:57.301327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312c2fd-977d-425d-9a15-3676c30b7200 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:57.312610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 536/1083] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:57.318197 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef245c-9e6f-41c9-b5e9-752e11dbe031 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:57.344904 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:57.415720 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef245c-9e6f-41c9-b5e9-752e11dbe031 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:57.449099 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafd2ab-0081-4a3e-9015-452c0cd9ebcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:57.449890 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafd2ab-0081-4a3e-9015-452c0cd9ebcf None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:57.450173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafd2ab-0081-4a3e-9015-452c0cd9ebcf None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:57.450506 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafd2ab-0081-4a3e-9015-452c0cd9ebcf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:57.457563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafd2ab-0081-4a3e-9015-452c0cd9ebcf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:57.459006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafd2ab-0081-4a3e-9015-452c0cd9ebcf None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:57.473716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-7cafd2ab-0081-4a3e-9015-452c0cd9ebcf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:42:57.473716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:57.473716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:57.473716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:57.473716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:57.473716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:57.473716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:57.473716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:57.473716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:57.473716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:57.473716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:57.473716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:57.473716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:42:57.473716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:42:57.473716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:42:57.473716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:42:57.474911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:57.474911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:57.474911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:42:57.474911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:57.474911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:42:57.474911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:42:57.474911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:57.474911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:57.474911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:57.474911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:57.474911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:57.474911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:57.474911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:57.474911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:57.474911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:57.474911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:57.474911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:57.474911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:57.475846 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:57.475846 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:57.475846 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:42:57.475846 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:42:57.475846 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:42:57.475846 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:42:57.475846 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:42:57.475846 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:42:57.475846 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 12:42:57.475846 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:57.475846 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 548/1084] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jul 5 12:42:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:57.481036 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312c2fd-977d-425d-9a15-3676c30b7200 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:57.577579 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312c2fd-977d-425d-9a15-3676c30b7200 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:57.617346 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4077f-96f6-48a2-8704-925c442702d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:57.618027 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4077f-96f6-48a2-8704-925c442702d1 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:57.618312 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4077f-96f6-48a2-8704-925c442702d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:57.618634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4077f-96f6-48a2-8704-925c442702d1 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:57.619710 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4077f-96f6-48a2-8704-925c442702d1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:57.620017 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4077f-96f6-48a2-8704-925c442702d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:57.621539 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4077f-96f6-48a2-8704-925c442702d1 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:57.647070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 537/1085] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jul 5 12:42:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:42:57.648615 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafd2ab-0081-4a3e-9015-452c0cd9ebcf None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:57.731353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:57.745871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafd2ab-0081-4a3e-9015-452c0cd9ebcf None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:57.779690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c5b85-01ed-43df-80ad-fb9d39c66d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:57.780363 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c5b85-01ed-43df-80ad-fb9d39c66d3b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:57.780649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c5b85-01ed-43df-80ad-fb9d39c66d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:57.780929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c5b85-01ed-43df-80ad-fb9d39c66d3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:57.848690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c5b85-01ed-43df-80ad-fb9d39c66d3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:57.850322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c5b85-01ed-43df-80ad-fb9d39c66d3b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:57.931643 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:57.946939 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 549/1086] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:42:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:42:57.952618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4077f-96f6-48a2-8704-925c442702d1 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:57.984319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:58.028742 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184b42f-7254-4f79-afcc-d572b1fefa39 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:58.029026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184b42f-7254-4f79-afcc-d572b1fefa39 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:58.029308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184b42f-7254-4f79-afcc-d572b1fefa39 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:58.031277 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 550/1087] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:42:58.035478 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c373d-1f27-41d2-8c77-b1424c84f9d0 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:58.035757 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c373d-1f27-41d2-8c77-b1424c84f9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:58.036029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c373d-1f27-41d2-8c77-b1424c84f9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:58.051736 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4077f-96f6-48a2-8704-925c442702d1 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:58.052399 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-557c373d-1f27-41d2-8c77-b1424c84f9d0 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:42:58.053626 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-557c373d-1f27-41d2-8c77-b1424c84f9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:42:58.086694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f48bd3-c8ca-4a12-b4cb-1e60084ec137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:58.087478 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f48bd3-c8ca-4a12-b4cb-1e60084ec137 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:58.087760 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f48bd3-c8ca-4a12-b4cb-1e60084ec137 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:58.088032 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f48bd3-c8ca-4a12-b4cb-1e60084ec137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:58.097775 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f48bd3-c8ca-4a12-b4cb-1e60084ec137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:58.099258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f48bd3-c8ca-4a12-b4cb-1e60084ec137 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:58.116319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-13f48bd3-c8ca-4a12-b4cb-1e60084ec137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:58.116319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:58.116319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:58.116319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:58.116319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:58.116319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:58.116319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:58.116319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:58.116319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:58.116319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:58.116319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:58.116319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:58.116319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:42:58.116319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:42:58.116319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:42:58.117255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:42:58.117255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:58.117255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:58.117255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:58.117255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:58.117255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:58.117255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:58.117255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:58.117255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:58.117255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:58.117255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:58.117255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:58.117255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:58.117255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:58.117255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:58.117255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:58.117255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:58.118156 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:42:58.118156 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:42:58.118156 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:42:58.118156 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:58.118156 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 538/1088] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:42:58.123073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f48bd3-c8ca-4a12-b4cb-1e60084ec137 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:58.123184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 551/1089] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:42:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:42:58.146133 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c373d-1f27-41d2-8c77-b1424c84f9d0 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:58.203733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:58.218702 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f48bd3-c8ca-4a12-b4cb-1e60084ec137 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:58.243404 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c373d-1f27-41d2-8c77-b1424c84f9d0 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:58.253812 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ca73e-4bfc-41a3-b8a0-1064cb0710a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:58.254458 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ca73e-4bfc-41a3-b8a0-1064cb0710a0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:58.254745 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ca73e-4bfc-41a3-b8a0-1064cb0710a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:58.255018 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ca73e-4bfc-41a3-b8a0-1064cb0710a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:58.255733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ca73e-4bfc-41a3-b8a0-1064cb0710a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:58.256160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ca73e-4bfc-41a3-b8a0-1064cb0710a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:58.257442 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ca73e-4bfc-41a3-b8a0-1064cb0710a0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:58.259507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:58.268678 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 539/1090] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:58.274214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ca73e-4bfc-41a3-b8a0-1064cb0710a0 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:58.277157 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16e376-b4ef-4beb-901d-b245539afd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:58.277960 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16e376-b4ef-4beb-901d-b245539afd4b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:58.278250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16e376-b4ef-4beb-901d-b245539afd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:58.278528 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16e376-b4ef-4beb-901d-b245539afd4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:58.289529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16e376-b4ef-4beb-901d-b245539afd4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:42:58.297127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-aa16e376-b4ef-4beb-901d-b245539afd4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:42:58.297127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:58.297127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:58.297127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:58.297127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:58.297127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:58.297127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:58.297127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:58.297127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:58.297127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:58.297127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:58.297127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:58.297127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:42:58.297127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:42:58.297127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:42:58.297127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:42:58.298785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:42:58.298785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:42:58.298785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:42:58.298785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:42:58.298785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:58.298785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:58.298785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:58.298785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:58.298785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:58.298785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:58.298785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:58.298785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:58.298785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:58.298785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:58.298785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:58.298785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:58.299811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:58.299811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:58.299811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:58.299811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:58.299811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:42:58.299811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:42:58.299811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:42:58.299811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:42:58.299811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:42:58.299811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:42:58.299811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:42:58.299811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:42:58.299811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 552/1091] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:42:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:58.304810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16e376-b4ef-4beb-901d-b245539afd4b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:58.378343 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ca73e-4bfc-41a3-b8a0-1064cb0710a0 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:58.401536 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16e376-b4ef-4beb-901d-b245539afd4b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:58.412455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371f915-5ce4-4cd3-9799-f9e39e22c23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:58.413263 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371f915-5ce4-4cd3-9799-f9e39e22c23e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:58.413546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371f915-5ce4-4cd3-9799-f9e39e22c23e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:58.413822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371f915-5ce4-4cd3-9799-f9e39e22c23e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:58.420286 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371f915-5ce4-4cd3-9799-f9e39e22c23e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:58.421744 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371f915-5ce4-4cd3-9799-f9e39e22c23e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:58.434301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfb386-9577-4755-8272-2f213cfbbb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:58.434957 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfb386-9577-4755-8272-2f213cfbbb8b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:58.435237 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfb386-9577-4755-8272-2f213cfbbb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:58.435511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfb386-9577-4755-8272-2f213cfbbb8b None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:58.436038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-2371f915-5ce4-4cd3-9799-f9e39e22c23e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:58.436038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:42:58.436038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:42:58.436038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:42:58.436038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:42:58.436038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:42:58.436038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:42:58.436038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:42:58.436038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:42:58.436038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:42:58.436038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:42:58.436038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:42:58.436038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:42:58.436038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:42:58.436038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:42:58.437021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:42:58.437021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:42:58.437021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:42:58.437021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:42:58.437021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:42:58.437021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:42:58.437021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:42:58.437021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:42:58.437021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:42:58.437021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:42:58.437021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:42:58.437021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:42:58.437021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:42:58.437021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:42:58.437021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:42:58.437021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:42:58.437021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:42:58.438109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:42:58.438109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:42:58.438109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:42:58.438109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:42:58.438109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:42:58.438109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:42:58.438109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:42:58.438109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:42:58.439345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfb386-9577-4755-8272-2f213cfbbb8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:58.439345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfb386-9577-4755-8272-2f213cfbbb8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:58.439489 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 540/1092] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:42:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:42:58.439557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfb386-9577-4755-8272-2f213cfbbb8b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:58.443354 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371f915-5ce4-4cd3-9799-f9e39e22c23e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:58.447362 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 553/1093] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:42:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:58.447833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:58.452237 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfb386-9577-4755-8272-2f213cfbbb8b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:58.491971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:58.542242 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371f915-5ce4-4cd3-9799-f9e39e22c23e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:58.551698 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfb386-9577-4755-8272-2f213cfbbb8b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:58.576970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be707439-610a-45d4-9fe6-df6290aaab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:58.577619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be707439-610a-45d4-9fe6-df6290aaab0c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:58.578161 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be707439-610a-45d4-9fe6-df6290aaab0c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:58.578161 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be707439-610a-45d4-9fe6-df6290aaab0c None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:58.578931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be707439-610a-45d4-9fe6-df6290aaab0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:58.579246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be707439-610a-45d4-9fe6-df6290aaab0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:58.580718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be707439-610a-45d4-9fe6-df6290aaab0c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:58.584621 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b0959-9e43-4d7b-9121-1303a4bfd4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:58.585494 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b0959-9e43-4d7b-9121-1303a4bfd4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:58.585779 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b0959-9e43-4d7b-9121-1303a4bfd4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:58.586055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b0959-9e43-4d7b-9121-1303a4bfd4f7 None admin] PATH_INFO: `/v3/users/8f68a2b1191a4e35bf4d0739259c8ea9` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:58.587255 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b0959-9e43-4d7b-9121-1303a4bfd4f7 None admin] RBAC: Authorizing `identity:get_user(user_id=8f68a2b1191a4e35bf4d0739259c8ea9)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:58.588735 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b0959-9e43-4d7b-9121-1303a4bfd4f7 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:58.590372 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 554/1094] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:42:58 2022] GET /identity/v3/users/8f68a2b1191a4e35bf4d0739259c8ea9 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:58.595187 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 541/1095] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:42:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:58.595990 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b0959-9e43-4d7b-9121-1303a4bfd4f7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:58.597451 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be707439-610a-45d4-9fe6-df6290aaab0c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:58.658237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:58.695058 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be707439-610a-45d4-9fe6-df6290aaab0c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:58.695220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b0959-9e43-4d7b-9121-1303a4bfd4f7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:58.702257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:42:58.728194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a79de4-ac75-4f6e-b4cb-f85d29a02836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:58.728748 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872503d-1c80-41b0-9e68-6279bdb324e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:58.728877 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a79de4-ac75-4f6e-b4cb-f85d29a02836 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:58.729134 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a79de4-ac75-4f6e-b4cb-f85d29a02836 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:58.729408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a79de4-ac75-4f6e-b4cb-f85d29a02836 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:58.729593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872503d-1c80-41b0-9e68-6279bdb324e2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:58.729873 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872503d-1c80-41b0-9e68-6279bdb324e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:58.730200 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872503d-1c80-41b0-9e68-6279bdb324e2 None admin] PATH_INFO: `/v3/projects/3132d27beb4e4f069bd9192b6d646d2a` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:58.730299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a79de4-ac75-4f6e-b4cb-f85d29a02836 None admin] RBAC: Adding query filter params (role.id=0376afc6fefb4532b4c0510d40c6c290, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=cdf37a42279a466b85906b23751f9c22) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:42:58.730523 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a79de4-ac75-4f6e-b4cb-f85d29a02836 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:58.731391 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872503d-1c80-41b0-9e68-6279bdb324e2 None admin] RBAC: Authorizing `identity:get_project(project_id=3132d27beb4e4f069bd9192b6d646d2a)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:58.731980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a79de4-ac75-4f6e-b4cb-f85d29a02836 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:58.732867 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872503d-1c80-41b0-9e68-6279bdb324e2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:58.740189 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 555/1096] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:42:58 2022] GET /identity/v3/projects/3132d27beb4e4f069bd9192b6d646d2a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:58.742088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872503d-1c80-41b0-9e68-6279bdb324e2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:42:58.743747 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 542/1097] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:42:58 2022] GET /identity/v3/role_assignments?user.id=cdf37a42279a466b85906b23751f9c22&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=0376afc6fefb4532b4c0510d40c6c290 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:42:58.847888 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872503d-1c80-41b0-9e68-6279bdb324e2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:42:58.883804 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193eff7-2542-466d-b592-fa91d053a8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:42:58.884737 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193eff7-2542-466d-b592-fa91d053a8bd None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:42:58.885027 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193eff7-2542-466d-b592-fa91d053a8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:42:58.885308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193eff7-2542-466d-b592-fa91d053a8bd None admin] PATH_INFO: `/v3/projects/3132d27beb4e4f069bd9192b6d646d2a/users/8f68a2b1191a4e35bf4d0739259c8ea9/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:42:58.887296 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193eff7-2542-466d-b592-fa91d053a8bd None admin] RBAC: Authorizing `identity:create_grant(project_id=3132d27beb4e4f069bd9192b6d646d2a, user_id=8f68a2b1191a4e35bf4d0739259c8ea9, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:42:58.888790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193eff7-2542-466d-b592-fa91d053a8bd None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:42:58.973920 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 556/1098] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:42:58 2022] PUT /identity/v3/projects/3132d27beb4e4f069bd9192b6d646d2a/users/8f68a2b1191a4e35bf4d0739259c8ea9/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 12:43:00.962894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb9c8d-3175-4205-b8b7-2be54c890da3 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:00.963430 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb9c8d-3175-4205-b8b7-2be54c890da3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:00.963520 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb9c8d-3175-4205-b8b7-2be54c890da3 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:00.964867 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 543/1099] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:43:00.970105 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44480e41-8693-487c-9d67-6b2bcb4662a2 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:00.970547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44480e41-8693-487c-9d67-6b2bcb4662a2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:00.970642 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44480e41-8693-487c-9d67-6b2bcb4662a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:00.989385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-44480e41-8693-487c-9d67-6b2bcb4662a2 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:43:00.991102 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-44480e41-8693-487c-9d67-6b2bcb4662a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:43:01.017017 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:01.056962 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 557/1100] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:43:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:43:01.080717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb9c8d-3175-4205-b8b7-2be54c890da3 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:01.185846 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb9c8d-3175-4205-b8b7-2be54c890da3 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:01.211579 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:01.223346 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762dd7b-bf11-4207-af31-9fe5e2831550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:01.223346 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762dd7b-bf11-4207-af31-9fe5e2831550 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:01.223346 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762dd7b-bf11-4207-af31-9fe5e2831550 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:01.223346 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762dd7b-bf11-4207-af31-9fe5e2831550 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:01.233479 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762dd7b-bf11-4207-af31-9fe5e2831550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:43:01.242140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-0762dd7b-bf11-4207-af31-9fe5e2831550 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:43:01.242140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:43:01.242140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:43:01.242140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:43:01.242140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:43:01.242140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:43:01.242140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:43:01.242140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:43:01.242140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:43:01.242140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:43:01.242140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:43:01.242140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:43:01.242140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:43:01.242140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:43:01.242140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:43:01.242140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:43:01.243293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:43:01.243293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:43:01.243293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:43:01.243293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:43:01.243293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:43:01.243293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:43:01.243293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:43:01.243293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:43:01.243293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:43:01.243293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:43:01.243293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:43:01.243293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:43:01.243293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:43:01.243293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:43:01.243293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:43:01.243293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:43:01.244314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:43:01.244314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:43:01.244314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:43:01.244314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:43:01.244314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:43:01.244314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:43:01.244314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:43:01.244314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:43:01.244314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:43:01.244314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:43:01.244314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:43:01.244314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:43:01.244314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 544/1101] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:43:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:43:01.251387 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44480e41-8693-487c-9d67-6b2bcb4662a2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:01.364541 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44480e41-8693-487c-9d67-6b2bcb4662a2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:01.400873 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2fd38-cc41-4906-aae6-51c88c65d867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:01.402011 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2fd38-cc41-4906-aae6-51c88c65d867 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:01.402516 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2fd38-cc41-4906-aae6-51c88c65d867 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:01.402988 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2fd38-cc41-4906-aae6-51c88c65d867 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:01.404116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2fd38-cc41-4906-aae6-51c88c65d867 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:43:01.404433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2fd38-cc41-4906-aae6-51c88c65d867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:01.406433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2fd38-cc41-4906-aae6-51c88c65d867 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:01.415867 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 558/1102] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:43:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:01.421700 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762dd7b-bf11-4207-af31-9fe5e2831550 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:01.525348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762dd7b-bf11-4207-af31-9fe5e2831550 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:01.564503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4da0b0-4d81-4234-8f01-f5f565ac78af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:01.565394 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4da0b0-4d81-4234-8f01-f5f565ac78af None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:01.565679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4da0b0-4d81-4234-8f01-f5f565ac78af None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:01.565957 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4da0b0-4d81-4234-8f01-f5f565ac78af None admin] PATH_INFO: `/v3/users/8f68a2b1191a4e35bf4d0739259c8ea9` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:01.567137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4da0b0-4d81-4234-8f01-f5f565ac78af None admin] RBAC: Authorizing `identity:get_user(user_id=8f68a2b1191a4e35bf4d0739259c8ea9)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:01.568571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4da0b0-4d81-4234-8f01-f5f565ac78af None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:01.570231 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 545/1103] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:43:01 2022] GET /identity/v3/users/8f68a2b1191a4e35bf4d0739259c8ea9 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:01.576166 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2fd38-cc41-4906-aae6-51c88c65d867 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:01.604963 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:01.677696 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2fd38-cc41-4906-aae6-51c88c65d867 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:01.711259 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f702e66-628e-4c6b-8dfd-2877a5b0c704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:01.711919 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f702e66-628e-4c6b-8dfd-2877a5b0c704 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:01.712208 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f702e66-628e-4c6b-8dfd-2877a5b0c704 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:01.712488 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f702e66-628e-4c6b-8dfd-2877a5b0c704 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:01.783202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f702e66-628e-4c6b-8dfd-2877a5b0c704 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:01.784697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f702e66-628e-4c6b-8dfd-2877a5b0c704 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:01.810590 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:01.881845 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 559/1104] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:43:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:43:01.887841 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4da0b0-4d81-4234-8f01-f5f565ac78af None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:01.942592 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:01.984258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4da0b0-4d81-4234-8f01-f5f565ac78af None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:02.016570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247f7ec-746b-4c3d-aceb-017a90c621d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:02.018026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247f7ec-746b-4c3d-aceb-017a90c621d7 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:02.018302 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247f7ec-746b-4c3d-aceb-017a90c621d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:02.018573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247f7ec-746b-4c3d-aceb-017a90c621d7 None admin] PATH_INFO: `/v3/projects/3132d27beb4e4f069bd9192b6d646d2a` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:02.019724 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247f7ec-746b-4c3d-aceb-017a90c621d7 None admin] RBAC: Authorizing `identity:get_project(project_id=3132d27beb4e4f069bd9192b6d646d2a)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:02.021178 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247f7ec-746b-4c3d-aceb-017a90c621d7 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:02.022826 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 546/1105] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:43:01 2022] GET /identity/v3/projects/3132d27beb4e4f069bd9192b6d646d2a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:02.028784 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f702e66-628e-4c6b-8dfd-2877a5b0c704 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:02.124934 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f702e66-628e-4c6b-8dfd-2877a5b0c704 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:02.150023 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:02.158554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d7123-c1df-4403-912e-8aa05bfdff7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:02.159207 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d7123-c1df-4403-912e-8aa05bfdff7a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:02.159499 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d7123-c1df-4403-912e-8aa05bfdff7a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:02.159780 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d7123-c1df-4403-912e-8aa05bfdff7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:02.166286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d7123-c1df-4403-912e-8aa05bfdff7a None admin] RBAC: Adding query filter params (role.id=868c7a356c674ded875dd079f5a9f5e0, scope.project.id=3132d27beb4e4f069bd9192b6d646d2a, user.id=8f68a2b1191a4e35bf4d0739259c8ea9) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:43:02.166286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d7123-c1df-4403-912e-8aa05bfdff7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:02.166286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d7123-c1df-4403-912e-8aa05bfdff7a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:02.167976 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 560/1106] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:43:02 2022] GET /identity/v3/role_assignments?user.id=8f68a2b1191a4e35bf4d0739259c8ea9&scope.project.id=3132d27beb4e4f069bd9192b6d646d2a&role.id=868c7a356c674ded875dd079f5a9f5e0 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:04.196266 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14d6d4-3817-4325-ba20-90e5e2872021 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:04.196858 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14d6d4-3817-4325-ba20-90e5e2872021 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:04.196858 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14d6d4-3817-4325-ba20-90e5e2872021 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:04.198206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 547/1107] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:43:04.203248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629855c-dcb0-496d-93a1-ba4b402d0776 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:04.203637 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629855c-dcb0-496d-93a1-ba4b402d0776 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:04.203810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629855c-dcb0-496d-93a1-ba4b402d0776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:04.220650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-8629855c-dcb0-496d-93a1-ba4b402d0776 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:43:04.221841 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8629855c-dcb0-496d-93a1-ba4b402d0776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:43:04.285867 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 561/1108] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:43:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:43:04.310455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14d6d4-3817-4325-ba20-90e5e2872021 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:04.407717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14d6d4-3817-4325-ba20-90e5e2872021 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:04.429604 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:04.439650 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972826a-85ec-44e6-82f7-c714ccab28bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:04.444223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972826a-85ec-44e6-82f7-c714ccab28bf None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:04.444223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972826a-85ec-44e6-82f7-c714ccab28bf None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:04.444223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972826a-85ec-44e6-82f7-c714ccab28bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:04.444223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972826a-85ec-44e6-82f7-c714ccab28bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:04.444223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972826a-85ec-44e6-82f7-c714ccab28bf None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:04.445160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 548/1109] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:43:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:04.450765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629855c-dcb0-496d-93a1-ba4b402d0776 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:04.547059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629855c-dcb0-496d-93a1-ba4b402d0776 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:04.566260 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:04.580211 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943118b-aeac-4460-b0d8-ecabd4092821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:04.581615 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943118b-aeac-4460-b0d8-ecabd4092821 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:04.581615 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943118b-aeac-4460-b0d8-ecabd4092821 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:04.581615 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943118b-aeac-4460-b0d8-ecabd4092821 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:04.582219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943118b-aeac-4460-b0d8-ecabd4092821 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:04.583653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943118b-aeac-4460-b0d8-ecabd4092821 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:04.737512 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 562/1110] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jul 5 12:43:04 2022] POST /identity/v3/users => generated 286 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:43:06.779022 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c4d3c-45ab-4d27-9022-cd51a268f620 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:06.779597 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c4d3c-45ab-4d27-9022-cd51a268f620 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:06.779597 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c4d3c-45ab-4d27-9022-cd51a268f620 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:06.780963 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 549/1111] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:43:06.786160 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac5087-315d-49dc-b964-aabbad77fce1 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:06.786565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac5087-315d-49dc-b964-aabbad77fce1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:06.786740 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac5087-315d-49dc-b964-aabbad77fce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:06.803770 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-20ac5087-315d-49dc-b964-aabbad77fce1 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:43:06.805013 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-20ac5087-315d-49dc-b964-aabbad77fce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:43:06.874066 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 563/1112] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:43:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:43:06.898187 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c4d3c-45ab-4d27-9022-cd51a268f620 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:06.996687 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c4d3c-45ab-4d27-9022-cd51a268f620 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:07.029495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a6a4f-8074-475c-ac75-0fe31d128f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:07.030266 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a6a4f-8074-475c-ac75-0fe31d128f6c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:07.030548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a6a4f-8074-475c-ac75-0fe31d128f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:07.030823 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a6a4f-8074-475c-ac75-0fe31d128f6c None admin] PATH_INFO: `/v3/roles/5ea7d4a868fb49b8992c3adb30476789` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:07.032817 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a6a4f-8074-475c-ac75-0fe31d128f6c None admin] RBAC: Authorizing `identity:get_role(role_id=5ea7d4a868fb49b8992c3adb30476789)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:07.034176 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a6a4f-8074-475c-ac75-0fe31d128f6c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:07.035511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 550/1113] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:43:06 2022] GET /identity/v3/roles/5ea7d4a868fb49b8992c3adb30476789 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:07.041212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac5087-315d-49dc-b964-aabbad77fce1 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:07.136303 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac5087-315d-49dc-b964-aabbad77fce1 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:07.143392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:07.169455 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc0750-96d6-420f-af8d-ede1d62759d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:07.170361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc0750-96d6-420f-af8d-ede1d62759d7 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:07.170645 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc0750-96d6-420f-af8d-ede1d62759d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:07.170925 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc0750-96d6-420f-af8d-ede1d62759d7 None admin] PATH_INFO: `/v3/users/18cd45ed0fe24ee5a245aa02415f09ad` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:07.186045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc0750-96d6-420f-af8d-ede1d62759d7 None admin] RBAC: Authorizing `identity:get_user(user_id=18cd45ed0fe24ee5a245aa02415f09ad)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:07.187588 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc0750-96d6-420f-af8d-ede1d62759d7 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:07.189745 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 564/1114] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:43:07 2022] GET /identity/v3/users/18cd45ed0fe24ee5a245aa02415f09ad => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:07.195259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a6a4f-8074-475c-ac75-0fe31d128f6c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:07.253001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:07.291868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a6a4f-8074-475c-ac75-0fe31d128f6c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:07.324352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96531d-99b1-4ab9-8795-4b7ceb6a38f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:07.325005 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96531d-99b1-4ab9-8795-4b7ceb6a38f7 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:07.325288 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96531d-99b1-4ab9-8795-4b7ceb6a38f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:07.325560 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96531d-99b1-4ab9-8795-4b7ceb6a38f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:07.389947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96531d-99b1-4ab9-8795-4b7ceb6a38f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:07.391908 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96531d-99b1-4ab9-8795-4b7ceb6a38f7 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:07.446088 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:07.486612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 551/1115] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:43:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:43:07.492399 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc0750-96d6-420f-af8d-ede1d62759d7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:07.588433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc0750-96d6-420f-af8d-ede1d62759d7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:07.621663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0febd-7c65-45b7-a53d-0a3acb9627e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:07.622506 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0febd-7c65-45b7-a53d-0a3acb9627e9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:07.622790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0febd-7c65-45b7-a53d-0a3acb9627e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:07.623066 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0febd-7c65-45b7-a53d-0a3acb9627e9 None admin] PATH_INFO: `/v3/projects/3132d27beb4e4f069bd9192b6d646d2a` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:07.624230 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0febd-7c65-45b7-a53d-0a3acb9627e9 None admin] RBAC: Authorizing `identity:get_project(project_id=3132d27beb4e4f069bd9192b6d646d2a)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:07.625715 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0febd-7c65-45b7-a53d-0a3acb9627e9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:07.627369 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 565/1116] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:43:07 2022] GET /identity/v3/projects/3132d27beb4e4f069bd9192b6d646d2a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:07.633208 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96531d-99b1-4ab9-8795-4b7ceb6a38f7 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:07.739687 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96531d-99b1-4ab9-8795-4b7ceb6a38f7 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:07.772719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743243ad-fbae-4439-9f24-ae26adb76c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:07.773356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743243ad-fbae-4439-9f24-ae26adb76c5d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:07.773637 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743243ad-fbae-4439-9f24-ae26adb76c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:07.773910 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743243ad-fbae-4439-9f24-ae26adb76c5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:07.774716 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743243ad-fbae-4439-9f24-ae26adb76c5d None admin] RBAC: Adding query filter params (role.id=5ea7d4a868fb49b8992c3adb30476789, scope.project.id=3132d27beb4e4f069bd9192b6d646d2a, user.id=18cd45ed0fe24ee5a245aa02415f09ad) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:43:07.775020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743243ad-fbae-4439-9f24-ae26adb76c5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:07.776427 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743243ad-fbae-4439-9f24-ae26adb76c5d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:07.781669 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 552/1117] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:43:07 2022] GET /identity/v3/role_assignments?user.id=18cd45ed0fe24ee5a245aa02415f09ad&scope.project.id=3132d27beb4e4f069bd9192b6d646d2a&role.id=5ea7d4a868fb49b8992c3adb30476789 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:09.761677 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4142bc-cace-4f21-8a6c-ad06c4b14c57 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:09.762216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4142bc-cace-4f21-8a6c-ad06c4b14c57 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:09.762308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4142bc-cace-4f21-8a6c-ad06c4b14c57 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:09.763638 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 566/1118] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:43:09.769062 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6fcb0-8693-4a75-a486-fa851e2c0d6e None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:09.769490 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6fcb0-8693-4a75-a486-fa851e2c0d6e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:09.769624 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6fcb0-8693-4a75-a486-fa851e2c0d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:09.785991 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e2e6fcb0-8693-4a75-a486-fa851e2c0d6e None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:43:09.787169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e2e6fcb0-8693-4a75-a486-fa851e2c0d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:43:09.804382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:09.851859 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 553/1119] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:43:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:43:09.874357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4142bc-cace-4f21-8a6c-ad06c4b14c57 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:09.904910 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:09.972604 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4142bc-cace-4f21-8a6c-ad06c4b14c57 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:10.005826 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeacbc6-a9da-481f-ab51-b5bbee745892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:10.006661 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeacbc6-a9da-481f-ab51-b5bbee745892 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:10.006941 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeacbc6-a9da-481f-ab51-b5bbee745892 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:10.007212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeacbc6-a9da-481f-ab51-b5bbee745892 None admin] PATH_INFO: `/v3/roles/5ea7d4a868fb49b8992c3adb30476789` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:10.008697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeacbc6-a9da-481f-ab51-b5bbee745892 None admin] RBAC: Authorizing `identity:get_role(role_id=5ea7d4a868fb49b8992c3adb30476789)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:10.010068 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeacbc6-a9da-481f-ab51-b5bbee745892 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:10.011404 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 567/1120] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:43:09 2022] GET /identity/v3/roles/5ea7d4a868fb49b8992c3adb30476789 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:10.017310 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6fcb0-8693-4a75-a486-fa851e2c0d6e None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:10.113197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6fcb0-8693-4a75-a486-fa851e2c0d6e None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:10.145380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617676e-41c6-4de5-9291-215fcf1b4f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:10.146229 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617676e-41c6-4de5-9291-215fcf1b4f50 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:10.146513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617676e-41c6-4de5-9291-215fcf1b4f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:10.146789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617676e-41c6-4de5-9291-215fcf1b4f50 None admin] PATH_INFO: `/v3/users/18cd45ed0fe24ee5a245aa02415f09ad` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:10.147961 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617676e-41c6-4de5-9291-215fcf1b4f50 None admin] RBAC: Authorizing `identity:get_user(user_id=18cd45ed0fe24ee5a245aa02415f09ad)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:10.149411 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617676e-41c6-4de5-9291-215fcf1b4f50 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:10.151017 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 554/1121] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:43:10 2022] GET /identity/v3/users/18cd45ed0fe24ee5a245aa02415f09ad => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:43:10.157327 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeacbc6-a9da-481f-ab51-b5bbee745892 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:10.251088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:10.253955 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeacbc6-a9da-481f-ab51-b5bbee745892 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:10.286847 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84268d-5387-4fa5-82bc-a6511fbdeae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:10.287686 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84268d-5387-4fa5-82bc-a6511fbdeae9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:10.287966 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84268d-5387-4fa5-82bc-a6511fbdeae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:10.288240 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84268d-5387-4fa5-82bc-a6511fbdeae9 None admin] PATH_INFO: `/v3/projects/3132d27beb4e4f069bd9192b6d646d2a` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:10.289439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84268d-5387-4fa5-82bc-a6511fbdeae9 None admin] RBAC: Authorizing `identity:get_project(project_id=3132d27beb4e4f069bd9192b6d646d2a)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:10.290871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84268d-5387-4fa5-82bc-a6511fbdeae9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:10.292525 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 568/1122] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:43:10 2022] GET /identity/v3/projects/3132d27beb4e4f069bd9192b6d646d2a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:10.298914 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617676e-41c6-4de5-9291-215fcf1b4f50 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:10.322380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:10.395240 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617676e-41c6-4de5-9291-215fcf1b4f50 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:10.427718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452f919-294a-401c-a489-5cc2726a9eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:10.428603 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452f919-294a-401c-a489-5cc2726a9eba None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:10.428893 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452f919-294a-401c-a489-5cc2726a9eba None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:10.429172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452f919-294a-401c-a489-5cc2726a9eba None admin] PATH_INFO: `/v3/projects/3132d27beb4e4f069bd9192b6d646d2a/users/18cd45ed0fe24ee5a245aa02415f09ad/roles/5ea7d4a868fb49b8992c3adb30476789` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:10.431352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452f919-294a-401c-a489-5cc2726a9eba None admin] RBAC: Authorizing `identity:create_grant(project_id=3132d27beb4e4f069bd9192b6d646d2a, user_id=18cd45ed0fe24ee5a245aa02415f09ad, role_id=5ea7d4a868fb49b8992c3adb30476789)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:10.432797 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452f919-294a-401c-a489-5cc2726a9eba None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:10.491337 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 555/1123] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:43:10 2022] PUT /identity/v3/projects/3132d27beb4e4f069bd9192b6d646d2a/users/18cd45ed0fe24ee5a245aa02415f09ad/roles/5ea7d4a868fb49b8992c3adb30476789 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:43:12.470046 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a77403-ddc4-41a1-9d59-80b4bf31fde6 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:12.470585 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a77403-ddc4-41a1-9d59-80b4bf31fde6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:12.470585 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a77403-ddc4-41a1-9d59-80b4bf31fde6 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:12.471879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 569/1124] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:43:12.477171 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dc26f-02ec-4d0d-912c-28d9fe46dd59 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:12.477589 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dc26f-02ec-4d0d-912c-28d9fe46dd59 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:12.477739 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dc26f-02ec-4d0d-912c-28d9fe46dd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:12.494705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-215dc26f-02ec-4d0d-912c-28d9fe46dd59 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:43:12.495895 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-215dc26f-02ec-4d0d-912c-28d9fe46dd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:43:12.562854 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 556/1125] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:43:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:43:12.586227 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a77403-ddc4-41a1-9d59-80b4bf31fde6 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:12.685202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a77403-ddc4-41a1-9d59-80b4bf31fde6 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:12.717632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c36b86-ef30-4de3-9170-ff07ef70f6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:12.718474 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c36b86-ef30-4de3-9170-ff07ef70f6ee None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:12.718755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c36b86-ef30-4de3-9170-ff07ef70f6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:12.719030 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c36b86-ef30-4de3-9170-ff07ef70f6ee None admin] PATH_INFO: `/v3/roles/5ea7d4a868fb49b8992c3adb30476789` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:12.721112 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c36b86-ef30-4de3-9170-ff07ef70f6ee None admin] RBAC: Authorizing `identity:get_role(role_id=5ea7d4a868fb49b8992c3adb30476789)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:12.722452 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c36b86-ef30-4de3-9170-ff07ef70f6ee None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:12.723801 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 570/1126] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:43:12 2022] GET /identity/v3/roles/5ea7d4a868fb49b8992c3adb30476789 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:12.729802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215dc26f-02ec-4d0d-912c-28d9fe46dd59 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:12.743594 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:12.825654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215dc26f-02ec-4d0d-912c-28d9fe46dd59 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:12.859046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73061cd8-df94-4e6b-857e-011fe9f29306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:12.859926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73061cd8-df94-4e6b-857e-011fe9f29306 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:12.860210 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73061cd8-df94-4e6b-857e-011fe9f29306 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:12.860486 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73061cd8-df94-4e6b-857e-011fe9f29306 None admin] PATH_INFO: `/v3/users/18cd45ed0fe24ee5a245aa02415f09ad` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:12.861682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73061cd8-df94-4e6b-857e-011fe9f29306 None admin] RBAC: Authorizing `identity:get_user(user_id=18cd45ed0fe24ee5a245aa02415f09ad)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:12.863112 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73061cd8-df94-4e6b-857e-011fe9f29306 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:12.864735 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 557/1127] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:43:12 2022] GET /identity/v3/users/18cd45ed0fe24ee5a245aa02415f09ad => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:12.870435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c36b86-ef30-4de3-9170-ff07ef70f6ee None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:12.904368 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:12.968717 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c36b86-ef30-4de3-9170-ff07ef70f6ee None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:13.002232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaaf857-a2a1-479c-b7a5-0806ae5d096d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:13.002803 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaf857-a2a1-479c-b7a5-0806ae5d096d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:13.003086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaf857-a2a1-479c-b7a5-0806ae5d096d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:13.003362 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaf857-a2a1-479c-b7a5-0806ae5d096d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:13.067769 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaaf857-a2a1-479c-b7a5-0806ae5d096d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:13.069266 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaaf857-a2a1-479c-b7a5-0806ae5d096d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:13.102584 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:13.165309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 571/1128] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:43:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:43:13.171135 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73061cd8-df94-4e6b-857e-011fe9f29306 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:13.249282 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:13.268534 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73061cd8-df94-4e6b-857e-011fe9f29306 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:13.300321 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d3f97-d755-4b7d-9de5-bedadda789a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:13.301190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d3f97-d755-4b7d-9de5-bedadda789a6 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:13.301471 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d3f97-d755-4b7d-9de5-bedadda789a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:13.301740 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d3f97-d755-4b7d-9de5-bedadda789a6 None admin] PATH_INFO: `/v3/projects/3132d27beb4e4f069bd9192b6d646d2a` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:13.302893 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d3f97-d755-4b7d-9de5-bedadda789a6 None admin] RBAC: Authorizing `identity:get_project(project_id=3132d27beb4e4f069bd9192b6d646d2a)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:13.304310 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d3f97-d755-4b7d-9de5-bedadda789a6 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:13.305999 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 558/1129] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:43:13 2022] GET /identity/v3/projects/3132d27beb4e4f069bd9192b6d646d2a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:13.311989 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaaf857-a2a1-479c-b7a5-0806ae5d096d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:13.408407 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaaf857-a2a1-479c-b7a5-0806ae5d096d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:13.440808 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a308af6-826c-460c-beae-61c010278fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:13.441441 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a308af6-826c-460c-beae-61c010278fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:13.441719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a308af6-826c-460c-beae-61c010278fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:13.441992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a308af6-826c-460c-beae-61c010278fe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:13.442809 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a308af6-826c-460c-beae-61c010278fe3 None admin] RBAC: Adding query filter params (role.id=5ea7d4a868fb49b8992c3adb30476789, scope.project.id=3132d27beb4e4f069bd9192b6d646d2a, user.id=18cd45ed0fe24ee5a245aa02415f09ad) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:43:13.443117 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a308af6-826c-460c-beae-61c010278fe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:13.444545 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a308af6-826c-460c-beae-61c010278fe3 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:13.447286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:13.450386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 572/1130] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:43:13 2022] GET /identity/v3/role_assignments?user.id=18cd45ed0fe24ee5a245aa02415f09ad&scope.project.id=3132d27beb4e4f069bd9192b6d646d2a&role.id=5ea7d4a868fb49b8992c3adb30476789 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:15.460445 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb33718-528c-4cec-9b08-9d584f83bb75 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:15.460990 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb33718-528c-4cec-9b08-9d584f83bb75 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:15.460990 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb33718-528c-4cec-9b08-9d584f83bb75 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:15.462314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 559/1131] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:43:15.467434 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8d263-5115-4a50-a7db-3ae75d3f8217 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:15.467804 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8d263-5115-4a50-a7db-3ae75d3f8217 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:15.467994 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8d263-5115-4a50-a7db-3ae75d3f8217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:15.485627 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-68e8d263-5115-4a50-a7db-3ae75d3f8217 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:43:15.486807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-68e8d263-5115-4a50-a7db-3ae75d3f8217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:43:15.551134 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 573/1132] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:43:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:43:15.574286 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb33718-528c-4cec-9b08-9d584f83bb75 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:15.681199 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb33718-528c-4cec-9b08-9d584f83bb75 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:15.715172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86044371-76d8-4d31-bfa4-b52ab7dc3224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:15.715890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86044371-76d8-4d31-bfa4-b52ab7dc3224 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:15.716175 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86044371-76d8-4d31-bfa4-b52ab7dc3224 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:15.716452 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86044371-76d8-4d31-bfa4-b52ab7dc3224 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:15.717643 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86044371-76d8-4d31-bfa4-b52ab7dc3224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:15.719714 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86044371-76d8-4d31-bfa4-b52ab7dc3224 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:15.721365 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 560/1133] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:43:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:15.727545 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8d263-5115-4a50-a7db-3ae75d3f8217 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:15.821670 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8d263-5115-4a50-a7db-3ae75d3f8217 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:15.849725 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:15.855236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4847f8-5a82-4629-9e53-2d289c7cb09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:15.855883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4847f8-5a82-4629-9e53-2d289c7cb09c None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:15.856161 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4847f8-5a82-4629-9e53-2d289c7cb09c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:15.856433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4847f8-5a82-4629-9e53-2d289c7cb09c None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:15.857171 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4847f8-5a82-4629-9e53-2d289c7cb09c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:15.862755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4847f8-5a82-4629-9e53-2d289c7cb09c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:15.961792 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 574/1134] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jul 5 12:43:15 2022] POST /identity/v3/projects => generated 311 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:43:17.985767 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567ef3a-0544-468e-9698-c0c6afd23547 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:17.986302 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567ef3a-0544-468e-9698-c0c6afd23547 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:17.986302 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567ef3a-0544-468e-9698-c0c6afd23547 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:17.987668 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 561/1135] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:43:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:43:17.992760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c055f5-4956-4b1b-a97f-0c271fb3c540 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:17.993142 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c055f5-4956-4b1b-a97f-0c271fb3c540 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:17.993313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c055f5-4956-4b1b-a97f-0c271fb3c540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:18.010351 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-54c055f5-4956-4b1b-a97f-0c271fb3c540 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:43:18.011526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-54c055f5-4956-4b1b-a97f-0c271fb3c540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:43:18.075774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 575/1136] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:43:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:43:18.100466 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567ef3a-0544-468e-9698-c0c6afd23547 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:18.119129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:18.199309 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567ef3a-0544-468e-9698-c0c6afd23547 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:18.231240 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757232b-7e8d-4e34-a571-253174916ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:18.232008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757232b-7e8d-4e34-a571-253174916ecf None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:18.232287 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757232b-7e8d-4e34-a571-253174916ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:18.232560 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757232b-7e8d-4e34-a571-253174916ecf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:18.233737 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757232b-7e8d-4e34-a571-253174916ecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:18.235674 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757232b-7e8d-4e34-a571-253174916ecf None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:18.237332 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 562/1137] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:43:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:18.242942 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c055f5-4956-4b1b-a97f-0c271fb3c540 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:18.337304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c055f5-4956-4b1b-a97f-0c271fb3c540 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:18.350435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:18.370688 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42605984-c370-4d5e-b272-dea5d600ab7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:18.371385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42605984-c370-4d5e-b272-dea5d600ab7b None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:18.371665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42605984-c370-4d5e-b272-dea5d600ab7b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:18.371937 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42605984-c370-4d5e-b272-dea5d600ab7b None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:18.372661 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42605984-c370-4d5e-b272-dea5d600ab7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:18.374199 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42605984-c370-4d5e-b272-dea5d600ab7b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:18.491750 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 576/1138] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jul 5 12:43:18 2022] POST /identity/v3/users => generated 286 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:43:20.525561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f3b75-b697-440e-85e6-9305e9bb3dc3 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:20.526099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f3b75-b697-440e-85e6-9305e9bb3dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:20.526099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f3b75-b697-440e-85e6-9305e9bb3dc3 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:20.527450 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 563/1139] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:43:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:43:20.534009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3067cc4-48b0-4188-a18a-c5f870ac7f44 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:20.534417 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3067cc4-48b0-4188-a18a-c5f870ac7f44 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:20.534587 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3067cc4-48b0-4188-a18a-c5f870ac7f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:20.554115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-d3067cc4-48b0-4188-a18a-c5f870ac7f44 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:43:20.555307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d3067cc4-48b0-4188-a18a-c5f870ac7f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:43:20.619449 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 577/1140] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:43:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:43:20.644072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f3b75-b697-440e-85e6-9305e9bb3dc3 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:20.726211 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:20.741894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f3b75-b697-440e-85e6-9305e9bb3dc3 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:20.774365 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdc8cc-0d12-4c31-94b8-2b2062961f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:20.775138 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdc8cc-0d12-4c31-94b8-2b2062961f13 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:20.775422 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdc8cc-0d12-4c31-94b8-2b2062961f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:20.775747 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdc8cc-0d12-4c31-94b8-2b2062961f13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:20.786037 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdc8cc-0d12-4c31-94b8-2b2062961f13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:43:20.793580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-32cdc8cc-0d12-4c31-94b8-2b2062961f13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:43:20.793580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:43:20.793580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:43:20.793580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:43:20.793580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:43:20.793580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:43:20.793580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:43:20.793580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:43:20.793580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:43:20.793580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:43:20.793580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:43:20.793580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:43:20.793580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:43:20.793580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:43:20.793580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:43:20.793580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:43:20.794800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:43:20.794800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:43:20.794800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:43:20.794800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:43:20.794800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:43:20.794800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:43:20.794800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:43:20.794800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:43:20.794800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:43:20.794800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:43:20.794800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:43:20.794800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:43:20.794800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:43:20.794800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:43:20.794800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:43:20.794800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:43:20.795855 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:43:20.795855 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:43:20.795855 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:43:20.795855 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:43:20.795855 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:43:20.795855 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:43:20.795855 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:43:20.795855 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:43:20.795855 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:43:20.795855 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:43:20.795855 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:43:20.795855 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:43:20.795855 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 564/1141] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:43:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:43:20.800607 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3067cc4-48b0-4188-a18a-c5f870ac7f44 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:20.893743 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:20.897412 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3067cc4-48b0-4188-a18a-c5f870ac7f44 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:20.930667 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9c769-b674-48cb-b2b4-9bf2a454230a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:20.931324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9c769-b674-48cb-b2b4-9bf2a454230a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:20.931611 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9c769-b674-48cb-b2b4-9bf2a454230a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:20.931886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9c769-b674-48cb-b2b4-9bf2a454230a None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:20.932642 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9c769-b674-48cb-b2b4-9bf2a454230a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:43:20.932953 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9c769-b674-48cb-b2b4-9bf2a454230a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:20.934319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9c769-b674-48cb-b2b4-9bf2a454230a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:20.942632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 578/1142] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:43:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:20.948429 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdc8cc-0d12-4c31-94b8-2b2062961f13 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:21.044745 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdc8cc-0d12-4c31-94b8-2b2062961f13 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:21.078473 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b7001-deac-447f-b4e8-863df83043c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:21.079344 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b7001-deac-447f-b4e8-863df83043c9 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:21.079625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b7001-deac-447f-b4e8-863df83043c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:21.079954 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b7001-deac-447f-b4e8-863df83043c9 None admin] PATH_INFO: `/v3/users/46099bc35be7412e89b4fde411d3c2a8` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:21.092702 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b7001-deac-447f-b4e8-863df83043c9 None admin] RBAC: Authorizing `identity:get_user(user_id=46099bc35be7412e89b4fde411d3c2a8)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:21.094132 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b7001-deac-447f-b4e8-863df83043c9 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:21.095753 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 565/1143] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:43:20 2022] GET /identity/v3/users/46099bc35be7412e89b4fde411d3c2a8 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:21.101681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9c769-b674-48cb-b2b4-9bf2a454230a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:21.197362 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9c769-b674-48cb-b2b4-9bf2a454230a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:21.229024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac40f0-0b91-459a-999c-1d3cdba6b297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:21.229657 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac40f0-0b91-459a-999c-1d3cdba6b297 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:21.229937 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac40f0-0b91-459a-999c-1d3cdba6b297 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:21.230212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac40f0-0b91-459a-999c-1d3cdba6b297 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:21.257014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:21.294836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac40f0-0b91-459a-999c-1d3cdba6b297 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:21.296208 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac40f0-0b91-459a-999c-1d3cdba6b297 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:21.389454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 579/1144] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:43:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:43:21.395248 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b7001-deac-447f-b4e8-863df83043c9 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:21.398102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:21.491952 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b7001-deac-447f-b4e8-863df83043c9 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:21.524249 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f835f5a-3ed2-48c8-a1ba-07d1cda63992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:21.525104 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f835f5a-3ed2-48c8-a1ba-07d1cda63992 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:21.525385 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f835f5a-3ed2-48c8-a1ba-07d1cda63992 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:21.525654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f835f5a-3ed2-48c8-a1ba-07d1cda63992 None admin] PATH_INFO: `/v3/projects/e91e7da41122477ba1026feb25e7aa62` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:21.526851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f835f5a-3ed2-48c8-a1ba-07d1cda63992 None admin] RBAC: Authorizing `identity:get_project(project_id=e91e7da41122477ba1026feb25e7aa62)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:21.528266 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f835f5a-3ed2-48c8-a1ba-07d1cda63992 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:21.529939 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 566/1145] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:43:21 2022] GET /identity/v3/projects/e91e7da41122477ba1026feb25e7aa62 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:21.536267 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac40f0-0b91-459a-999c-1d3cdba6b297 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:21.591992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:21.631379 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac40f0-0b91-459a-999c-1d3cdba6b297 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:21.664522 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a756c1-0092-4b9f-901a-71f237a23003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:21.665187 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a756c1-0092-4b9f-901a-71f237a23003 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:21.665466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a756c1-0092-4b9f-901a-71f237a23003 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:21.665741 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a756c1-0092-4b9f-901a-71f237a23003 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:21.666557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a756c1-0092-4b9f-901a-71f237a23003 None admin] RBAC: Adding query filter params (role.id=868c7a356c674ded875dd079f5a9f5e0, scope.project.id=e91e7da41122477ba1026feb25e7aa62, user.id=46099bc35be7412e89b4fde411d3c2a8) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:43:21.666870 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a756c1-0092-4b9f-901a-71f237a23003 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:21.668291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a756c1-0092-4b9f-901a-71f237a23003 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:21.673680 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 580/1146] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:43:21 2022] GET /identity/v3/role_assignments?user.id=46099bc35be7412e89b4fde411d3c2a8&scope.project.id=e91e7da41122477ba1026feb25e7aa62&role.id=868c7a356c674ded875dd079f5a9f5e0 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:23.666515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1522c8-774d-4560-827f-7b6269be7378 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:23.667067 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1522c8-774d-4560-827f-7b6269be7378 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:23.667067 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1522c8-774d-4560-827f-7b6269be7378 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:23.668420 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 567/1147] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:43:23.673592 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7226ea-0a9a-4710-8790-722030df7eda None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:23.674008 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7226ea-0a9a-4710-8790-722030df7eda None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:23.674155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7226ea-0a9a-4710-8790-722030df7eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:23.691043 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-aa7226ea-0a9a-4710-8790-722030df7eda None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:43:23.692240 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-aa7226ea-0a9a-4710-8790-722030df7eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:43:23.758496 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 581/1148] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:43:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:43:23.781523 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1522c8-774d-4560-827f-7b6269be7378 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:23.849573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:23.880354 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1522c8-774d-4560-827f-7b6269be7378 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:23.913037 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b45226-1b14-4559-a102-cfb137b63493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:23.913813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b45226-1b14-4559-a102-cfb137b63493 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:23.914096 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b45226-1b14-4559-a102-cfb137b63493 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:23.914371 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b45226-1b14-4559-a102-cfb137b63493 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:23.924653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b45226-1b14-4559-a102-cfb137b63493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:43:23.932101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-87b45226-1b14-4559-a102-cfb137b63493 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:43:23.932101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:43:23.932101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:43:23.932101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:43:23.932101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:43:23.932101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:43:23.932101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:43:23.932101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:43:23.932101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:43:23.932101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:43:23.932101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:43:23.932101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:43:23.932101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:43:23.932101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:43:23.932101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:43:23.932101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:43:23.933261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:43:23.933261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:43:23.933261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:43:23.933261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:43:23.933261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:43:23.933261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:43:23.933261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:43:23.933261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:43:23.933261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:43:23.933261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:43:23.933261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:43:23.933261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:43:23.933261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:43:23.933261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:43:23.933261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:43:23.933261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:43:23.934172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:43:23.934172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:43:23.934172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:43:23.934172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:43:23.934172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:43:23.934172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:43:23.934172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:43:23.934172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:43:23.934172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:43:23.934172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:43:23.934172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:43:23.934172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:43:23.934172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 568/1149] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:43:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:43:23.940203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7226ea-0a9a-4710-8790-722030df7eda None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:23.993806 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:24.036576 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7226ea-0a9a-4710-8790-722030df7eda None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:24.069772 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb3119-cda8-4373-8684-39c67064e702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:24.070440 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb3119-cda8-4373-8684-39c67064e702 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:24.070726 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb3119-cda8-4373-8684-39c67064e702 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:24.071004 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb3119-cda8-4373-8684-39c67064e702 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:24.071748 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb3119-cda8-4373-8684-39c67064e702 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:43:24.072055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb3119-cda8-4373-8684-39c67064e702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:24.073459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb3119-cda8-4373-8684-39c67064e702 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:24.081785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 582/1150] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:43:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:24.087446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b45226-1b14-4559-a102-cfb137b63493 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:24.184887 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b45226-1b14-4559-a102-cfb137b63493 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:24.212184 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:24.217745 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019efae-9711-46df-bfd9-1955c9756e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:24.218595 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019efae-9711-46df-bfd9-1955c9756e21 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:24.218883 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019efae-9711-46df-bfd9-1955c9756e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:24.219189 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019efae-9711-46df-bfd9-1955c9756e21 None admin] PATH_INFO: `/v3/users/46099bc35be7412e89b4fde411d3c2a8` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:24.220430 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019efae-9711-46df-bfd9-1955c9756e21 None admin] RBAC: Authorizing `identity:get_user(user_id=46099bc35be7412e89b4fde411d3c2a8)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:24.221895 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019efae-9711-46df-bfd9-1955c9756e21 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:24.223489 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 569/1151] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:43:24 2022] GET /identity/v3/users/46099bc35be7412e89b4fde411d3c2a8 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:24.229501 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb3119-cda8-4373-8684-39c67064e702 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:24.325404 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb3119-cda8-4373-8684-39c67064e702 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:24.340817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:24.358249 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ee610-ca18-4aca-9c3d-16ec6ce5afee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:24.359099 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ee610-ca18-4aca-9c3d-16ec6ce5afee None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:24.359376 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ee610-ca18-4aca-9c3d-16ec6ce5afee None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:24.359667 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ee610-ca18-4aca-9c3d-16ec6ce5afee None admin] PATH_INFO: `/v3/projects/e91e7da41122477ba1026feb25e7aa62` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:24.361361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ee610-ca18-4aca-9c3d-16ec6ce5afee None admin] RBAC: Authorizing `identity:get_project(project_id=e91e7da41122477ba1026feb25e7aa62)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:24.362778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ee610-ca18-4aca-9c3d-16ec6ce5afee None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:24.364485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 583/1152] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:43:24 2022] GET /identity/v3/projects/e91e7da41122477ba1026feb25e7aa62 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:24.370134 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019efae-9711-46df-bfd9-1955c9756e21 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:24.466238 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019efae-9711-46df-bfd9-1955c9756e21 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:24.499341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ddcd9-00cc-4253-b4d5-846e1a6d6d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:24.500206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ddcd9-00cc-4253-b4d5-846e1a6d6d77 None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:24.500519 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ddcd9-00cc-4253-b4d5-846e1a6d6d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:24.500826 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ddcd9-00cc-4253-b4d5-846e1a6d6d77 None admin] PATH_INFO: `/v3/projects/e91e7da41122477ba1026feb25e7aa62/users/46099bc35be7412e89b4fde411d3c2a8/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:24.502774 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ddcd9-00cc-4253-b4d5-846e1a6d6d77 None admin] RBAC: Authorizing `identity:create_grant(project_id=e91e7da41122477ba1026feb25e7aa62, user_id=46099bc35be7412e89b4fde411d3c2a8, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:24.504196 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ddcd9-00cc-4253-b4d5-846e1a6d6d77 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:24.639476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 570/1153] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:43:24 2022] PUT /identity/v3/projects/e91e7da41122477ba1026feb25e7aa62/users/46099bc35be7412e89b4fde411d3c2a8/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:43:26.621746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84006ce-78e8-4d2e-a6cb-4ee49e0dc955 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:26.622338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84006ce-78e8-4d2e-a6cb-4ee49e0dc955 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:26.622338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84006ce-78e8-4d2e-a6cb-4ee49e0dc955 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:26.623663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 584/1154] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:43:26.629390 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701722f7-619a-4816-af1f-59ac150c8dc0 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:26.629809 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701722f7-619a-4816-af1f-59ac150c8dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:26.629945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701722f7-619a-4816-af1f-59ac150c8dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:26.646770 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-701722f7-619a-4816-af1f-59ac150c8dc0 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:43:26.647940 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-701722f7-619a-4816-af1f-59ac150c8dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:43:26.698206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:26.711823 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 571/1155] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:43:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:43:26.734758 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84006ce-78e8-4d2e-a6cb-4ee49e0dc955 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:26.835071 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84006ce-78e8-4d2e-a6cb-4ee49e0dc955 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:26.869130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511c842-7ee7-410e-881d-056a95ca5949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:26.869903 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511c842-7ee7-410e-881d-056a95ca5949 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:26.870183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511c842-7ee7-410e-881d-056a95ca5949 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:26.870452 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511c842-7ee7-410e-881d-056a95ca5949 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:26.880232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511c842-7ee7-410e-881d-056a95ca5949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:43:26.887671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-d511c842-7ee7-410e-881d-056a95ca5949 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:43:26.887671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:43:26.887671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:43:26.887671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:43:26.887671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:43:26.887671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:43:26.887671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:43:26.887671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:43:26.887671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:43:26.887671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:43:26.887671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:43:26.887671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:43:26.887671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:43:26.887671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:43:26.887671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:43:26.887671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:43:26.888817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:43:26.888817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:43:26.888817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:43:26.888817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:43:26.888817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:43:26.888817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:43:26.888817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:43:26.888817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:43:26.888817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:43:26.888817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:43:26.888817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:43:26.888817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:43:26.888817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:43:26.888817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:43:26.888817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:43:26.888817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:43:26.889864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:43:26.889864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:43:26.889864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:43:26.889864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:43:26.889864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:43:26.889864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:43:26.889864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:43:26.889864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:43:26.889864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:43:26.889864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:43:26.889864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:43:26.889864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:43:26.889864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 585/1156] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:43:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:43:26.895269 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701722f7-619a-4816-af1f-59ac150c8dc0 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:26.989789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701722f7-619a-4816-af1f-59ac150c8dc0 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:27.021881 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62820d6-3197-4c46-aac4-af75da3db370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:27.022525 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62820d6-3197-4c46-aac4-af75da3db370 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:27.022805 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62820d6-3197-4c46-aac4-af75da3db370 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:27.023076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62820d6-3197-4c46-aac4-af75da3db370 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:27.023807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62820d6-3197-4c46-aac4-af75da3db370 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:43:27.024107 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62820d6-3197-4c46-aac4-af75da3db370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:27.025484 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62820d6-3197-4c46-aac4-af75da3db370 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:27.033240 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 572/1157] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:43:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:27.038778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511c842-7ee7-410e-881d-056a95ca5949 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:27.084061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:27.137496 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511c842-7ee7-410e-881d-056a95ca5949 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:27.169225 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3473ae-8ae4-4cbf-8757-8b98521c7760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:27.170084 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3473ae-8ae4-4cbf-8757-8b98521c7760 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:27.170369 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3473ae-8ae4-4cbf-8757-8b98521c7760 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:27.170646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3473ae-8ae4-4cbf-8757-8b98521c7760 None admin] PATH_INFO: `/v3/users/46099bc35be7412e89b4fde411d3c2a8` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:27.171821 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3473ae-8ae4-4cbf-8757-8b98521c7760 None admin] RBAC: Authorizing `identity:get_user(user_id=46099bc35be7412e89b4fde411d3c2a8)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:27.173817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3473ae-8ae4-4cbf-8757-8b98521c7760 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:27.175422 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 586/1158] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:43:27 2022] GET /identity/v3/users/46099bc35be7412e89b4fde411d3c2a8 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:27.181145 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62820d6-3197-4c46-aac4-af75da3db370 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:27.229021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:27.277641 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62820d6-3197-4c46-aac4-af75da3db370 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:27.309842 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41ad1e-7b46-4a35-a00f-37bfb6a4ab24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:27.310469 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41ad1e-7b46-4a35-a00f-37bfb6a4ab24 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:27.310750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41ad1e-7b46-4a35-a00f-37bfb6a4ab24 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:27.311020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41ad1e-7b46-4a35-a00f-37bfb6a4ab24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:27.374666 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41ad1e-7b46-4a35-a00f-37bfb6a4ab24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:27.376120 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41ad1e-7b46-4a35-a00f-37bfb6a4ab24 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:27.421379 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:27.469548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 573/1159] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:43:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:43:27.475545 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3473ae-8ae4-4cbf-8757-8b98521c7760 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:27.571381 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3473ae-8ae4-4cbf-8757-8b98521c7760 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:27.583780 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:27.604523 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9765cf-09d4-444f-b709-95c046a7f3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:27.605401 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9765cf-09d4-444f-b709-95c046a7f3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:27.605684 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9765cf-09d4-444f-b709-95c046a7f3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:27.605960 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9765cf-09d4-444f-b709-95c046a7f3f0 None admin] PATH_INFO: `/v3/projects/e91e7da41122477ba1026feb25e7aa62` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:27.607129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9765cf-09d4-444f-b709-95c046a7f3f0 None admin] RBAC: Authorizing `identity:get_project(project_id=e91e7da41122477ba1026feb25e7aa62)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:27.608560 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9765cf-09d4-444f-b709-95c046a7f3f0 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:27.611006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 587/1160] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:43:27 2022] GET /identity/v3/projects/e91e7da41122477ba1026feb25e7aa62 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:27.617050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41ad1e-7b46-4a35-a00f-37bfb6a4ab24 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:27.712571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41ad1e-7b46-4a35-a00f-37bfb6a4ab24 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:27.746186 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf1ff4-251b-4ed9-8730-5798b783d9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:27.746827 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf1ff4-251b-4ed9-8730-5798b783d9df None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:27.747110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf1ff4-251b-4ed9-8730-5798b783d9df None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:27.747386 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf1ff4-251b-4ed9-8730-5798b783d9df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:27.748211 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf1ff4-251b-4ed9-8730-5798b783d9df None admin] RBAC: Adding query filter params (role.id=868c7a356c674ded875dd079f5a9f5e0, scope.project.id=e91e7da41122477ba1026feb25e7aa62, user.id=46099bc35be7412e89b4fde411d3c2a8) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:43:27.748521 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf1ff4-251b-4ed9-8730-5798b783d9df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:27.749967 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf1ff4-251b-4ed9-8730-5798b783d9df None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:27.755658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 574/1161] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:43:27 2022] GET /identity/v3/role_assignments?user.id=46099bc35be7412e89b4fde411d3c2a8&scope.project.id=e91e7da41122477ba1026feb25e7aa62&role.id=868c7a356c674ded875dd079f5a9f5e0 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:29.772028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eebffc-bfcc-4f64-86a1-a779ad048521 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:29.772563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eebffc-bfcc-4f64-86a1-a779ad048521 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:29.772563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eebffc-bfcc-4f64-86a1-a779ad048521 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:29.773974 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 588/1162] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:43:29.779389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386d826-ec7c-4dd3-bc71-2b341aff778a None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:29.779782 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386d826-ec7c-4dd3-bc71-2b341aff778a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:29.779949 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386d826-ec7c-4dd3-bc71-2b341aff778a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:29.796075 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-0386d826-ec7c-4dd3-bc71-2b341aff778a None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:43:29.797278 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0386d826-ec7c-4dd3-bc71-2b341aff778a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:43:29.806135 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:29.861890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 575/1163] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:43:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:43:29.884453 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eebffc-bfcc-4f64-86a1-a779ad048521 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:29.989162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eebffc-bfcc-4f64-86a1-a779ad048521 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:30.021253 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c1c39-1ee0-4535-842b-27255023cd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:30.021891 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c1c39-1ee0-4535-842b-27255023cd7e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:30.022219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c1c39-1ee0-4535-842b-27255023cd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:30.022442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c1c39-1ee0-4535-842b-27255023cd7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:30.070479 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:30.088743 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c1c39-1ee0-4535-842b-27255023cd7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:30.090239 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c1c39-1ee0-4535-842b-27255023cd7e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:30.183889 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 589/1164] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:43:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:43:30.189867 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386d826-ec7c-4dd3-bc71-2b341aff778a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:30.286837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386d826-ec7c-4dd3-bc71-2b341aff778a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:30.319062 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de770d-1a13-4fab-ade0-53e34d6098ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:30.319842 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de770d-1a13-4fab-ade0-53e34d6098ff None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:30.320124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de770d-1a13-4fab-ade0-53e34d6098ff None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:30.320396 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de770d-1a13-4fab-ade0-53e34d6098ff None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:30.326918 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de770d-1a13-4fab-ade0-53e34d6098ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:30.328945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de770d-1a13-4fab-ade0-53e34d6098ff None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:30.342500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-a1de770d-1a13-4fab-ade0-53e34d6098ff None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 05 12:43:30.342500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:43:30.342500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 05 12:43:30.342500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 05 12:43:30.342500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:43:30.342500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:43:30.342500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:43:30.342500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:43:30.342500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 05 12:43:30.342500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:43:30.342500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:43:30.342500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:43:30.342500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:43:30.342500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:43:30.342500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:43:30.342500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:43:30.342500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:43:30.343758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:43:30.343758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:43:30.343758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:43:30.343758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:43:30.343758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:43:30.343758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:43:30.343758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:43:30.343758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:43:30.343758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:43:30.343758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:43:30.343758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:43:30.343758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:43:30.343758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:43:30.343758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:43:30.343758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:43:30.343758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:43:30.344997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:43:30.344997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:43:30.344997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:43:30.344997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:43:30.344997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:43:30.344997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:43:30.344997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:43:30.344997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:43:30.344997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:43:30.344997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:43:30.344997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 05 12:43:30.344997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:43:30.344997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 05 12:43:30.344997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:43:30.344997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 576/1165] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jul 5 12:43:30 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:43:30.349856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c1c39-1ee0-4535-842b-27255023cd7e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:30.426049 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:30.444536 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c1c39-1ee0-4535-842b-27255023cd7e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:30.477871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29092682-fc35-41c7-a92b-41f442c79950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:30.478522 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29092682-fc35-41c7-a92b-41f442c79950 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:30.478802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29092682-fc35-41c7-a92b-41f442c79950 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:30.479076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29092682-fc35-41c7-a92b-41f442c79950 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:30.479787 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29092682-fc35-41c7-a92b-41f442c79950 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:43:30.480090 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29092682-fc35-41c7-a92b-41f442c79950 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:30.481470 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29092682-fc35-41c7-a92b-41f442c79950 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:30.488386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 590/1166] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jul 5 12:43:30 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:32.480130 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5146014-ae32-4cc3-947d-3cbe69d80907 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:32.480652 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5146014-ae32-4cc3-947d-3cbe69d80907 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:32.480652 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5146014-ae32-4cc3-947d-3cbe69d80907 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:32.481974 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 577/1167] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:43:32.487656 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6123c2e-5a90-47b1-af1f-d5f2417b01a6 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:32.488094 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6123c2e-5a90-47b1-af1f-d5f2417b01a6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:32.488213 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6123c2e-5a90-47b1-af1f-d5f2417b01a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:32.505010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-c6123c2e-5a90-47b1-af1f-d5f2417b01a6 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:43:32.506187 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c6123c2e-5a90-47b1-af1f-d5f2417b01a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:43:32.569197 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 591/1168] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:43:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:43:32.591295 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5146014-ae32-4cc3-947d-3cbe69d80907 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:32.596231 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:32.690138 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5146014-ae32-4cc3-947d-3cbe69d80907 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:32.721900 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127cdaa1-1aa3-42a8-b008-9e0ac18cf371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:32.722534 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cdaa1-1aa3-42a8-b008-9e0ac18cf371 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:32.722834 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cdaa1-1aa3-42a8-b008-9e0ac18cf371 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:32.723110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cdaa1-1aa3-42a8-b008-9e0ac18cf371 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:32.723835 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127cdaa1-1aa3-42a8-b008-9e0ac18cf371 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:32.725474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127cdaa1-1aa3-42a8-b008-9e0ac18cf371 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:32.800909 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 578/1169] 10.222.0.36 () {60 vars in 1138 bytes} [Tue Jul 5 12:43:32 2022] POST /identity/v3/domains => generated 267 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:43:34.830715 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8262b-ab86-44ec-a0fe-43656a00c6cb None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:34.831249 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8262b-ab86-44ec-a0fe-43656a00c6cb None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:34.831249 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8262b-ab86-44ec-a0fe-43656a00c6cb None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:34.832656 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 592/1170] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:43:34.837805 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f750b-bdac-4a1e-978b-96ceeaf3b672 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:34.838214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f750b-bdac-4a1e-978b-96ceeaf3b672 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:34.838363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f750b-bdac-4a1e-978b-96ceeaf3b672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:34.856075 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-bd9f750b-bdac-4a1e-978b-96ceeaf3b672 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:43:34.857278 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-bd9f750b-bdac-4a1e-978b-96ceeaf3b672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:43:34.913443 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:34.922273 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 579/1171] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:43:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:43:34.945759 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8262b-ab86-44ec-a0fe-43656a00c6cb None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:35.019591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:35.045052 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8262b-ab86-44ec-a0fe-43656a00c6cb None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:35.079286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12269c4-9623-4187-8ea0-bdb2dd2fadfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:35.080143 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12269c4-9623-4187-8ea0-bdb2dd2fadfc None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:35.080423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12269c4-9623-4187-8ea0-bdb2dd2fadfc None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:35.080790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12269c4-9623-4187-8ea0-bdb2dd2fadfc None admin] PATH_INFO: `/v3/domains/f0cff7307b084d4fab86240c727738d5` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:35.090765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12269c4-9623-4187-8ea0-bdb2dd2fadfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=f0cff7307b084d4fab86240c727738d5)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:35.092206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12269c4-9623-4187-8ea0-bdb2dd2fadfc None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:35.094382 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 593/1172] 10.222.0.36 () {56 vars in 1183 bytes} [Tue Jul 5 12:43:34 2022] GET /identity/v3/domains/f0cff7307b084d4fab86240c727738d5 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:35.100427 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f750b-bdac-4a1e-978b-96ceeaf3b672 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:35.194842 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f750b-bdac-4a1e-978b-96ceeaf3b672 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:35.228099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b1d9b-d71b-4eb5-82bd-70121b6ead7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:35.228769 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b1d9b-d71b-4eb5-82bd-70121b6ead7e None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:35.229056 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b1d9b-d71b-4eb5-82bd-70121b6ead7e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:35.229334 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b1d9b-d71b-4eb5-82bd-70121b6ead7e None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:35.230053 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b1d9b-d71b-4eb5-82bd-70121b6ead7e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:35.231463 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b1d9b-d71b-4eb5-82bd-70121b6ead7e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:35.320100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 580/1173] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jul 5 12:43:35 2022] POST /identity/v3/projects => generated 361 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:43:37.357877 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4e557-7a4d-4f77-99d7-d35f0597480d None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:37.358380 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4e557-7a4d-4f77-99d7-d35f0597480d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:37.358380 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4e557-7a4d-4f77-99d7-d35f0597480d None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:37.360226 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 594/1174] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:43:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:43:37.365419 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5974fc2-cf9a-4c85-bc5d-feb4f790e20a None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:37.365839 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5974fc2-cf9a-4c85-bc5d-feb4f790e20a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:37.365981 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5974fc2-cf9a-4c85-bc5d-feb4f790e20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:37.382899 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-a5974fc2-cf9a-4c85-bc5d-feb4f790e20a None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:43:37.384086 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a5974fc2-cf9a-4c85-bc5d-feb4f790e20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:43:37.424861 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:37.450132 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 581/1175] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:43:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:43:37.475991 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4e557-7a4d-4f77-99d7-d35f0597480d None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:37.574052 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4e557-7a4d-4f77-99d7-d35f0597480d None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:37.605954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdccd4-06b7-46bb-af1c-7f7e542f6808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:37.606796 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdccd4-06b7-46bb-af1c-7f7e542f6808 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:37.607075 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdccd4-06b7-46bb-af1c-7f7e542f6808 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:37.607345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdccd4-06b7-46bb-af1c-7f7e542f6808 None admin] PATH_INFO: `/v3/domains/f0cff7307b084d4fab86240c727738d5` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:37.608545 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdccd4-06b7-46bb-af1c-7f7e542f6808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f0cff7307b084d4fab86240c727738d5)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:37.610487 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdccd4-06b7-46bb-af1c-7f7e542f6808 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:37.612064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 595/1176] 10.222.0.36 () {56 vars in 1183 bytes} [Tue Jul 5 12:43:37 2022] GET /identity/v3/domains/f0cff7307b084d4fab86240c727738d5 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:37.617847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5974fc2-cf9a-4c85-bc5d-feb4f790e20a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:37.713034 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5974fc2-cf9a-4c85-bc5d-feb4f790e20a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:37.746200 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c1886-d4c1-4f77-9f49-f87099ecf120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:37.746845 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c1886-d4c1-4f77-9f49-f87099ecf120 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:37.747128 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c1886-d4c1-4f77-9f49-f87099ecf120 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:37.747405 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c1886-d4c1-4f77-9f49-f87099ecf120 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:37.748141 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c1886-d4c1-4f77-9f49-f87099ecf120 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:37.750135 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c1886-d4c1-4f77-9f49-f87099ecf120 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:37.869341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 582/1177] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jul 5 12:43:37 2022] POST /identity/v3/users => generated 311 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:43:39.906980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7755f-4594-4337-8bba-d9bc822e8939 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:39.907515 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7755f-4594-4337-8bba-d9bc822e8939 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:39.907515 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7755f-4594-4337-8bba-d9bc822e8939 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:39.908924 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 596/1178] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:43:39.914062 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5698e7-1324-464f-ab80-3952d91c027c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:39.914445 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5698e7-1324-464f-ab80-3952d91c027c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:39.914629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5698e7-1324-464f-ab80-3952d91c027c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:39.931443 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-fd5698e7-1324-464f-ab80-3952d91c027c None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:43:39.932647 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-fd5698e7-1324-464f-ab80-3952d91c027c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:43:39.957802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:39.998017 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 583/1179] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:43:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:43:40.021876 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7755f-4594-4337-8bba-d9bc822e8939 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:40.024745 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:40.122429 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7755f-4594-4337-8bba-d9bc822e8939 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:40.154313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a84df4-4e84-4db2-8ad0-6046ea7a8cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:40.155095 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a84df4-4e84-4db2-8ad0-6046ea7a8cac None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:40.155375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a84df4-4e84-4db2-8ad0-6046ea7a8cac None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:40.156172 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a84df4-4e84-4db2-8ad0-6046ea7a8cac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:40.166025 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a84df4-4e84-4db2-8ad0-6046ea7a8cac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:43:40.174067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-d7a84df4-4e84-4db2-8ad0-6046ea7a8cac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:43:40.174067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:43:40.174067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:43:40.174067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:43:40.174067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:43:40.174067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:43:40.174067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:43:40.174067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:43:40.174067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:43:40.174067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:43:40.174067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:43:40.174067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:43:40.174067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:43:40.174067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:43:40.174067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:43:40.174067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:43:40.175152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:43:40.175152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:43:40.175152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:43:40.175152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:43:40.175152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:43:40.175152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:43:40.175152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:43:40.175152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:43:40.175152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:43:40.175152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:43:40.175152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:43:40.175152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:43:40.175152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:43:40.175152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:43:40.175152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:43:40.175152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:43:40.176174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:43:40.176174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:43:40.176174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:43:40.176174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:43:40.176174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:43:40.176174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:43:40.176174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:43:40.176174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:43:40.176174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:43:40.176174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:43:40.176174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:43:40.176174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:43:40.176174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 597/1180] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:43:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:43:40.181381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5698e7-1324-464f-ab80-3952d91c027c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:40.275230 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5698e7-1324-464f-ab80-3952d91c027c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:40.308005 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed726a-589d-4ad1-8b2c-45c2aca773d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:40.308677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed726a-589d-4ad1-8b2c-45c2aca773d0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:40.308960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed726a-589d-4ad1-8b2c-45c2aca773d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:40.309234 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed726a-589d-4ad1-8b2c-45c2aca773d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:40.309974 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed726a-589d-4ad1-8b2c-45c2aca773d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:43:40.310275 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed726a-589d-4ad1-8b2c-45c2aca773d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:40.311623 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed726a-589d-4ad1-8b2c-45c2aca773d0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:40.319341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 584/1181] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:43:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:40.324877 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a84df4-4e84-4db2-8ad0-6046ea7a8cac None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:40.384546 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:40.422703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a84df4-4e84-4db2-8ad0-6046ea7a8cac None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:40.455086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033ef20-ef56-45d0-8c35-141d4d9f122f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:40.455934 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033ef20-ef56-45d0-8c35-141d4d9f122f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:40.456217 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033ef20-ef56-45d0-8c35-141d4d9f122f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:40.456494 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033ef20-ef56-45d0-8c35-141d4d9f122f None admin] PATH_INFO: `/v3/users/f5e439f224ef4aec8bf6b39203e646fc` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:40.469781 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033ef20-ef56-45d0-8c35-141d4d9f122f None admin] RBAC: Authorizing `identity:get_user(user_id=f5e439f224ef4aec8bf6b39203e646fc)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:40.471217 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033ef20-ef56-45d0-8c35-141d4d9f122f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:40.472859 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 598/1182] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:43:40 2022] GET /identity/v3/users/f5e439f224ef4aec8bf6b39203e646fc => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:40.478687 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed726a-589d-4ad1-8b2c-45c2aca773d0 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:40.503792 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:40.574668 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed726a-589d-4ad1-8b2c-45c2aca773d0 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:40.607529 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe075dd-7ebb-4d62-961b-4cf531f32bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:40.608152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe075dd-7ebb-4d62-961b-4cf531f32bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:40.608431 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe075dd-7ebb-4d62-961b-4cf531f32bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:40.608755 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe075dd-7ebb-4d62-961b-4cf531f32bd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:40.672210 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe075dd-7ebb-4d62-961b-4cf531f32bd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:40.673706 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe075dd-7ebb-4d62-961b-4cf531f32bd3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:40.695690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:40.767949 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 585/1183] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:43:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:43:40.773775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033ef20-ef56-45d0-8c35-141d4d9f122f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:40.868851 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033ef20-ef56-45d0-8c35-141d4d9f122f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:40.889373 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:40.903149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8900fd-531a-4269-8d0b-8bccd2ca73eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:40.904007 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8900fd-531a-4269-8d0b-8bccd2ca73eb None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:40.904292 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8900fd-531a-4269-8d0b-8bccd2ca73eb None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:40.904571 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8900fd-531a-4269-8d0b-8bccd2ca73eb None admin] PATH_INFO: `/v3/projects/e60646101dd4430fbb3b3b8f2c9b03db` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:40.905803 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8900fd-531a-4269-8d0b-8bccd2ca73eb None admin] RBAC: Authorizing `identity:get_project(project_id=e60646101dd4430fbb3b3b8f2c9b03db)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:40.907244 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8900fd-531a-4269-8d0b-8bccd2ca73eb None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:40.908969 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 599/1184] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:43:40 2022] GET /identity/v3/projects/e60646101dd4430fbb3b3b8f2c9b03db => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:40.915096 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe075dd-7ebb-4d62-961b-4cf531f32bd3 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:41.011575 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe075dd-7ebb-4d62-961b-4cf531f32bd3 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:41.034816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:41.045127 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a929b-4229-439d-a8fb-f91263ac10f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:41.048802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a929b-4229-439d-a8fb-f91263ac10f7 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:41.048802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a929b-4229-439d-a8fb-f91263ac10f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:41.048802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a929b-4229-439d-a8fb-f91263ac10f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:41.048802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a929b-4229-439d-a8fb-f91263ac10f7 None admin] RBAC: Adding query filter params (role.id=868c7a356c674ded875dd079f5a9f5e0, scope.project.id=e60646101dd4430fbb3b3b8f2c9b03db, user.id=f5e439f224ef4aec8bf6b39203e646fc) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:43:41.048802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a929b-4229-439d-a8fb-f91263ac10f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:41.049273 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a929b-4229-439d-a8fb-f91263ac10f7 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:41.054329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 586/1185] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:43:40 2022] GET /identity/v3/role_assignments?user.id=f5e439f224ef4aec8bf6b39203e646fc&scope.project.id=e60646101dd4430fbb3b3b8f2c9b03db&role.id=868c7a356c674ded875dd079f5a9f5e0 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:43.005320 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f61a5-3c0b-43b6-b0a4-2c28d1e81724 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:43.005877 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f61a5-3c0b-43b6-b0a4-2c28d1e81724 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:43.005877 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f61a5-3c0b-43b6-b0a4-2c28d1e81724 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:43.007242 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 600/1186] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:43:43.012336 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ff3b8-6f90-42ef-b581-25d0c0a18262 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:43.012740 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ff3b8-6f90-42ef-b581-25d0c0a18262 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:43.012940 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ff3b8-6f90-42ef-b581-25d0c0a18262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:43.029146 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-4e2ff3b8-6f90-42ef-b581-25d0c0a18262 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:43:43.030311 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4e2ff3b8-6f90-42ef-b581-25d0c0a18262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:43:43.095072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 587/1187] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:43:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:43:43.117812 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f61a5-3c0b-43b6-b0a4-2c28d1e81724 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:43.223853 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f61a5-3c0b-43b6-b0a4-2c28d1e81724 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:43.257343 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7206d-0710-49ed-9508-47f01ab4043f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:43.258062 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7206d-0710-49ed-9508-47f01ab4043f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:43.258345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7206d-0710-49ed-9508-47f01ab4043f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:43.258626 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7206d-0710-49ed-9508-47f01ab4043f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:43.268404 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7206d-0710-49ed-9508-47f01ab4043f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:43:43.276033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-58b7206d-0710-49ed-9508-47f01ab4043f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:43:43.276033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:43:43.276033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:43:43.276033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:43:43.276033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:43:43.276033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:43:43.276033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:43:43.276033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:43:43.276033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:43:43.276033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:43:43.276033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:43:43.276033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:43:43.276033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:43:43.276033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:43:43.276033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:43:43.276033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:43:43.277115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:43:43.277115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:43:43.277115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:43:43.277115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:43:43.277115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:43:43.277115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:43:43.277115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:43:43.277115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:43:43.277115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:43:43.277115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:43:43.277115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:43:43.277115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:43:43.277115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:43:43.277115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:43:43.277115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:43:43.277115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:43:43.278155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:43:43.278155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:43:43.278155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:43:43.278155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:43:43.278155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:43:43.278155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:43:43.278155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:43:43.278155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:43:43.278155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:43:43.278155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:43:43.278155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:43:43.278155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:43:43.278155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 601/1188] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:43:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:43:43.283900 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ff3b8-6f90-42ef-b581-25d0c0a18262 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:43.378101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ff3b8-6f90-42ef-b581-25d0c0a18262 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:43.394907 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:43.411313 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52809d82-6705-4a5d-b199-cbf39010bbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:43.411961 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52809d82-6705-4a5d-b199-cbf39010bbd0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:43.412244 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52809d82-6705-4a5d-b199-cbf39010bbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:43.412519 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52809d82-6705-4a5d-b199-cbf39010bbd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:43.413283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52809d82-6705-4a5d-b199-cbf39010bbd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:43:43.413588 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52809d82-6705-4a5d-b199-cbf39010bbd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:43.414949 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52809d82-6705-4a5d-b199-cbf39010bbd0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:43.422618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 588/1189] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:43:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:43:43.428249 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7206d-0710-49ed-9508-47f01ab4043f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:43.477169 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:43.526550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7206d-0710-49ed-9508-47f01ab4043f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:43.558928 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28119f5-4dea-4b02-b0f9-bbb57098b790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:43.559821 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28119f5-4dea-4b02-b0f9-bbb57098b790 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:43.560104 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28119f5-4dea-4b02-b0f9-bbb57098b790 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:43.560381 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28119f5-4dea-4b02-b0f9-bbb57098b790 None admin] PATH_INFO: `/v3/users/f5e439f224ef4aec8bf6b39203e646fc` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:43.561626 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28119f5-4dea-4b02-b0f9-bbb57098b790 None admin] RBAC: Authorizing `identity:get_user(user_id=f5e439f224ef4aec8bf6b39203e646fc)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:43.563647 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28119f5-4dea-4b02-b0f9-bbb57098b790 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:43.565311 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 602/1190] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:43:43 2022] GET /identity/v3/users/f5e439f224ef4aec8bf6b39203e646fc => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:43.571283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52809d82-6705-4a5d-b199-cbf39010bbd0 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:43.667887 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52809d82-6705-4a5d-b199-cbf39010bbd0 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:43.700510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16feb4-bb49-4ed2-9adb-f213c8751042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:43.701379 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16feb4-bb49-4ed2-9adb-f213c8751042 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:43.701662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16feb4-bb49-4ed2-9adb-f213c8751042 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:43.701935 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16feb4-bb49-4ed2-9adb-f213c8751042 None admin] PATH_INFO: `/v3/projects/e60646101dd4430fbb3b3b8f2c9b03db` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:43.703134 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16feb4-bb49-4ed2-9adb-f213c8751042 None admin] RBAC: Authorizing `identity:get_project(project_id=e60646101dd4430fbb3b3b8f2c9b03db)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:43.704557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16feb4-bb49-4ed2-9adb-f213c8751042 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:43.706248 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 589/1191] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:43:43 2022] GET /identity/v3/projects/e60646101dd4430fbb3b3b8f2c9b03db => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:43.712033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28119f5-4dea-4b02-b0f9-bbb57098b790 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:43.813604 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28119f5-4dea-4b02-b0f9-bbb57098b790 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:43.828979 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:43.846262 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20384334-7abb-41a5-a7f1-8f4be69a085e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:43.847133 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20384334-7abb-41a5-a7f1-8f4be69a085e None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:43.847414 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20384334-7abb-41a5-a7f1-8f4be69a085e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:43.847687 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20384334-7abb-41a5-a7f1-8f4be69a085e None admin] PATH_INFO: `/v3/projects/e60646101dd4430fbb3b3b8f2c9b03db/users/f5e439f224ef4aec8bf6b39203e646fc/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:43.850078 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20384334-7abb-41a5-a7f1-8f4be69a085e None admin] RBAC: Authorizing `identity:create_grant(project_id=e60646101dd4430fbb3b3b8f2c9b03db, user_id=f5e439f224ef4aec8bf6b39203e646fc, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:43.851500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20384334-7abb-41a5-a7f1-8f4be69a085e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:43.988051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 603/1192] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:43:43 2022] PUT /identity/v3/projects/e60646101dd4430fbb3b3b8f2c9b03db/users/f5e439f224ef4aec8bf6b39203e646fc/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:43:45.967282 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92041cf-f601-4c2f-a528-7070c37dc888 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:45.967813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92041cf-f601-4c2f-a528-7070c37dc888 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:45.967813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92041cf-f601-4c2f-a528-7070c37dc888 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:45.969223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 590/1193] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:43:45.974476 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b813aa-e229-491f-8ee3-8317272233a4 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:45.974872 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b813aa-e229-491f-8ee3-8317272233a4 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:45.975030 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b813aa-e229-491f-8ee3-8317272233a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:45.991731 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b4b813aa-e229-491f-8ee3-8317272233a4 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:43:45.993023 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b4b813aa-e229-491f-8ee3-8317272233a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:43:46.056850 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 604/1194] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:43:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:43:46.079870 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92041cf-f601-4c2f-a528-7070c37dc888 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:46.129137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:46.180019 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92041cf-f601-4c2f-a528-7070c37dc888 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:46.211485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8c6b3-20d3-4f08-b410-4d69eb7bbe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:46.212248 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8c6b3-20d3-4f08-b410-4d69eb7bbe02 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:46.212529 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8c6b3-20d3-4f08-b410-4d69eb7bbe02 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:46.212830 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8c6b3-20d3-4f08-b410-4d69eb7bbe02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:46.223058 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8c6b3-20d3-4f08-b410-4d69eb7bbe02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:43:46.230742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-b6f8c6b3-20d3-4f08-b410-4d69eb7bbe02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:43:46.230742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:43:46.230742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:43:46.230742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:43:46.230742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:43:46.230742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:43:46.230742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:43:46.230742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:43:46.230742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:43:46.230742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:43:46.230742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:43:46.230742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:43:46.230742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:43:46.230742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:43:46.230742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:43:46.230742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:43:46.231851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:43:46.231851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:43:46.231851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:43:46.231851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:43:46.231851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:43:46.231851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:43:46.231851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:43:46.231851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:43:46.231851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:43:46.231851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:43:46.231851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:43:46.231851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:43:46.231851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:43:46.231851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:43:46.231851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:43:46.231851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:43:46.232765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:43:46.232765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:43:46.232765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:43:46.232765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:43:46.232765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:43:46.232765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:43:46.232765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:43:46.232765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:43:46.232765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:43:46.232765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:43:46.232765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:43:46.232765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:43:46.232765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 591/1195] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:43:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:43:46.238612 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b813aa-e229-491f-8ee3-8317272233a4 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:46.333111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b813aa-e229-491f-8ee3-8317272233a4 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:46.340124 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:46.366695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08f74c-5a7f-4ad6-b6eb-f696ab06b034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:46.367348 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08f74c-5a7f-4ad6-b6eb-f696ab06b034 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:46.367626 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08f74c-5a7f-4ad6-b6eb-f696ab06b034 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:46.367901 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08f74c-5a7f-4ad6-b6eb-f696ab06b034 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:46.368659 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08f74c-5a7f-4ad6-b6eb-f696ab06b034 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:43:46.368970 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08f74c-5a7f-4ad6-b6eb-f696ab06b034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:46.370328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08f74c-5a7f-4ad6-b6eb-f696ab06b034 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:46.378144 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 605/1196] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:43:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:46.383727 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8c6b3-20d3-4f08-b410-4d69eb7bbe02 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:46.480635 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8c6b3-20d3-4f08-b410-4d69eb7bbe02 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:46.489525 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:46.513354 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b030148-5393-4645-a105-085afb7d0dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:46.514197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b030148-5393-4645-a105-085afb7d0dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:46.514480 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b030148-5393-4645-a105-085afb7d0dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:46.514777 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b030148-5393-4645-a105-085afb7d0dc0 None admin] PATH_INFO: `/v3/users/f5e439f224ef4aec8bf6b39203e646fc` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:46.515934 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b030148-5393-4645-a105-085afb7d0dc0 None admin] RBAC: Authorizing `identity:get_user(user_id=f5e439f224ef4aec8bf6b39203e646fc)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:46.517367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b030148-5393-4645-a105-085afb7d0dc0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:46.518950 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 592/1197] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jul 5 12:43:46 2022] GET /identity/v3/users/f5e439f224ef4aec8bf6b39203e646fc => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:46.524530 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08f74c-5a7f-4ad6-b6eb-f696ab06b034 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:46.618859 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08f74c-5a7f-4ad6-b6eb-f696ab06b034 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:46.650558 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511594bd-326c-4a80-86c0-9b7596a09925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:46.651186 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511594bd-326c-4a80-86c0-9b7596a09925 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:46.651465 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511594bd-326c-4a80-86c0-9b7596a09925 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:46.651735 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511594bd-326c-4a80-86c0-9b7596a09925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:46.684500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:46.716030 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511594bd-326c-4a80-86c0-9b7596a09925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:46.717486 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511594bd-326c-4a80-86c0-9b7596a09925 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:46.811841 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 606/1198] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:43:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:43:46.817710 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b030148-5393-4645-a105-085afb7d0dc0 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:46.918816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b030148-5393-4645-a105-085afb7d0dc0 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:46.951409 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36a11f-6c52-4800-b83f-5caade59c234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:46.952289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36a11f-6c52-4800-b83f-5caade59c234 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:46.952573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36a11f-6c52-4800-b83f-5caade59c234 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:46.952942 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36a11f-6c52-4800-b83f-5caade59c234 None admin] PATH_INFO: `/v3/projects/e60646101dd4430fbb3b3b8f2c9b03db` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:46.954110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36a11f-6c52-4800-b83f-5caade59c234 None admin] RBAC: Authorizing `identity:get_project(project_id=e60646101dd4430fbb3b3b8f2c9b03db)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:46.955541 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36a11f-6c52-4800-b83f-5caade59c234 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:46.957277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 593/1199] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jul 5 12:43:46 2022] GET /identity/v3/projects/e60646101dd4430fbb3b3b8f2c9b03db => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:46.963405 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511594bd-326c-4a80-86c0-9b7596a09925 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:43:47.028086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:47.060722 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511594bd-326c-4a80-86c0-9b7596a09925 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:43:47.092352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0474e-71b4-4274-904f-4ae471b70644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:43:47.093548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0474e-71b4-4274-904f-4ae471b70644 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:43:47.093828 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0474e-71b4-4274-904f-4ae471b70644 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:43:47.094099 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0474e-71b4-4274-904f-4ae471b70644 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:43:47.094915 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0474e-71b4-4274-904f-4ae471b70644 None admin] RBAC: Adding query filter params (role.id=868c7a356c674ded875dd079f5a9f5e0, scope.project.id=e60646101dd4430fbb3b3b8f2c9b03db, user.id=f5e439f224ef4aec8bf6b39203e646fc) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:43:47.095223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0474e-71b4-4274-904f-4ae471b70644 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:43:47.096659 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0474e-71b4-4274-904f-4ae471b70644 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:43:47.102463 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 607/1200] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:43:46 2022] GET /identity/v3/role_assignments?user.id=f5e439f224ef4aec8bf6b39203e646fc&scope.project.id=e60646101dd4430fbb3b3b8f2c9b03db&role.id=868c7a356c674ded875dd079f5a9f5e0 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:43:56.947418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=78 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:43:57.125437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=34 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:04.299542 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b519e7-a3b8-4003-837c-bc5a6a224f31 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:04.300134 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b519e7-a3b8-4003-837c-bc5a6a224f31 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:04.300134 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b519e7-a3b8-4003-837c-bc5a6a224f31 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:04.301996 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 594/1201] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:45:04.308131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea92b9-e686-47e8-82ca-09c862e0dc46 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:04.308632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea92b9-e686-47e8-82ca-09c862e0dc46 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:04.308736 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea92b9-e686-47e8-82ca-09c862e0dc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:04.325831 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-caea92b9-e686-47e8-82ca-09c862e0dc46 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:45:04.326959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-caea92b9-e686-47e8-82ca-09c862e0dc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:45:04.391973 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 608/1202] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:45:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:45:04.415975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b519e7-a3b8-4003-837c-bc5a6a224f31 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:04.515869 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b519e7-a3b8-4003-837c-bc5a6a224f31 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:04.552070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a543bf-fe62-4383-9394-9285b4f039db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:04.552874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a543bf-fe62-4383-9394-9285b4f039db None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:04.553155 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a543bf-fe62-4383-9394-9285b4f039db None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:04.553443 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a543bf-fe62-4383-9394-9285b4f039db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:04.564290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a543bf-fe62-4383-9394-9285b4f039db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:04.565757 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a543bf-fe62-4383-9394-9285b4f039db None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:04.582254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-f3a543bf-fe62-4383-9394-9285b4f039db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:04.582254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:04.582254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:04.582254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:04.582254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:04.582254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:04.582254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:04.582254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:04.582254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:04.582254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:04.582254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:04.582254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:04.582254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:45:04.582254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:45:04.582254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:45:04.583414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:45:04.583414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:04.583414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:04.583414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:04.583414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:04.583414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:04.583414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:04.583414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:04.583414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:04.583414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:04.583414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:04.583414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:04.583414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:04.583414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:04.583414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:04.583414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:04.583414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:04.584417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:45:04.584417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:45:04.584417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:04.584417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:45:04.584417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 595/1203] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:04.589730 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea92b9-e686-47e8-82ca-09c862e0dc46 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:04.688671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea92b9-e686-47e8-82ca-09c862e0dc46 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:04.715734 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:04.721244 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90704de5-4711-42ad-982d-83d66e2ca384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:04.721896 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90704de5-4711-42ad-982d-83d66e2ca384 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:04.722173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90704de5-4711-42ad-982d-83d66e2ca384 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:04.722444 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90704de5-4711-42ad-982d-83d66e2ca384 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:04.723408 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90704de5-4711-42ad-982d-83d66e2ca384 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:04.723711 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90704de5-4711-42ad-982d-83d66e2ca384 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:04.725108 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90704de5-4711-42ad-982d-83d66e2ca384 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:04.736455 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 609/1204] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:04.742841 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a543bf-fe62-4383-9394-9285b4f039db None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:04.795799 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:04.841964 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a543bf-fe62-4383-9394-9285b4f039db None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:04.874824 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8c30e-707d-405b-a3b2-6c1b32d8d72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:04.875477 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8c30e-707d-405b-a3b2-6c1b32d8d72b None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:04.875759 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8c30e-707d-405b-a3b2-6c1b32d8d72b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:04.876038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8c30e-707d-405b-a3b2-6c1b32d8d72b None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:04.876782 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8c30e-707d-405b-a3b2-6c1b32d8d72b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:04.878229 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8c30e-707d-405b-a3b2-6c1b32d8d72b None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:04.995741 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 596/1205] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jul 5 12:45:04 2022] POST /identity/v3/users => generated 251 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:45:07.070574 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648e329-01cb-42cd-b296-1a24cf7f3368 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:07.071006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648e329-01cb-42cd-b296-1a24cf7f3368 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:07.071114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648e329-01cb-42cd-b296-1a24cf7f3368 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:07.072491 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 610/1206] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:45:07.077674 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbdb35-1001-4340-9487-64fdf420320b None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:07.078092 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbdb35-1001-4340-9487-64fdf420320b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:07.078233 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbdb35-1001-4340-9487-64fdf420320b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:07.095798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-6adbdb35-1001-4340-9487-64fdf420320b None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:45:07.097120 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6adbdb35-1001-4340-9487-64fdf420320b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:45:07.162318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 597/1207] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:45:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:45:07.186002 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648e329-01cb-42cd-b296-1a24cf7f3368 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:07.284682 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648e329-01cb-42cd-b296-1a24cf7f3368 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:07.317786 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bea337-7410-47da-8991-5a05548211d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:07.318513 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bea337-7410-47da-8991-5a05548211d5 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:07.318794 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bea337-7410-47da-8991-5a05548211d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:07.319626 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bea337-7410-47da-8991-5a05548211d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:07.329587 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bea337-7410-47da-8991-5a05548211d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:45:07.337116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-a0bea337-7410-47da-8991-5a05548211d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:45:07.337116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:07.337116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:07.337116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:07.337116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:07.337116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:07.337116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:07.337116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:07.337116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:07.337116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:07.337116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:07.337116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:07.337116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:45:07.337116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:45:07.337116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:45:07.337116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:45:07.338138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:45:07.338138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:45:07.338138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:45:07.338138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:45:07.338138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:07.338138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:07.338138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:07.338138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:07.338138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:07.338138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:07.338138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:07.338138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:07.338138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:07.338138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:07.338138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:07.338138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:07.339319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:07.339319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:07.339319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:07.339319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:07.339319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:45:07.339319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:45:07.339319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:45:07.339319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:45:07.339319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:45:07.339319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:45:07.339319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:45:07.339319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:07.339319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 611/1208] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:45:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:07.344210 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbdb35-1001-4340-9487-64fdf420320b None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:07.383508 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:07.439668 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbdb35-1001-4340-9487-64fdf420320b None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:07.472255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8fba8-b1ad-4e3c-a67f-c80f459ce07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:07.473208 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8fba8-b1ad-4e3c-a67f-c80f459ce07e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:07.473495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8fba8-b1ad-4e3c-a67f-c80f459ce07e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:07.473766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8fba8-b1ad-4e3c-a67f-c80f459ce07e None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:07.474511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8fba8-b1ad-4e3c-a67f-c80f459ce07e None admin] RBAC: Adding query filter params (name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:07.474796 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8fba8-b1ad-4e3c-a67f-c80f459ce07e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:07.476820 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8fba8-b1ad-4e3c-a67f-c80f459ce07e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:07.484432 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 598/1209] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jul 5 12:45:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:07.490190 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bea337-7410-47da-8991-5a05548211d5 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:07.539326 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:07.586472 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bea337-7410-47da-8991-5a05548211d5 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:07.619133 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029a9c1-799e-45db-971b-ba8ebf85d3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:07.619919 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029a9c1-799e-45db-971b-ba8ebf85d3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:07.620202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029a9c1-799e-45db-971b-ba8ebf85d3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:07.620524 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029a9c1-799e-45db-971b-ba8ebf85d3f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:07.630803 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029a9c1-799e-45db-971b-ba8ebf85d3f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:07.632246 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029a9c1-799e-45db-971b-ba8ebf85d3f1 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:07.649633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-5029a9c1-799e-45db-971b-ba8ebf85d3f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:07.649633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:07.649633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:07.649633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:07.649633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:07.649633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:07.649633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:07.649633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:07.649633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:07.649633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:07.649633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:07.649633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:07.649633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:45:07.649633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:45:07.649633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:45:07.650774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:45:07.650774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:07.650774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:07.650774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:07.650774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:07.650774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:07.650774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:07.650774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:07.650774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:07.650774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:07.650774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:07.650774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:07.650774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:07.650774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:07.650774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:07.650774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:07.650774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:07.655866 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:45:07.655866 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:45:07.655866 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:07.655866 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:07.655866 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 612/1210] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:07.656614 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8fba8-b1ad-4e3c-a67f-c80f459ce07e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:07.751846 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:07.754726 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8fba8-b1ad-4e3c-a67f-c80f459ce07e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:07.786376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7676f5b-8e6a-4382-ad79-dee9c4129bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:07.787026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7676f5b-8e6a-4382-ad79-dee9c4129bec None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:07.787473 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7676f5b-8e6a-4382-ad79-dee9c4129bec None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:07.788097 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7676f5b-8e6a-4382-ad79-dee9c4129bec None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:07.788862 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7676f5b-8e6a-4382-ad79-dee9c4129bec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:07.789175 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7676f5b-8e6a-4382-ad79-dee9c4129bec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:07.790578 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7676f5b-8e6a-4382-ad79-dee9c4129bec None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:07.801885 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 599/1211] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:07.808084 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029a9c1-799e-45db-971b-ba8ebf85d3f1 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:07.904511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029a9c1-799e-45db-971b-ba8ebf85d3f1 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:07.905966 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:07.936924 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1477aa-4661-4a81-b703-ab9e95f905a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:07.937803 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1477aa-4661-4a81-b703-ab9e95f905a3 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:07.937990 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1477aa-4661-4a81-b703-ab9e95f905a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:07.938262 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1477aa-4661-4a81-b703-ab9e95f905a3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:07.944979 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1477aa-4661-4a81-b703-ab9e95f905a3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:07.950643 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1477aa-4661-4a81-b703-ab9e95f905a3 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:07.961114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-eb1477aa-4661-4a81-b703-ab9e95f905a3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:45:07.961114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:07.961114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:07.961114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:07.961114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:07.961114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:07.961114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:07.961114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:07.961114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:07.961114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:07.961114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:07.961114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:07.961114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:45:07.961114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:45:07.961114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:45:07.961114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:45:07.962250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:07.962250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:07.962250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:45:07.962250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:45:07.962250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:45:07.962250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:45:07.962250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:07.962250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:07.962250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:07.962250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:07.962250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:07.962250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:07.962250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:07.962250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:07.962250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:07.962250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:07.962250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:07.962250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:07.963223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:07.963223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:07.963223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:45:07.963223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:45:07.963223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:45:07.963223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:45:07.963223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:45:07.963223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:45:07.963223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:45:07.963223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:07.963223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 613/1212] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:45:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:07.968090 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7676f5b-8e6a-4382-ad79-dee9c4129bec None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:08.067096 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7676f5b-8e6a-4382-ad79-dee9c4129bec None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:08.101095 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed2c74-44b5-4344-93c6-a9ae45f9f454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:08.101744 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed2c74-44b5-4344-93c6-a9ae45f9f454 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:08.102023 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed2c74-44b5-4344-93c6-a9ae45f9f454 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:08.102298 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed2c74-44b5-4344-93c6-a9ae45f9f454 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:08.103121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed2c74-44b5-4344-93c6-a9ae45f9f454 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:08.103423 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed2c74-44b5-4344-93c6-a9ae45f9f454 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:08.104862 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed2c74-44b5-4344-93c6-a9ae45f9f454 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:08.121339 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 600/1213] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jul 5 12:45:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:08.127120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1477aa-4661-4a81-b703-ab9e95f905a3 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:08.225763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1477aa-4661-4a81-b703-ab9e95f905a3 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:08.258495 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb6a3c-868a-4145-951f-6abe84210cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:08.259131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb6a3c-868a-4145-951f-6abe84210cdd None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:08.259413 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb6a3c-868a-4145-951f-6abe84210cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:08.259689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb6a3c-868a-4145-951f-6abe84210cdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:08.289308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:08.325530 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb6a3c-868a-4145-951f-6abe84210cdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:08.326983 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb6a3c-868a-4145-951f-6abe84210cdd None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:08.420385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 614/1214] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:45:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:45:08.426219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed2c74-44b5-4344-93c6-a9ae45f9f454 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:08.445237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:08.525079 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed2c74-44b5-4344-93c6-a9ae45f9f454 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:08.558344 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29239b03-4ee9-4361-b4fb-61c44ab97fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:08.559132 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29239b03-4ee9-4361-b4fb-61c44ab97fed None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:08.559420 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29239b03-4ee9-4361-b4fb-61c44ab97fed None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:08.559760 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29239b03-4ee9-4361-b4fb-61c44ab97fed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:08.570173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29239b03-4ee9-4361-b4fb-61c44ab97fed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:08.571603 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29239b03-4ee9-4361-b4fb-61c44ab97fed None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:08.589447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-29239b03-4ee9-4361-b4fb-61c44ab97fed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:08.589447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:08.589447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:08.589447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:08.589447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:08.589447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:08.589447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:08.589447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:08.589447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:08.589447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:08.589447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:08.589447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:08.589447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:45:08.589447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:45:08.589447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:45:08.590545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:45:08.590545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:08.590545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:08.590545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:08.590545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:08.590545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:08.590545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:08.590545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:08.590545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:08.590545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:08.590545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:08.590545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:08.590545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:08.590545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:08.590545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:08.590545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:08.590545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:08.591649 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:45:08.591649 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:45:08.591649 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:08.591649 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:45:08.591649 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 601/1215] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:08.596390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb6a3c-868a-4145-951f-6abe84210cdd None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:08.657259 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:08.695349 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb6a3c-868a-4145-951f-6abe84210cdd None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:08.726835 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc6d19-bd29-4a5a-8496-f2cd913c3fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:08.728252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc6d19-bd29-4a5a-8496-f2cd913c3fbe None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:08.728252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc6d19-bd29-4a5a-8496-f2cd913c3fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:08.728252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc6d19-bd29-4a5a-8496-f2cd913c3fbe None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:08.728789 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc6d19-bd29-4a5a-8496-f2cd913c3fbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:08.729101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc6d19-bd29-4a5a-8496-f2cd913c3fbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:08.730492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc6d19-bd29-4a5a-8496-f2cd913c3fbe None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:08.742355 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 615/1216] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:08.748059 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29239b03-4ee9-4361-b4fb-61c44ab97fed None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:08.817630 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:08.847321 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29239b03-4ee9-4361-b4fb-61c44ab97fed None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:08.880151 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50086800-3d90-4af8-b174-9f1a50d4d9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:08.882935 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50086800-3d90-4af8-b174-9f1a50d4d9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:08.882935 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50086800-3d90-4af8-b174-9f1a50d4d9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:08.882935 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50086800-3d90-4af8-b174-9f1a50d4d9d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:08.888393 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50086800-3d90-4af8-b174-9f1a50d4d9d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:08.889876 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50086800-3d90-4af8-b174-9f1a50d4d9d7 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:08.905329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-50086800-3d90-4af8-b174-9f1a50d4d9d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:45:08.905329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:08.905329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:08.905329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:08.905329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:08.905329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:08.905329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:08.905329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:08.905329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:08.905329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:08.905329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:08.905329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:08.905329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:45:08.905329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:45:08.905329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:45:08.906415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:45:08.906415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:08.906415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:08.906415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:08.906415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:08.906415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:08.906415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:08.906415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:08.906415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:08.906415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:08.906415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:08.906415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:08.906415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:08.906415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:08.906415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:08.906415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:08.906415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:08.907359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:45:08.907359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:45:08.907359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:45:08.907359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:45:08.907359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:45:08.907359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:45:08.907359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:45:08.907359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:45:08.907359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 602/1217] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:45:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:08.912761 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc6d19-bd29-4a5a-8496-f2cd913c3fbe None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:09.013553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc6d19-bd29-4a5a-8496-f2cd913c3fbe None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:09.035265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:09.047289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0defee-a98a-4801-a7cc-45cd997bf758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:09.058042 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0defee-a98a-4801-a7cc-45cd997bf758 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:09.058042 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0defee-a98a-4801-a7cc-45cd997bf758 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:09.058042 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0defee-a98a-4801-a7cc-45cd997bf758 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:09.058042 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0defee-a98a-4801-a7cc-45cd997bf758 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:09.058042 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0defee-a98a-4801-a7cc-45cd997bf758 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:09.058042 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0defee-a98a-4801-a7cc-45cd997bf758 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:09.065517 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 616/1218] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:45:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:09.069677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50086800-3d90-4af8-b174-9f1a50d4d9d7 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:09.167691 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50086800-3d90-4af8-b174-9f1a50d4d9d7 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:09.195338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:09.200922 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15863a96-942c-4629-afc8-eef7fbee7f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:09.201563 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15863a96-942c-4629-afc8-eef7fbee7f4f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:09.201847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15863a96-942c-4629-afc8-eef7fbee7f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:09.202125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15863a96-942c-4629-afc8-eef7fbee7f4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:09.202939 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15863a96-942c-4629-afc8-eef7fbee7f4f None admin] RBAC: Adding query filter params (role.id=fb140b8a852547a5b8f339dce8d3440e, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=43b85b5c7b1e4d73b29fb96f4fa6db71) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:09.203250 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15863a96-942c-4629-afc8-eef7fbee7f4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:09.204696 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15863a96-942c-4629-afc8-eef7fbee7f4f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:09.209976 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 603/1219] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:45:09 2022] GET /identity/v3/role_assignments?user.id=43b85b5c7b1e4d73b29fb96f4fa6db71&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=fb140b8a852547a5b8f339dce8d3440e => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:11.190226 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad361ec-37ba-48dc-9aa8-5bbf0c40c1dd None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:11.190757 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad361ec-37ba-48dc-9aa8-5bbf0c40c1dd None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:11.190867 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad361ec-37ba-48dc-9aa8-5bbf0c40c1dd None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:11.192151 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 617/1220] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:45:11.197977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fbae1-3e12-4dd6-848d-34338d8e2136 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:11.198389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fbae1-3e12-4dd6-848d-34338d8e2136 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:11.198536 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fbae1-3e12-4dd6-848d-34338d8e2136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:11.215786 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e74fbae1-3e12-4dd6-848d-34338d8e2136 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:45:11.217511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e74fbae1-3e12-4dd6-848d-34338d8e2136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:45:11.282478 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 604/1221] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:45:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:45:11.305197 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad361ec-37ba-48dc-9aa8-5bbf0c40c1dd None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:11.403998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad361ec-37ba-48dc-9aa8-5bbf0c40c1dd None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:11.436054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3b512-f48d-424c-ac69-ee5a873c5bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:11.436864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3b512-f48d-424c-ac69-ee5a873c5bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:11.437149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3b512-f48d-424c-ac69-ee5a873c5bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:11.437428 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3b512-f48d-424c-ac69-ee5a873c5bb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:11.447732 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3b512-f48d-424c-ac69-ee5a873c5bb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:45:11.455393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-eca3b512-f48d-424c-ac69-ee5a873c5bb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:45:11.455393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:11.455393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:11.455393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:11.455393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:11.455393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:11.455393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:11.455393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:11.455393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:11.455393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:11.455393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:11.455393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:11.455393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:45:11.455393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:45:11.455393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:45:11.455393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:45:11.456521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:45:11.456521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:45:11.456521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:45:11.456521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:45:11.456521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:11.456521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:11.456521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:11.456521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:11.456521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:11.456521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:11.456521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:11.456521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:11.456521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:11.456521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:11.456521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:11.456521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:11.457392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:11.457392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:11.457392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:11.457392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:11.457392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:45:11.457392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:45:11.457392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:45:11.457392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:45:11.457392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:45:11.457392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:45:11.457392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:45:11.457392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:11.457392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 618/1222] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:45:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:11.463393 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fbae1-3e12-4dd6-848d-34338d8e2136 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:11.559544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fbae1-3e12-4dd6-848d-34338d8e2136 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:11.582380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:11.592683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bce0ba-8898-4508-aecd-991ab382a2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:11.593342 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bce0ba-8898-4508-aecd-991ab382a2cc None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:11.593627 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bce0ba-8898-4508-aecd-991ab382a2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:11.593904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bce0ba-8898-4508-aecd-991ab382a2cc None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:11.594640 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bce0ba-8898-4508-aecd-991ab382a2cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:11.594991 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bce0ba-8898-4508-aecd-991ab382a2cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:11.596352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bce0ba-8898-4508-aecd-991ab382a2cc None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:11.604253 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 605/1223] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jul 5 12:45:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:11.609956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3b512-f48d-424c-ac69-ee5a873c5bb1 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:11.652518 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:11.706393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3b512-f48d-424c-ac69-ee5a873c5bb1 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:11.738123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8375d1-18cf-45f7-9ec4-00d115671c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:11.738899 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8375d1-18cf-45f7-9ec4-00d115671c56 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:11.739183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8375d1-18cf-45f7-9ec4-00d115671c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:11.739462 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8375d1-18cf-45f7-9ec4-00d115671c56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:11.750051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8375d1-18cf-45f7-9ec4-00d115671c56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:11.751532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8375d1-18cf-45f7-9ec4-00d115671c56 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:11.768500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-9c8375d1-18cf-45f7-9ec4-00d115671c56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:11.768500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:11.768500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:11.768500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:11.768500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:11.768500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:11.768500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:11.768500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:11.768500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:11.768500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:11.768500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:11.768500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:11.768500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:45:11.768500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:45:11.768500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:45:11.769420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:45:11.769420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:11.769420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:11.769420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:11.769420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:11.769420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:11.769420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:11.769420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:11.769420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:11.769420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:11.769420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:11.769420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:11.769420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:11.769420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:11.769420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:11.769420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:11.769420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:11.770352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:45:11.770352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:45:11.770352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:11.770352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:11.770352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 619/1224] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:11.775539 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bce0ba-8898-4508-aecd-991ab382a2cc None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:11.872974 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bce0ba-8898-4508-aecd-991ab382a2cc None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:11.906013 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c9636-2c05-4771-a6e1-0bc3db34be5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:11.906668 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c9636-2c05-4771-a6e1-0bc3db34be5a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:11.906953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c9636-2c05-4771-a6e1-0bc3db34be5a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:11.907230 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c9636-2c05-4771-a6e1-0bc3db34be5a None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:11.907948 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c9636-2c05-4771-a6e1-0bc3db34be5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:11.908258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c9636-2c05-4771-a6e1-0bc3db34be5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:11.909661 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c9636-2c05-4771-a6e1-0bc3db34be5a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:11.921027 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 606/1225] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:11.926968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8375d1-18cf-45f7-9ec4-00d115671c56 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:12.024257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:12.030733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8375d1-18cf-45f7-9ec4-00d115671c56 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:12.064490 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7004d90-1ec2-4c82-be2b-e2129d811850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:12.065151 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7004d90-1ec2-4c82-be2b-e2129d811850 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:12.065433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7004d90-1ec2-4c82-be2b-e2129d811850 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:12.065712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7004d90-1ec2-4c82-be2b-e2129d811850 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:12.072660 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7004d90-1ec2-4c82-be2b-e2129d811850 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:12.074110 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7004d90-1ec2-4c82-be2b-e2129d811850 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:12.088305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-b7004d90-1ec2-4c82-be2b-e2129d811850 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:45:12.088305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:12.088305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:12.088305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:12.088305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:12.088305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:12.088305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:12.088305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:12.088305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:12.088305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:12.088305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:12.088305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:12.088305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:45:12.088305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:45:12.088305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:45:12.088305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:45:12.089421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:12.089421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:12.089421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:45:12.089421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:45:12.089421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:45:12.089421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:45:12.089421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:12.089421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:12.089421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:12.089421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:12.089421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:12.089421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:12.089421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:12.089421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:12.089421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:12.089421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:12.089421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:12.089421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:12.090403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:12.090403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:12.090403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:45:12.090403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:45:12.090403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:45:12.090403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:45:12.090403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:45:12.090403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:45:12.090403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:45:12.090403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:12.090403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 620/1226] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:45:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:12.095461 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c9636-2c05-4771-a6e1-0bc3db34be5a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:12.143349 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:12.194274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c9636-2c05-4771-a6e1-0bc3db34be5a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:12.226773 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927db47c-a254-46b6-9df6-d853a006b891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:12.227429 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927db47c-a254-46b6-9df6-d853a006b891 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:12.227713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927db47c-a254-46b6-9df6-d853a006b891 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:12.227990 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927db47c-a254-46b6-9df6-d853a006b891 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:12.228847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927db47c-a254-46b6-9df6-d853a006b891 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:12.229176 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927db47c-a254-46b6-9df6-d853a006b891 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:12.231148 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927db47c-a254-46b6-9df6-d853a006b891 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:12.249229 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 607/1227] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jul 5 12:45:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:12.254896 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7004d90-1ec2-4c82-be2b-e2129d811850 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:12.352602 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7004d90-1ec2-4c82-be2b-e2129d811850 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:12.385478 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d4ace-3f2c-4df2-b4ee-ace0b91c7b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:12.386259 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d4ace-3f2c-4df2-b4ee-ace0b91c7b36 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:12.386535 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d4ace-3f2c-4df2-b4ee-ace0b91c7b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:12.386805 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d4ace-3f2c-4df2-b4ee-ace0b91c7b36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:12.396540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d4ace-3f2c-4df2-b4ee-ace0b91c7b36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:12.398573 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d4ace-3f2c-4df2-b4ee-ace0b91c7b36 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:12.416304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-379d4ace-3f2c-4df2-b4ee-ace0b91c7b36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:12.416304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:12.416304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:12.416304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:12.416304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:12.416304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:12.416304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:12.416304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:12.416304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:12.416304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:12.416304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:12.416304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:12.416304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:45:12.416304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:45:12.416304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:45:12.417329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:45:12.417329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:12.417329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:12.417329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:12.417329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:12.417329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:12.417329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:12.417329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:12.417329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:12.417329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:12.417329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:12.417329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:12.417329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:12.417329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:12.417329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:12.417329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:12.417329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:12.418400 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:45:12.418400 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:45:12.418400 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:12.418400 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:12.418400 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 621/1228] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:12.423295 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927db47c-a254-46b6-9df6-d853a006b891 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:12.520213 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927db47c-a254-46b6-9df6-d853a006b891 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:12.523019 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:12.553728 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c848ab2-3bab-42d1-b3aa-a2761957798a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:12.554411 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c848ab2-3bab-42d1-b3aa-a2761957798a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:12.554695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c848ab2-3bab-42d1-b3aa-a2761957798a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:12.554969 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c848ab2-3bab-42d1-b3aa-a2761957798a None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:12.555686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c848ab2-3bab-42d1-b3aa-a2761957798a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:12.555996 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c848ab2-3bab-42d1-b3aa-a2761957798a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:12.557391 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c848ab2-3bab-42d1-b3aa-a2761957798a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:12.568227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 608/1229] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:45:12.573875 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d4ace-3f2c-4df2-b4ee-ace0b91c7b36 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:12.582592 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:12.670553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d4ace-3f2c-4df2-b4ee-ace0b91c7b36 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:12.702499 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a98d9-1dca-4878-a6ca-96d4a5ace9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:12.703275 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a98d9-1dca-4878-a6ca-96d4a5ace9cc None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:12.703551 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a98d9-1dca-4878-a6ca-96d4a5ace9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:12.703864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a98d9-1dca-4878-a6ca-96d4a5ace9cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:12.711712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a98d9-1dca-4878-a6ca-96d4a5ace9cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:12.713176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a98d9-1dca-4878-a6ca-96d4a5ace9cc None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:12.727086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-de8a98d9-1dca-4878-a6ca-96d4a5ace9cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:45:12.727086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:12.727086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:12.727086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:12.727086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:12.727086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:12.727086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:12.727086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:12.727086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:12.727086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:12.727086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:12.727086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:12.727086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:45:12.727086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:45:12.727086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:45:12.728155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:45:12.728155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:12.728155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:12.728155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:12.728155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:12.728155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:12.728155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:12.728155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:12.728155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:12.728155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:12.728155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:12.728155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:12.728155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:12.728155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:12.728155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:12.728155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:12.728155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:12.729293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:45:12.729293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:45:12.729293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:45:12.729293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:45:12.729293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:45:12.729293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:45:12.729293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:45:12.729293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:12.729293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 622/1230] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:45:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:12.734001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c848ab2-3bab-42d1-b3aa-a2761957798a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:12.831404 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c848ab2-3bab-42d1-b3aa-a2761957798a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:12.864981 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e8e7c-b0c8-47bd-a80e-1dd8ddef7222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:12.865642 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e8e7c-b0c8-47bd-a80e-1dd8ddef7222 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:12.865929 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e8e7c-b0c8-47bd-a80e-1dd8ddef7222 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:12.866210 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e8e7c-b0c8-47bd-a80e-1dd8ddef7222 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:12.867002 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e8e7c-b0c8-47bd-a80e-1dd8ddef7222 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:12.867311 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e8e7c-b0c8-47bd-a80e-1dd8ddef7222 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:12.868764 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e8e7c-b0c8-47bd-a80e-1dd8ddef7222 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:12.880741 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 609/1231] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:45:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:12.887300 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a98d9-1dca-4878-a6ca-96d4a5ace9cc None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:12.951507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:12.984532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a98d9-1dca-4878-a6ca-96d4a5ace9cc None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:13.017102 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba75e3a-a483-4729-8136-5272dbe33ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:13.018044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba75e3a-a483-4729-8136-5272dbe33ad6 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:13.018366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba75e3a-a483-4729-8136-5272dbe33ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:13.018641 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba75e3a-a483-4729-8136-5272dbe33ad6 None admin] PATH_INFO: `/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/43b85b5c7b1e4d73b29fb96f4fa6db71/roles/fb140b8a852547a5b8f339dce8d3440e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:13.032854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba75e3a-a483-4729-8136-5272dbe33ad6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4190347294b48c096d7aa9d3a479d12, user_id=43b85b5c7b1e4d73b29fb96f4fa6db71, role_id=fb140b8a852547a5b8f339dce8d3440e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:13.034305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba75e3a-a483-4729-8136-5272dbe33ad6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:13.207337 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 623/1232] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:45:12 2022] PUT /identity/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/43b85b5c7b1e4d73b29fb96f4fa6db71/roles/fb140b8a852547a5b8f339dce8d3440e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:45:15.183985 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc7e28-fc8c-4bfc-adf9-76e684c1c5d9 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:15.184554 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc7e28-fc8c-4bfc-adf9-76e684c1c5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:15.184554 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc7e28-fc8c-4bfc-adf9-76e684c1c5d9 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:15.185919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 610/1233] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:45:15.190992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e328c2-78a3-4564-b960-43e5947323f9 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:15.191418 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e328c2-78a3-4564-b960-43e5947323f9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:15.191551 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e328c2-78a3-4564-b960-43e5947323f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:15.208526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-51e328c2-78a3-4564-b960-43e5947323f9 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:45:15.211261 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-51e328c2-78a3-4564-b960-43e5947323f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:45:15.273961 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 624/1234] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:45:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:45:15.297965 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc7e28-fc8c-4bfc-adf9-76e684c1c5d9 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:15.323209 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:15.396224 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc7e28-fc8c-4bfc-adf9-76e684c1c5d9 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:15.430876 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66e697-cc2a-4369-a503-03b5bfcb4b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:15.431653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66e697-cc2a-4369-a503-03b5bfcb4b8e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:15.431935 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66e697-cc2a-4369-a503-03b5bfcb4b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:15.432207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66e697-cc2a-4369-a503-03b5bfcb4b8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:15.441936 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a66e697-cc2a-4369-a503-03b5bfcb4b8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:45:15.449531 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-3a66e697-cc2a-4369-a503-03b5bfcb4b8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:45:15.449531 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:15.449531 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:15.449531 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:15.449531 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:15.449531 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:15.449531 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:15.449531 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:15.449531 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:15.449531 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:15.449531 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:15.449531 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:15.449531 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:45:15.449531 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:45:15.449531 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:45:15.449531 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:45:15.450606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:45:15.450606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:45:15.450606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:45:15.450606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:45:15.450606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:15.450606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:15.450606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:15.450606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:15.450606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:15.450606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:15.450606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:15.450606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:15.450606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:15.450606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:15.450606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:15.450606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:15.451933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:15.451933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:15.451933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:15.451933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:15.451933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:45:15.451933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:45:15.451933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:45:15.451933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:45:15.451933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:45:15.451933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:45:15.451933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 12:45:15.451933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:45:15.451933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 611/1235] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jul 5 12:45:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:15.456716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e328c2-78a3-4564-b960-43e5947323f9 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:15.502062 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:15.552299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e328c2-78a3-4564-b960-43e5947323f9 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:15.584469 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e14cf0-7dea-4904-80c6-db739e8ed0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:15.585119 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e14cf0-7dea-4904-80c6-db739e8ed0ce None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:15.585399 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e14cf0-7dea-4904-80c6-db739e8ed0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:15.585672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e14cf0-7dea-4904-80c6-db739e8ed0ce None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:15.586411 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e14cf0-7dea-4904-80c6-db739e8ed0ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:15.586718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e14cf0-7dea-4904-80c6-db739e8ed0ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:15.588080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e14cf0-7dea-4904-80c6-db739e8ed0ce None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:15.595667 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 625/1236] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jul 5 12:45:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:15.602118 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66e697-cc2a-4369-a503-03b5bfcb4b8e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:15.687544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:15.703660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66e697-cc2a-4369-a503-03b5bfcb4b8e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:15.736497 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cea1f3-cf07-4f45-b5fb-eacfd8ba0729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:15.737307 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cea1f3-cf07-4f45-b5fb-eacfd8ba0729 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:15.737629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cea1f3-cf07-4f45-b5fb-eacfd8ba0729 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:15.737907 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cea1f3-cf07-4f45-b5fb-eacfd8ba0729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:15.748898 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cea1f3-cf07-4f45-b5fb-eacfd8ba0729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:15.750329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cea1f3-cf07-4f45-b5fb-eacfd8ba0729 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:15.767232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-b5cea1f3-cf07-4f45-b5fb-eacfd8ba0729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:15.767232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:15.767232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:15.767232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:15.767232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:15.767232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:15.767232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:15.767232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:15.767232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:15.767232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:15.767232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:15.767232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:15.767232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:45:15.767232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:45:15.767232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:45:15.768102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:45:15.768102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:15.768102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:15.768102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:15.768102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:15.768102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:15.768102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:15.768102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:15.768102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:15.768102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:15.768102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:15.768102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:15.768102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:15.768102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:15.768102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:15.768102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:15.768102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:15.769301 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:45:15.769301 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:45:15.769301 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:15.769301 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:45:15.769301 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 612/1237] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:15.774857 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e14cf0-7dea-4904-80c6-db739e8ed0ce None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:15.872010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e14cf0-7dea-4904-80c6-db739e8ed0ce None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:15.880544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:15.905903 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fc3a9-e001-439b-8ede-d0ae381b6aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:15.906565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fc3a9-e001-439b-8ede-d0ae381b6aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:15.906847 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fc3a9-e001-439b-8ede-d0ae381b6aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:15.907122 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fc3a9-e001-439b-8ede-d0ae381b6aa0 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:15.907863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fc3a9-e001-439b-8ede-d0ae381b6aa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:15.908167 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fc3a9-e001-439b-8ede-d0ae381b6aa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:15.909557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fc3a9-e001-439b-8ede-d0ae381b6aa0 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:15.921188 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 626/1238] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:15.926484 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cea1f3-cf07-4f45-b5fb-eacfd8ba0729 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:16.026282 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cea1f3-cf07-4f45-b5fb-eacfd8ba0729 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:16.061698 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20188749-8cbc-4102-9276-41c751841f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:16.062505 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20188749-8cbc-4102-9276-41c751841f65 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:16.062786 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20188749-8cbc-4102-9276-41c751841f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:16.063070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20188749-8cbc-4102-9276-41c751841f65 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:16.065902 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:16.071699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20188749-8cbc-4102-9276-41c751841f65 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:16.073181 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20188749-8cbc-4102-9276-41c751841f65 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:16.087076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-20188749-8cbc-4102-9276-41c751841f65 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:45:16.087076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:16.087076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:16.087076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:16.087076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:16.087076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:16.087076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:16.087076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:16.087076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:16.087076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:16.087076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:16.087076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:16.087076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:45:16.087076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:45:16.087076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:45:16.087076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:45:16.088183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:16.088183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:16.088183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:45:16.088183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:45:16.088183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:45:16.088183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:45:16.088183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:16.088183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:16.088183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:16.088183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:16.088183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:16.088183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:16.088183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:16.088183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:16.088183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:16.088183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:16.088183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:16.088183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:16.089197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:16.089197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:16.089197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:45:16.089197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:45:16.089197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:45:16.089197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:45:16.089197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:45:16.089197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:45:16.089197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:45:16.089197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:45:16.089197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 613/1239] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:45:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:16.094131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fc3a9-e001-439b-8ede-d0ae381b6aa0 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:16.193225 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fc3a9-e001-439b-8ede-d0ae381b6aa0 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:16.227102 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f3496-2b3c-4c0b-a33f-9af3a8d40bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:16.227770 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f3496-2b3c-4c0b-a33f-9af3a8d40bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:16.228050 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f3496-2b3c-4c0b-a33f-9af3a8d40bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:16.228324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f3496-2b3c-4c0b-a33f-9af3a8d40bf6 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:16.229181 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f3496-2b3c-4c0b-a33f-9af3a8d40bf6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:16.229490 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f3496-2b3c-4c0b-a33f-9af3a8d40bf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:16.230913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f3496-2b3c-4c0b-a33f-9af3a8d40bf6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:16.247834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 627/1240] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jul 5 12:45:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:16.253605 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20188749-8cbc-4102-9276-41c751841f65 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:16.364818 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20188749-8cbc-4102-9276-41c751841f65 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:16.398050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890762d-f4c8-4ebd-9207-3507fab2ee94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:16.398685 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890762d-f4c8-4ebd-9207-3507fab2ee94 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:16.398965 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890762d-f4c8-4ebd-9207-3507fab2ee94 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:16.399238 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890762d-f4c8-4ebd-9207-3507fab2ee94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:16.458433 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:16.464778 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890762d-f4c8-4ebd-9207-3507fab2ee94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:16.466230 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890762d-f4c8-4ebd-9207-3507fab2ee94 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:16.562257 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 614/1241] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:45:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 12:45:16.568055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f3496-2b3c-4c0b-a33f-9af3a8d40bf6 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:16.594539 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:16.669119 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f3496-2b3c-4c0b-a33f-9af3a8d40bf6 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:16.707957 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf7696-f482-443a-9be1-14aa6ad985b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:16.708847 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf7696-f482-443a-9be1-14aa6ad985b1 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:16.709081 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf7696-f482-443a-9be1-14aa6ad985b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:16.709359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf7696-f482-443a-9be1-14aa6ad985b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:16.719228 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf7696-f482-443a-9be1-14aa6ad985b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:16.720721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf7696-f482-443a-9be1-14aa6ad985b1 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:16.738658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-dacf7696-f482-443a-9be1-14aa6ad985b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:16.738658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:16.738658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:16.738658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:16.738658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:16.738658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:16.738658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:16.738658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:16.738658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:16.738658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:16.738658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:16.738658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:16.738658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:45:16.738658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:45:16.738658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:45:16.739704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:45:16.739704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:16.739704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:16.739704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:16.739704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:16.739704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:16.739704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:16.739704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:16.739704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:16.739704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:16.739704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:16.739704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:16.739704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:16.739704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:16.739704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:16.739704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:16.739704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:16.741324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:45:16.741324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:45:16.741324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:16.741324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:16.741324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 628/1242] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:16.746115 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890762d-f4c8-4ebd-9207-3507fab2ee94 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:16.838182 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:16.843865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890762d-f4c8-4ebd-9207-3507fab2ee94 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:16.877611 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14d437-092d-49df-8328-2a5c2a64fc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:16.878261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14d437-092d-49df-8328-2a5c2a64fc16 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:16.878542 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14d437-092d-49df-8328-2a5c2a64fc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:16.878822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14d437-092d-49df-8328-2a5c2a64fc16 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:16.879532 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14d437-092d-49df-8328-2a5c2a64fc16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:16.879836 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14d437-092d-49df-8328-2a5c2a64fc16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:16.881276 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14d437-092d-49df-8328-2a5c2a64fc16 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:16.892431 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 615/1243] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:16.898790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf7696-f482-443a-9be1-14aa6ad985b1 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:16.984227 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:17.005597 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf7696-f482-443a-9be1-14aa6ad985b1 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:17.039897 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46300b72-0c2f-4ac2-96a4-e6845c5df8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:17.040775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46300b72-0c2f-4ac2-96a4-e6845c5df8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:17.041217 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46300b72-0c2f-4ac2-96a4-e6845c5df8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:17.041502 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46300b72-0c2f-4ac2-96a4-e6845c5df8b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:17.048151 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46300b72-0c2f-4ac2-96a4-e6845c5df8b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:17.049630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46300b72-0c2f-4ac2-96a4-e6845c5df8b2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:17.063357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-46300b72-0c2f-4ac2-96a4-e6845c5df8b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:45:17.063357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:17.063357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:17.063357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:17.063357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:17.063357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:17.063357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:17.063357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:17.063357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:17.063357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:17.063357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:17.063357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:17.063357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:45:17.063357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:45:17.063357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:45:17.064332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:45:17.064332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:17.064332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:17.064332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:17.064332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:17.064332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:17.064332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:17.064332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:17.064332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:17.064332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:17.064332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:17.064332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:17.064332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:17.064332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:17.064332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:17.064332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:17.064332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:17.065836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:45:17.065836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:45:17.065836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:45:17.065836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:45:17.065836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:45:17.065836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:45:17.065836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:45:17.065836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:17.065836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 629/1244] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:45:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:17.070624 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14d437-092d-49df-8328-2a5c2a64fc16 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:17.169050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14d437-092d-49df-8328-2a5c2a64fc16 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:17.201482 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eba375-df52-4fe6-8802-406b5ebb0d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:17.202160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eba375-df52-4fe6-8802-406b5ebb0d9a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:17.202439 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eba375-df52-4fe6-8802-406b5ebb0d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:17.202711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eba375-df52-4fe6-8802-406b5ebb0d9a None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:17.203498 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eba375-df52-4fe6-8802-406b5ebb0d9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:17.203804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eba375-df52-4fe6-8802-406b5ebb0d9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:17.205291 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eba375-df52-4fe6-8802-406b5ebb0d9a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:17.217838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 616/1245] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:45:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:17.224063 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46300b72-0c2f-4ac2-96a4-e6845c5df8b2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:17.319760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46300b72-0c2f-4ac2-96a4-e6845c5df8b2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:17.352372 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3ae54-2fef-4bf0-830d-0429fa4d6502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:17.353047 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3ae54-2fef-4bf0-830d-0429fa4d6502 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:17.353354 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3ae54-2fef-4bf0-830d-0429fa4d6502 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:17.353593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3ae54-2fef-4bf0-830d-0429fa4d6502 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:17.354414 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3ae54-2fef-4bf0-830d-0429fa4d6502 None admin] RBAC: Adding query filter params (role.id=fb140b8a852547a5b8f339dce8d3440e, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=43b85b5c7b1e4d73b29fb96f4fa6db71) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:17.354722 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3ae54-2fef-4bf0-830d-0429fa4d6502 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:17.356145 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3ae54-2fef-4bf0-830d-0429fa4d6502 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:17.361839 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 630/1246] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:45:17 2022] GET /identity/v3/role_assignments?user.id=43b85b5c7b1e4d73b29fb96f4fa6db71&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=fb140b8a852547a5b8f339dce8d3440e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:19.405037 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe45bd6-f360-4a65-8572-0ed27e69292a None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:19.405585 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe45bd6-f360-4a65-8572-0ed27e69292a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:19.405585 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe45bd6-f360-4a65-8572-0ed27e69292a None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:19.406902 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 617/1247] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:45:19.412492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30e3ed-b728-4634-ba74-84fa285fced2 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:19.412933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30e3ed-b728-4634-ba74-84fa285fced2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:19.413083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30e3ed-b728-4634-ba74-84fa285fced2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:19.418040 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:19.429775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-2c30e3ed-b728-4634-ba74-84fa285fced2 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:45:19.430972 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2c30e3ed-b728-4634-ba74-84fa285fced2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:45:19.495372 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 631/1248] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:45:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:45:19.519209 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe45bd6-f360-4a65-8572-0ed27e69292a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:19.537454 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:19.617765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe45bd6-f360-4a65-8572-0ed27e69292a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:19.656512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732817d-f068-4c65-9947-77d58d9ac25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:19.657276 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732817d-f068-4c65-9947-77d58d9ac25a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:19.657557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732817d-f068-4c65-9947-77d58d9ac25a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:19.657836 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732817d-f068-4c65-9947-77d58d9ac25a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:19.667903 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732817d-f068-4c65-9947-77d58d9ac25a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:45:19.675464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-b732817d-f068-4c65-9947-77d58d9ac25a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:45:19.675464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:19.675464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:19.675464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:19.675464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:19.675464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:19.675464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:19.675464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:19.675464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:19.675464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:19.675464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:19.675464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:19.675464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:45:19.675464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:45:19.675464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:45:19.675464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:45:19.678012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:45:19.678012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:45:19.678012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:45:19.678012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:45:19.678012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:19.678012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:19.678012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:19.678012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:19.678012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:19.678012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:19.678012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:19.678012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:19.678012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:19.678012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:19.678012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:19.678012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:19.679038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:19.679038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:19.679038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:19.679038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:19.679038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:45:19.679038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:45:19.679038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:45:19.679038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:45:19.679038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:45:19.679038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:45:19.679038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:45:19.679038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:45:19.679038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 618/1249] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:45:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:19.682649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30e3ed-b728-4634-ba74-84fa285fced2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:19.779789 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30e3ed-b728-4634-ba74-84fa285fced2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:19.808250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:19.812833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d23ea-1c21-46cf-8139-8d55cfa8b71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:19.813501 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d23ea-1c21-46cf-8139-8d55cfa8b71a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:19.813779 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d23ea-1c21-46cf-8139-8d55cfa8b71a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:19.814072 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d23ea-1c21-46cf-8139-8d55cfa8b71a None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:19.814800 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d23ea-1c21-46cf-8139-8d55cfa8b71a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:19.815104 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d23ea-1c21-46cf-8139-8d55cfa8b71a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:19.816497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d23ea-1c21-46cf-8139-8d55cfa8b71a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:19.824938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 632/1250] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:45:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:19.830816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732817d-f068-4c65-9947-77d58d9ac25a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:19.907224 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:19.929661 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732817d-f068-4c65-9947-77d58d9ac25a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:19.964807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43526a6a-d7aa-432d-8900-df7a007588ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:19.965638 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43526a6a-d7aa-432d-8900-df7a007588ad None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:19.965917 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43526a6a-d7aa-432d-8900-df7a007588ad None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:19.966188 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43526a6a-d7aa-432d-8900-df7a007588ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:19.976718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43526a6a-d7aa-432d-8900-df7a007588ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:19.978191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43526a6a-d7aa-432d-8900-df7a007588ad None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:19.995177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-43526a6a-d7aa-432d-8900-df7a007588ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:19.995177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:19.995177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:19.995177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:19.995177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:19.995177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:19.995177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:19.995177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:19.995177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:19.995177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:19.995177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:19.995177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:19.995177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:45:19.995177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:45:19.995177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:45:19.996190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:45:19.996190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:19.996190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:19.996190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:19.996190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:19.996190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:19.996190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:19.996190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:19.996190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:19.996190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:19.996190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:19.996190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:19.996190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:19.996190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:19.996190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:19.996190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:19.996190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:19.997397 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:45:19.997397 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:45:19.997397 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:19.997397 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:45:19.997397 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 619/1251] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:20.003791 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d23ea-1c21-46cf-8139-8d55cfa8b71a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:20.110293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d23ea-1c21-46cf-8139-8d55cfa8b71a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:20.143442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85037d12-4951-4087-946c-c0d5fb1c4839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:20.144102 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85037d12-4951-4087-946c-c0d5fb1c4839 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:20.144389 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85037d12-4951-4087-946c-c0d5fb1c4839 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:20.144692 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85037d12-4951-4087-946c-c0d5fb1c4839 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:20.145410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85037d12-4951-4087-946c-c0d5fb1c4839 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:20.145740 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85037d12-4951-4087-946c-c0d5fb1c4839 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:20.147603 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85037d12-4951-4087-946c-c0d5fb1c4839 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:20.159576 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 633/1252] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:20.165761 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43526a6a-d7aa-432d-8900-df7a007588ad None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:20.263082 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43526a6a-d7aa-432d-8900-df7a007588ad None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:20.289307 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:20.296720 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a16c4c-79ca-4092-894c-89da03b40139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:20.297511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a16c4c-79ca-4092-894c-89da03b40139 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:20.297790 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a16c4c-79ca-4092-894c-89da03b40139 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:20.298058 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a16c4c-79ca-4092-894c-89da03b40139 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:20.305291 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a16c4c-79ca-4092-894c-89da03b40139 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:20.306712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a16c4c-79ca-4092-894c-89da03b40139 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:20.321110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-f3a16c4c-79ca-4092-894c-89da03b40139 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:45:20.321110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:20.321110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:20.321110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:20.321110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:20.321110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:20.321110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:20.321110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:20.321110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:20.321110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:20.321110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:20.321110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:20.321110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:45:20.321110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:45:20.321110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:45:20.321110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:45:20.330544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:20.330544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:20.330544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:45:20.330544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:45:20.330544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:45:20.330544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:45:20.330544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:20.330544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:20.330544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:20.330544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:20.330544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:20.330544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:20.330544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:20.330544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:20.330544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:20.330544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:20.330544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:20.330544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:20.331520 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:20.331520 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:20.331520 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:45:20.331520 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:45:20.331520 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:45:20.331520 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:45:20.331520 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:45:20.331520 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:45:20.331520 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:45:20.331520 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:45:20.331520 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 620/1253] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:45:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:20.332116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85037d12-4951-4087-946c-c0d5fb1c4839 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:20.381774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:20.424784 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85037d12-4951-4087-946c-c0d5fb1c4839 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:20.456383 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1a456-8d61-403c-a498-16178854bb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:20.457071 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1a456-8d61-403c-a498-16178854bb27 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:20.457354 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1a456-8d61-403c-a498-16178854bb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:20.457632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1a456-8d61-403c-a498-16178854bb27 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:20.458450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1a456-8d61-403c-a498-16178854bb27 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:20.459358 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1a456-8d61-403c-a498-16178854bb27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:20.461516 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1a456-8d61-403c-a498-16178854bb27 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:20.478079 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 634/1254] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jul 5 12:45:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:20.483930 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a16c4c-79ca-4092-894c-89da03b40139 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:20.581665 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a16c4c-79ca-4092-894c-89da03b40139 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:20.614898 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e47829-e5b8-467d-bac4-852dc43c1300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:20.616210 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e47829-e5b8-467d-bac4-852dc43c1300 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:20.616210 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e47829-e5b8-467d-bac4-852dc43c1300 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:20.616210 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e47829-e5b8-467d-bac4-852dc43c1300 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:20.670635 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:20.682575 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e47829-e5b8-467d-bac4-852dc43c1300 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:20.684006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e47829-e5b8-467d-bac4-852dc43c1300 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:20.778638 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 621/1255] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:45:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:45:20.784325 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1a456-8d61-403c-a498-16178854bb27 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:20.880681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1a456-8d61-403c-a498-16178854bb27 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:20.894027 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:20.915494 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e4084-1efc-4cda-bfe4-0c754ceb731f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:20.916280 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e4084-1efc-4cda-bfe4-0c754ceb731f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:20.916560 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e4084-1efc-4cda-bfe4-0c754ceb731f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:20.916867 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e4084-1efc-4cda-bfe4-0c754ceb731f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:20.926355 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e4084-1efc-4cda-bfe4-0c754ceb731f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:20.927789 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e4084-1efc-4cda-bfe4-0c754ceb731f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:20.945006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-e02e4084-1efc-4cda-bfe4-0c754ceb731f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:20.945006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:20.945006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:20.945006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:20.945006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:20.945006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:20.945006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:20.945006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:20.945006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:20.945006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:20.945006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:20.945006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:20.945006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:45:20.945006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:45:20.945006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:45:20.946080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:45:20.946080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:20.946080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:20.946080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:20.946080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:20.946080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:20.946080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:20.946080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:20.946080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:20.946080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:20.946080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:20.946080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:20.946080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:20.946080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:20.946080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:20.946080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:20.946080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:20.947116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:45:20.947116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:45:20.947116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:20.947116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:20.947116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 635/1256] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:20.952059 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e47829-e5b8-467d-bac4-852dc43c1300 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:21.040411 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:21.052363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e47829-e5b8-467d-bac4-852dc43c1300 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:21.087075 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db5ff4-db4f-4edb-9e16-189f025b0e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:21.087742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db5ff4-db4f-4edb-9e16-189f025b0e1b None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:21.088027 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db5ff4-db4f-4edb-9e16-189f025b0e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:21.088306 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db5ff4-db4f-4edb-9e16-189f025b0e1b None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:21.089067 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db5ff4-db4f-4edb-9e16-189f025b0e1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:21.089380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db5ff4-db4f-4edb-9e16-189f025b0e1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:21.090838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db5ff4-db4f-4edb-9e16-189f025b0e1b None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:21.102111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 622/1257] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:21.110026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e4084-1efc-4cda-bfe4-0c754ceb731f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:21.206028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e4084-1efc-4cda-bfe4-0c754ceb731f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:21.238871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c1365-a639-4714-9b3e-7a5202561eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:21.239652 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c1365-a639-4714-9b3e-7a5202561eba None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:21.239955 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c1365-a639-4714-9b3e-7a5202561eba None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:21.240221 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c1365-a639-4714-9b3e-7a5202561eba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:21.246660 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c1365-a639-4714-9b3e-7a5202561eba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:21.248097 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c1365-a639-4714-9b3e-7a5202561eba None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:21.261917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-367c1365-a639-4714-9b3e-7a5202561eba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:45:21.261917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:21.261917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:21.261917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:21.261917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:21.261917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:21.261917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:21.261917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:21.261917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:21.261917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:21.261917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:21.261917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:21.261917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:45:21.261917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:45:21.261917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:45:21.263020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:45:21.263020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:21.263020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:21.263020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:21.263020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:21.263020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:21.263020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:21.263020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:21.263020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:21.263020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:21.263020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:21.263020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:21.263020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:21.263020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:21.263020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:21.263020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:21.263020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:21.264009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:45:21.264009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:45:21.264009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:45:21.264009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:45:21.264009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:45:21.264009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:45:21.264009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:45:21.264009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:21.264009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 636/1258] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:45:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:21.268917 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db5ff4-db4f-4edb-9e16-189f025b0e1b None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:21.371007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db5ff4-db4f-4edb-9e16-189f025b0e1b None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:21.403802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfeff1-b72f-4f87-922c-9ced67d0a63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:21.404446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfeff1-b72f-4f87-922c-9ced67d0a63e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:21.404761 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfeff1-b72f-4f87-922c-9ced67d0a63e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:21.405042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfeff1-b72f-4f87-922c-9ced67d0a63e None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:21.405880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfeff1-b72f-4f87-922c-9ced67d0a63e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:21.406191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfeff1-b72f-4f87-922c-9ced67d0a63e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:21.407622 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfeff1-b72f-4f87-922c-9ced67d0a63e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:21.419416 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 623/1259] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:45:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:21.425558 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c1365-a639-4714-9b3e-7a5202561eba None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:21.451688 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:21.524569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c1365-a639-4714-9b3e-7a5202561eba None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:21.557618 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9b034-6d3f-44d1-8c47-eb019655cf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:21.558261 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9b034-6d3f-44d1-8c47-eb019655cf01 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:21.558542 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9b034-6d3f-44d1-8c47-eb019655cf01 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:21.558816 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9b034-6d3f-44d1-8c47-eb019655cf01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:21.559637 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9b034-6d3f-44d1-8c47-eb019655cf01 None admin] RBAC: Adding query filter params (role.id=868c7a356c674ded875dd079f5a9f5e0, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=43b85b5c7b1e4d73b29fb96f4fa6db71) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:21.559948 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9b034-6d3f-44d1-8c47-eb019655cf01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:21.561401 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9b034-6d3f-44d1-8c47-eb019655cf01 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:21.566684 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 637/1260] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:45:21 2022] GET /identity/v3/role_assignments?user.id=43b85b5c7b1e4d73b29fb96f4fa6db71&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=868c7a356c674ded875dd079f5a9f5e0 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:23.540416 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b231589-39b6-4ab6-a521-35bc137676e6 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:23.540972 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b231589-39b6-4ab6-a521-35bc137676e6 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:23.541080 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b231589-39b6-4ab6-a521-35bc137676e6 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:23.542386 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 624/1261] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:45:23.547632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1661c-e8f3-4091-9c25-cbf05e7b0d68 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:23.553211 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1661c-e8f3-4091-9c25-cbf05e7b0d68 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:23.553211 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1661c-e8f3-4091-9c25-cbf05e7b0d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:23.565716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-fce1661c-e8f3-4091-9c25-cbf05e7b0d68 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:45:23.566907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-fce1661c-e8f3-4091-9c25-cbf05e7b0d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:45:23.632529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 638/1262] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:45:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:45:23.655128 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b231589-39b6-4ab6-a521-35bc137676e6 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:23.666300 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:23.756692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b231589-39b6-4ab6-a521-35bc137676e6 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:23.790684 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b7591-76e5-4f53-bce5-9e775cce9649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:23.791369 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b7591-76e5-4f53-bce5-9e775cce9649 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:23.791652 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b7591-76e5-4f53-bce5-9e775cce9649 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:23.791927 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b7591-76e5-4f53-bce5-9e775cce9649 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:23.802117 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b7591-76e5-4f53-bce5-9e775cce9649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:45:23.810289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-204b7591-76e5-4f53-bce5-9e775cce9649 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:45:23.810289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:23.810289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:23.810289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:23.810289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:23.810289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:23.810289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:23.810289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:23.810289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:23.810289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:23.810289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:23.810289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:23.810289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:45:23.810289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:45:23.810289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:45:23.810289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:45:23.811511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:45:23.811511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:45:23.811511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:45:23.811511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:45:23.811511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:23.811511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:23.811511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:23.811511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:23.811511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:23.811511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:23.811511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:23.811511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:23.811511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:23.811511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:23.811511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:23.811511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:23.812401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:23.812401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:23.812401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:23.812401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:23.812401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:45:23.812401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:45:23.812401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:45:23.812401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:45:23.812401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:45:23.812401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:45:23.812401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:45:23.812401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:45:23.812401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 625/1263] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:45:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:23.817770 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1661c-e8f3-4091-9c25-cbf05e7b0d68 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:23.836431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:23.913570 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1661c-e8f3-4091-9c25-cbf05e7b0d68 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:23.946942 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7506811-59a6-4285-99fb-0c511fdb3406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:23.947607 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7506811-59a6-4285-99fb-0c511fdb3406 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:23.947889 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7506811-59a6-4285-99fb-0c511fdb3406 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:23.948184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7506811-59a6-4285-99fb-0c511fdb3406 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:23.948940 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7506811-59a6-4285-99fb-0c511fdb3406 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:23.949252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7506811-59a6-4285-99fb-0c511fdb3406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:23.950621 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7506811-59a6-4285-99fb-0c511fdb3406 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:23.958449 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 639/1264] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:45:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:23.964328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b7591-76e5-4f53-bce5-9e775cce9649 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:24.030771 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:24.067906 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b7591-76e5-4f53-bce5-9e775cce9649 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:24.101099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31c190-7a79-43fe-bf22-073ac4f62a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:24.101882 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31c190-7a79-43fe-bf22-073ac4f62a62 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:24.102167 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31c190-7a79-43fe-bf22-073ac4f62a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:24.102446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31c190-7a79-43fe-bf22-073ac4f62a62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:24.113299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31c190-7a79-43fe-bf22-073ac4f62a62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:24.114728 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31c190-7a79-43fe-bf22-073ac4f62a62 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:24.132428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-ed31c190-7a79-43fe-bf22-073ac4f62a62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:24.132428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:24.132428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:24.132428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:24.132428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:24.132428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:24.132428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:24.132428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:24.132428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:24.132428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:24.132428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:24.132428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:24.132428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:45:24.132428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:45:24.132428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:45:24.133601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:45:24.133601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:24.133601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:24.133601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:24.133601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:24.133601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:24.133601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:24.133601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:24.133601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:24.133601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:24.133601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:24.133601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:24.133601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:24.133601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:24.133601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:24.133601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:24.133601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:24.134788 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:45:24.134788 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:45:24.134788 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:24.134788 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:45:24.134788 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 626/1265] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:24.140028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7506811-59a6-4285-99fb-0c511fdb3406 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:24.219814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:24.238661 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7506811-59a6-4285-99fb-0c511fdb3406 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:24.271878 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dff114-dec4-4bd0-9162-915ef97324d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:24.272542 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dff114-dec4-4bd0-9162-915ef97324d3 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:24.272856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dff114-dec4-4bd0-9162-915ef97324d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:24.273134 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dff114-dec4-4bd0-9162-915ef97324d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:24.273856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dff114-dec4-4bd0-9162-915ef97324d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:24.274163 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dff114-dec4-4bd0-9162-915ef97324d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:24.275537 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dff114-dec4-4bd0-9162-915ef97324d3 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:24.286455 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 640/1266] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:24.294881 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31c190-7a79-43fe-bf22-073ac4f62a62 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:24.398494 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31c190-7a79-43fe-bf22-073ac4f62a62 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:24.418098 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:24.431366 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b5324-60ac-43c2-b93a-332f99508142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:24.432150 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b5324-60ac-43c2-b93a-332f99508142 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:24.432431 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b5324-60ac-43c2-b93a-332f99508142 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:24.432736 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b5324-60ac-43c2-b93a-332f99508142 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:24.440042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b5324-60ac-43c2-b93a-332f99508142 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:24.441425 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b5324-60ac-43c2-b93a-332f99508142 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:24.455292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-d12b5324-60ac-43c2-b93a-332f99508142 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:45:24.455292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:24.455292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:24.455292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:24.455292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:24.455292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:24.455292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:24.455292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:24.455292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:24.455292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:24.455292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:24.455292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:24.455292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:45:24.455292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:45:24.455292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:45:24.455292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:45:24.456258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:24.456258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:24.456258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:45:24.456258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:45:24.456258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:45:24.456258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:45:24.456258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:24.456258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:24.456258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:24.456258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:24.456258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:24.456258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:24.456258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:24.456258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:24.456258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:24.456258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:24.456258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:24.456258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:24.457546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:24.457546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:24.457546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:45:24.457546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:45:24.457546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:45:24.457546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:45:24.457546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:45:24.457546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:45:24.457546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:45:24.457546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:45:24.457546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 627/1267] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:45:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:24.462970 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dff114-dec4-4bd0-9162-915ef97324d3 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:24.560776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dff114-dec4-4bd0-9162-915ef97324d3 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:24.593058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a4ce0-2403-400b-9f22-b7c1a1fbd6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:24.593728 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a4ce0-2403-400b-9f22-b7c1a1fbd6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:24.594011 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a4ce0-2403-400b-9f22-b7c1a1fbd6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:24.594293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a4ce0-2403-400b-9f22-b7c1a1fbd6e1 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:24.595117 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a4ce0-2403-400b-9f22-b7c1a1fbd6e1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:24.595426 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a4ce0-2403-400b-9f22-b7c1a1fbd6e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:24.596874 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a4ce0-2403-400b-9f22-b7c1a1fbd6e1 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:24.606484 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:24.614245 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 641/1268] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jul 5 12:45:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:24.619900 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b5324-60ac-43c2-b93a-332f99508142 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:24.728223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b5324-60ac-43c2-b93a-332f99508142 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:24.761147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1800bd2-0c17-4515-a055-155d78b40709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:24.761924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1800bd2-0c17-4515-a055-155d78b40709 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:24.762207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1800bd2-0c17-4515-a055-155d78b40709 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:24.762483 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1800bd2-0c17-4515-a055-155d78b40709 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:24.772706 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1800bd2-0c17-4515-a055-155d78b40709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:24.774132 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1800bd2-0c17-4515-a055-155d78b40709 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:24.791143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-c1800bd2-0c17-4515-a055-155d78b40709 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:24.791143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:24.791143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:24.791143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:24.791143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:24.791143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:24.791143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:24.791143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:24.791143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:24.791143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:24.791143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:24.791143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:24.791143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:45:24.791143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:45:24.791143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:45:24.792226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:45:24.792226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:24.792226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:24.792226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:24.792226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:24.792226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:24.792226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:24.792226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:24.792226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:24.792226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:24.792226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:24.792226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:24.792226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:24.792226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:24.792226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:24.792226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:24.792226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:24.793337 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:45:24.793337 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:45:24.793337 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:24.793337 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:45:24.793337 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 628/1269] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:24.798112 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a4ce0-2403-400b-9f22-b7c1a1fbd6e1 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:24.896507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a4ce0-2403-400b-9f22-b7c1a1fbd6e1 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:24.931403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307a261-c278-4df4-9ef7-2333494fd159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:24.932063 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307a261-c278-4df4-9ef7-2333494fd159 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:24.932347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307a261-c278-4df4-9ef7-2333494fd159 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:24.932649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307a261-c278-4df4-9ef7-2333494fd159 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:24.933375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307a261-c278-4df4-9ef7-2333494fd159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:24.933683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307a261-c278-4df4-9ef7-2333494fd159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:24.935080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307a261-c278-4df4-9ef7-2333494fd159 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:24.947338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 642/1270] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:24.953755 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1800bd2-0c17-4515-a055-155d78b40709 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:24.985415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:25.050870 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1800bd2-0c17-4515-a055-155d78b40709 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:25.084928 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83c85d-39ea-4f46-8e71-19562306a36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:25.085722 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83c85d-39ea-4f46-8e71-19562306a36d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:25.086030 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83c85d-39ea-4f46-8e71-19562306a36d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:25.086280 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83c85d-39ea-4f46-8e71-19562306a36d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:25.092798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83c85d-39ea-4f46-8e71-19562306a36d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:25.094234 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83c85d-39ea-4f46-8e71-19562306a36d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:25.109690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-aa83c85d-39ea-4f46-8e71-19562306a36d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:45:25.109690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:25.109690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:25.109690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:25.109690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:25.109690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:25.109690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:25.109690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:25.109690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:25.109690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:25.109690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:25.109690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:25.109690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:45:25.109690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:45:25.109690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:45:25.110768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:45:25.110768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:25.110768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:25.110768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:25.110768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:25.110768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:25.110768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:25.110768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:25.110768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:25.110768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:25.110768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:25.110768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:25.110768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:25.110768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:25.110768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:25.110768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:25.110768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:25.111865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:45:25.111865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:45:25.111865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:45:25.111865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:45:25.111865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:45:25.111865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:45:25.111865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:45:25.111865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:45:25.111865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 629/1271] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:45:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:25.116742 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307a261-c278-4df4-9ef7-2333494fd159 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:25.174513 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:25.214581 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307a261-c278-4df4-9ef7-2333494fd159 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:25.247483 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5aed79-62d4-48f8-95a4-59821b983658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:25.248082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5aed79-62d4-48f8-95a4-59821b983658 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:25.248365 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5aed79-62d4-48f8-95a4-59821b983658 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:25.248674 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5aed79-62d4-48f8-95a4-59821b983658 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:25.249475 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5aed79-62d4-48f8-95a4-59821b983658 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:25.250529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5aed79-62d4-48f8-95a4-59821b983658 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:25.251214 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5aed79-62d4-48f8-95a4-59821b983658 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:25.263265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 643/1272] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:45:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:25.269244 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83c85d-39ea-4f46-8e71-19562306a36d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:25.359709 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:25.368180 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83c85d-39ea-4f46-8e71-19562306a36d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:25.400938 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7e61e-e2ba-4d5b-a189-206d708474cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:25.401818 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7e61e-e2ba-4d5b-a189-206d708474cf None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:25.402100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7e61e-e2ba-4d5b-a189-206d708474cf None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:25.402375 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7e61e-e2ba-4d5b-a189-206d708474cf None admin] PATH_INFO: `/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/43b85b5c7b1e4d73b29fb96f4fa6db71/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:25.404308 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7e61e-e2ba-4d5b-a189-206d708474cf None admin] RBAC: Authorizing `identity:create_grant(project_id=a4190347294b48c096d7aa9d3a479d12, user_id=43b85b5c7b1e4d73b29fb96f4fa6db71, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:25.405781 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7e61e-e2ba-4d5b-a189-206d708474cf None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:25.515343 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 630/1273] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jul 5 12:45:25 2022] PUT /identity/v3/projects/a4190347294b48c096d7aa9d3a479d12/users/43b85b5c7b1e4d73b29fb96f4fa6db71/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:45:27.531477 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310eabd-e37f-4104-9593-5a7da34cc1d4 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:27.532011 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310eabd-e37f-4104-9593-5a7da34cc1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:27.532105 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310eabd-e37f-4104-9593-5a7da34cc1d4 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:27.533444 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 644/1274] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:45:27.538684 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817de3aa-9427-4868-a117-3496b6f05955 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:27.541438 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817de3aa-9427-4868-a117-3496b6f05955 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:27.541438 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817de3aa-9427-4868-a117-3496b6f05955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:27.556054 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-817de3aa-9427-4868-a117-3496b6f05955 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:45:27.557281 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-817de3aa-9427-4868-a117-3496b6f05955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:45:27.624085 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 631/1275] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:45:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 12:45:27.648117 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310eabd-e37f-4104-9593-5a7da34cc1d4 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:27.748020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310eabd-e37f-4104-9593-5a7da34cc1d4 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:27.764653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:27.781145 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2bf26-8ff6-4aee-886b-3291a18f2943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:27.781987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2bf26-8ff6-4aee-886b-3291a18f2943 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:27.782216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2bf26-8ff6-4aee-886b-3291a18f2943 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:27.782486 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2bf26-8ff6-4aee-886b-3291a18f2943 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:27.792840 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2bf26-8ff6-4aee-886b-3291a18f2943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 12:45:27.800724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-46a2bf26-8ff6-4aee-886b-3291a18f2943 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:45:27.800724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:27.800724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:27.800724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:27.800724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:27.800724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:27.800724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:27.800724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:27.800724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:27.800724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:27.800724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:27.800724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:27.800724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 12:45:27.800724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 12:45:27.800724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 12:45:27.800724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 12:45:27.801710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 12:45:27.801710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 12:45:27.801710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 12:45:27.801710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 12:45:27.801710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:27.801710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:27.801710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:27.801710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:27.801710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:27.801710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:27.801710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:27.801710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:27.801710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:27.801710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:27.801710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:27.801710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:27.803177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:27.803177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:27.803177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:27.803177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:27.803177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 12:45:27.803177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 12:45:27.803177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 12:45:27.803177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 12:45:27.803177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 12:45:27.803177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 12:45:27.803177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 12:45:27.803177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:27.803177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 645/1276] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jul 5 12:45:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:27.808492 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817de3aa-9427-4868-a117-3496b6f05955 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:27.886962 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:27.903956 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817de3aa-9427-4868-a117-3496b6f05955 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:27.936790 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec6bce-26e3-4aa2-af4e-567c8feb9f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:27.937508 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec6bce-26e3-4aa2-af4e-567c8feb9f55 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:27.937794 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec6bce-26e3-4aa2-af4e-567c8feb9f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:27.938072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec6bce-26e3-4aa2-af4e-567c8feb9f55 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:27.938818 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec6bce-26e3-4aa2-af4e-567c8feb9f55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:27.939124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec6bce-26e3-4aa2-af4e-567c8feb9f55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:27.940502 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec6bce-26e3-4aa2-af4e-567c8feb9f55 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:27.948513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 632/1277] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jul 5 12:45:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:27.954150 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2bf26-8ff6-4aee-886b-3291a18f2943 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:28.053510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2bf26-8ff6-4aee-886b-3291a18f2943 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:28.090758 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6005d58-ddd1-4ff4-9558-440fa0e26746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:28.091561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6005d58-ddd1-4ff4-9558-440fa0e26746 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:28.091841 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6005d58-ddd1-4ff4-9558-440fa0e26746 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:28.092121 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6005d58-ddd1-4ff4-9558-440fa0e26746 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:28.103379 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6005d58-ddd1-4ff4-9558-440fa0e26746 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:28.104854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6005d58-ddd1-4ff4-9558-440fa0e26746 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:28.121308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-c6005d58-ddd1-4ff4-9558-440fa0e26746 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:28.121308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:28.121308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:28.121308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:28.121308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:28.121308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:28.121308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:28.121308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:28.121308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:28.121308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:28.121308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:28.121308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:28.121308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:45:28.121308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:45:28.121308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:45:28.122212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:45:28.122212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:28.122212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:28.122212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:28.122212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:28.122212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:28.122212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:28.122212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:28.122212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:28.122212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:28.122212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:28.122212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:28.122212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:28.122212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:28.122212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:28.122212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:28.122212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:28.123318 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:45:28.123318 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:45:28.123318 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:28.123318 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:28.123318 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 646/1278] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:28.128201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec6bce-26e3-4aa2-af4e-567c8feb9f55 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:28.227628 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec6bce-26e3-4aa2-af4e-567c8feb9f55 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:28.259800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e37828-268b-4ce2-9b5e-78e6d7d38e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:28.260452 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e37828-268b-4ce2-9b5e-78e6d7d38e85 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:28.260770 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e37828-268b-4ce2-9b5e-78e6d7d38e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:28.261054 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e37828-268b-4ce2-9b5e-78e6d7d38e85 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:28.261771 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e37828-268b-4ce2-9b5e-78e6d7d38e85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:28.262081 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e37828-268b-4ce2-9b5e-78e6d7d38e85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:28.263507 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e37828-268b-4ce2-9b5e-78e6d7d38e85 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:28.275604 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 633/1279] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:28.281130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6005d58-ddd1-4ff4-9558-440fa0e26746 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:28.312536 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:28.379230 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6005d58-ddd1-4ff4-9558-440fa0e26746 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:28.413149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5ab9b-78a1-46cb-a677-56d1115944e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:28.413941 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5ab9b-78a1-46cb-a677-56d1115944e6 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:28.414221 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5ab9b-78a1-46cb-a677-56d1115944e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:28.423420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5ab9b-78a1-46cb-a677-56d1115944e6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:28.423420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5ab9b-78a1-46cb-a677-56d1115944e6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:28.423420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5ab9b-78a1-46cb-a677-56d1115944e6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:28.437000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-73d5ab9b-78a1-46cb-a677-56d1115944e6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:45:28.437000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:28.437000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:28.437000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:28.437000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:28.437000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:28.437000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:28.437000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:28.437000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:28.437000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:28.437000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:28.437000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:28.437000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 12:45:28.437000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 12:45:28.437000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 12:45:28.437000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 12:45:28.438193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:28.438193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:28.438193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 12:45:28.438193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:45:28.438193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 12:45:28.438193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 12:45:28.438193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:28.438193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:28.438193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:28.438193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:28.438193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:28.438193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:28.438193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:28.438193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:28.438193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:28.438193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:28.438193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:28.438193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:28.439600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:28.439600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:28.439600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 12:45:28.439600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 12:45:28.439600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 12:45:28.439600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 12:45:28.439600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 12:45:28.439600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 12:45:28.439600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 12:45:28.439600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:28.439600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 647/1280] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:45:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:28.444415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e37828-268b-4ce2-9b5e-78e6d7d38e85 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:28.448171 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:28.542302 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e37828-268b-4ce2-9b5e-78e6d7d38e85 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:28.575506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1061656-daf2-4fdf-969b-d917dbe769bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:28.576100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1061656-daf2-4fdf-969b-d917dbe769bf None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:28.576384 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1061656-daf2-4fdf-969b-d917dbe769bf None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:28.576697 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1061656-daf2-4fdf-969b-d917dbe769bf None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:28.577555 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1061656-daf2-4fdf-969b-d917dbe769bf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:28.577887 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1061656-daf2-4fdf-969b-d917dbe769bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:28.579359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1061656-daf2-4fdf-969b-d917dbe769bf None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:28.596029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 634/1281] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jul 5 12:45:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:28.602499 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5ab9b-78a1-46cb-a677-56d1115944e6 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:28.694289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:28.703451 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5ab9b-78a1-46cb-a677-56d1115944e6 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:28.736718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c406be-1b6c-48f5-a632-37a4a6cebdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:28.738676 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c406be-1b6c-48f5-a632-37a4a6cebdbe None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:28.738676 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c406be-1b6c-48f5-a632-37a4a6cebdbe None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:28.738676 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c406be-1b6c-48f5-a632-37a4a6cebdbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:28.804111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c406be-1b6c-48f5-a632-37a4a6cebdbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:28.805618 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c406be-1b6c-48f5-a632-37a4a6cebdbe None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:28.891011 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:28.901693 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 648/1282] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jul 5 12:45:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 12:45:28.907444 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1061656-daf2-4fdf-969b-d917dbe769bf None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:28.970063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:29.007786 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1061656-daf2-4fdf-969b-d917dbe769bf None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:29.041152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24972e-aeab-495e-b374-7f5f30eb3c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:29.041929 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24972e-aeab-495e-b374-7f5f30eb3c29 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:29.042209 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24972e-aeab-495e-b374-7f5f30eb3c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:29.042480 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24972e-aeab-495e-b374-7f5f30eb3c29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:29.052276 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24972e-aeab-495e-b374-7f5f30eb3c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:29.053805 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24972e-aeab-495e-b374-7f5f30eb3c29 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:29.072194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-ab24972e-aeab-495e-b374-7f5f30eb3c29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:29.072194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:29.072194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:29.072194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:29.072194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:29.072194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:29.072194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:29.072194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:29.072194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:29.072194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:29.072194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:29.072194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:29.072194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 12:45:29.072194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 12:45:29.072194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 12:45:29.074352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 12:45:29.074352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:29.074352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:29.074352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:29.074352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:29.074352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:29.074352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:29.074352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:29.074352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:29.074352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:29.074352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:29.074352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:29.074352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:29.074352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:29.074352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:29.074352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:29.074352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:29.075476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 12:45:29.075476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 12:45:29.075476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 12:45:29.075476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:45:29.075476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 635/1283] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:29.079263 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c406be-1b6c-48f5-a632-37a4a6cebdbe None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:29.178198 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c406be-1b6c-48f5-a632-37a4a6cebdbe None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:29.211585 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16679b-feb7-4b6b-9aa6-89ec85ada69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:29.212269 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16679b-feb7-4b6b-9aa6-89ec85ada69c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:29.212553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16679b-feb7-4b6b-9aa6-89ec85ada69c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:29.212864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16679b-feb7-4b6b-9aa6-89ec85ada69c None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:29.213579 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16679b-feb7-4b6b-9aa6-89ec85ada69c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:29.213887 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16679b-feb7-4b6b-9aa6-89ec85ada69c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:29.215240 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16679b-feb7-4b6b-9aa6-89ec85ada69c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:29.226409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 649/1284] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jul 5 12:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:29.231915 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24972e-aeab-495e-b374-7f5f30eb3c29 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:29.331014 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24972e-aeab-495e-b374-7f5f30eb3c29 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:29.345214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:29.364904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282db9ae-fb70-4c07-a8c4-6460bdd94d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:29.365776 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282db9ae-fb70-4c07-a8c4-6460bdd94d4e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:29.366064 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282db9ae-fb70-4c07-a8c4-6460bdd94d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:29.366345 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282db9ae-fb70-4c07-a8c4-6460bdd94d4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:29.372826 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282db9ae-fb70-4c07-a8c4-6460bdd94d4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:29.381245 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282db9ae-fb70-4c07-a8c4-6460bdd94d4e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:29.388802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-282db9ae-fb70-4c07-a8c4-6460bdd94d4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:45:29.388802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:29.388802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:29.388802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:29.388802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:29.388802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:29.388802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:29.388802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:29.388802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:29.388802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:29.388802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:29.388802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:29.388802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 12:45:29.388802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 12:45:29.388802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 12:45:29.389850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 12:45:29.389850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:29.389850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:29.389850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:29.389850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:29.389850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:29.389850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:29.389850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:29.389850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:29.389850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:29.389850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:29.389850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:29.389850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:29.389850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:29.389850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:29.389850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:29.389850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:29.395662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 12:45:29.395662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 12:45:29.395662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 12:45:29.395662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 12:45:29.395662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 12:45:29.395662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 12:45:29.395662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 12:45:29.395662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 05 12:45:29.395662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 636/1285] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jul 5 12:45:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:29.396913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16679b-feb7-4b6b-9aa6-89ec85ada69c None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:29.444791 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:29.493299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16679b-feb7-4b6b-9aa6-89ec85ada69c None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:29.526049 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b8818-d14b-40e8-aa00-28f22dba3887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:29.526707 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b8818-d14b-40e8-aa00-28f22dba3887 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:29.530262 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b8818-d14b-40e8-aa00-28f22dba3887 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:29.530262 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b8818-d14b-40e8-aa00-28f22dba3887 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:29.530262 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b8818-d14b-40e8-aa00-28f22dba3887 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:29.530262 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b8818-d14b-40e8-aa00-28f22dba3887 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:29.530262 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b8818-d14b-40e8-aa00-28f22dba3887 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:29.541944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 650/1286] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jul 5 12:45:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:29.547882 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282db9ae-fb70-4c07-a8c4-6460bdd94d4e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:29.645572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282db9ae-fb70-4c07-a8c4-6460bdd94d4e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:29.680363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4db2e-8914-4b63-a39f-3ad53df375a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:29.681100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4db2e-8914-4b63-a39f-3ad53df375a7 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:29.681388 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4db2e-8914-4b63-a39f-3ad53df375a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:29.681666 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4db2e-8914-4b63-a39f-3ad53df375a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:29.682498 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4db2e-8914-4b63-a39f-3ad53df375a7 None admin] RBAC: Adding query filter params (role.id=868c7a356c674ded875dd079f5a9f5e0, scope.project.id=a4190347294b48c096d7aa9d3a479d12, user.id=43b85b5c7b1e4d73b29fb96f4fa6db71) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:29.682811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4db2e-8914-4b63-a39f-3ad53df375a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:29.684237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4db2e-8914-4b63-a39f-3ad53df375a7 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:29.689976 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 637/1287] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jul 5 12:45:29 2022] GET /identity/v3/role_assignments?user.id=43b85b5c7b1e4d73b29fb96f4fa6db71&scope.project.id=a4190347294b48c096d7aa9d3a479d12&role.id=868c7a356c674ded875dd079f5a9f5e0 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:31.732144 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cc9cf-8673-41ad-aedf-43ebd091511b None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:31.732729 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cc9cf-8673-41ad-aedf-43ebd091511b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:31.732729 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cc9cf-8673-41ad-aedf-43ebd091511b None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:31.734108 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 651/1288] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:45:31.739389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349ed55-52c0-4147-bd4d-10fa5811ce51 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:31.739836 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349ed55-52c0-4147-bd4d-10fa5811ce51 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:31.740005 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349ed55-52c0-4147-bd4d-10fa5811ce51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:31.756421 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-0349ed55-52c0-4147-bd4d-10fa5811ce51 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:45:31.757642 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0349ed55-52c0-4147-bd4d-10fa5811ce51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:45:31.787386 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:31.823136 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 638/1289] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:45:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:45:31.846032 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cc9cf-8673-41ad-aedf-43ebd091511b None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:31.947182 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cc9cf-8673-41ad-aedf-43ebd091511b None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:31.957532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:31.981338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a650f6d-4a3c-4172-b990-4d7eecce3a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:31.982140 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a650f6d-4a3c-4172-b990-4d7eecce3a42 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:31.982468 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a650f6d-4a3c-4172-b990-4d7eecce3a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:31.982803 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a650f6d-4a3c-4172-b990-4d7eecce3a42 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:31.983861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a650f6d-4a3c-4172-b990-4d7eecce3a42 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:31.985257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a650f6d-4a3c-4172-b990-4d7eecce3a42 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:31.999650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-3a650f6d-4a3c-4172-b990-4d7eecce3a42 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 12:45:31.999650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:31.999650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:45:31.999650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:45:31.999650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:45:31.999650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:45:31.999650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:45:31.999650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:45:31.999650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 12:45:31.999650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:31.999650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:45:31.999650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:31.999650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:31.999650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:31.999650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:31.999650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:31.999650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:32.000775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:32.000775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:32.000775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:32.000775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:32.000775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:32.000775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:32.000775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:45:32.000775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:45:32.000775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:45:32.000775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:45:32.000775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:32.000775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:32.000775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:32.000775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:32.000775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:32.000775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:32.002026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:32.002026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:32.002026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:32.002026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:32.002026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:32.002026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:32.002026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:32.002026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:32.002026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:32.002026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:32.002026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:45:32.002026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:45:32.002026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 12:45:32.002026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:32.002026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 652/1290] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jul 5 12:45:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 12:45:32.007569 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349ed55-52c0-4147-bd4d-10fa5811ce51 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:32.116017 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349ed55-52c0-4147-bd4d-10fa5811ce51 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:32.150810 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f39940-213d-4dc8-a66a-dfcc79352a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:32.151474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f39940-213d-4dc8-a66a-dfcc79352a16 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:32.151754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f39940-213d-4dc8-a66a-dfcc79352a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:32.152027 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f39940-213d-4dc8-a66a-dfcc79352a16 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:32.152758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f39940-213d-4dc8-a66a-dfcc79352a16 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:32.153062 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f39940-213d-4dc8-a66a-dfcc79352a16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:32.154507 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f39940-213d-4dc8-a66a-dfcc79352a16 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:32.161478 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 639/1291] 10.222.0.36 () {56 vars in 1116 bytes} [Tue Jul 5 12:45:32 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:32.165220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a650f6d-4a3c-4172-b990-4d7eecce3a42 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:32.263179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a650f6d-4a3c-4172-b990-4d7eecce3a42 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:32.295988 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688cd31-9358-4b77-a53c-aebd0632a719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:32.296675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688cd31-9358-4b77-a53c-aebd0632a719 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:32.296959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688cd31-9358-4b77-a53c-aebd0632a719 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:32.297235 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688cd31-9358-4b77-a53c-aebd0632a719 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:32.297943 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688cd31-9358-4b77-a53c-aebd0632a719 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:32.298248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688cd31-9358-4b77-a53c-aebd0632a719 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:32.299614 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688cd31-9358-4b77-a53c-aebd0632a719 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:32.304526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 653/1292] 10.222.0.36 () {56 vars in 1116 bytes} [Tue Jul 5 12:45:32 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:34.355341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f0f1f-21fa-484e-831c-a200e2f34896 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:34.355892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f0f1f-21fa-484e-831c-a200e2f34896 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:34.355892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f0f1f-21fa-484e-831c-a200e2f34896 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:34.357402 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 640/1293] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:45:34.364206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d91999-872b-41d5-8c80-623748e31a03 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:34.364206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d91999-872b-41d5-8c80-623748e31a03 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:34.364206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d91999-872b-41d5-8c80-623748e31a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:34.380727 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-19d91999-872b-41d5-8c80-623748e31a03 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:45:34.382034 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-19d91999-872b-41d5-8c80-623748e31a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:45:34.411992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:34.452321 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 654/1294] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:45:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:45:34.475721 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f0f1f-21fa-484e-831c-a200e2f34896 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:34.507161 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:34.574606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f0f1f-21fa-484e-831c-a200e2f34896 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:34.607900 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f833a7-fc2c-4372-9b89-c1b655cf6358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:34.608484 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f833a7-fc2c-4372-9b89-c1b655cf6358 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:34.608795 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f833a7-fc2c-4372-9b89-c1b655cf6358 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:34.609073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f833a7-fc2c-4372-9b89-c1b655cf6358 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:34.609811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f833a7-fc2c-4372-9b89-c1b655cf6358 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:34.611151 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f833a7-fc2c-4372-9b89-c1b655cf6358 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:34.722205 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 641/1295] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jul 5 12:45:34 2022] POST /identity/v3/services => generated 246 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:45:36.731492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cae663-ea38-4549-b553-54569fe63364 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:36.732054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cae663-ea38-4549-b553-54569fe63364 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:36.732054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cae663-ea38-4549-b553-54569fe63364 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:36.733445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 655/1296] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:45:36.738756 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e292f75-354c-4b99-97a2-71d2e3fc17db None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:36.739130 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e292f75-354c-4b99-97a2-71d2e3fc17db None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:36.739319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e292f75-354c-4b99-97a2-71d2e3fc17db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:36.757346 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-9e292f75-354c-4b99-97a2-71d2e3fc17db None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:45:36.758604 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9e292f75-354c-4b99-97a2-71d2e3fc17db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:45:36.830219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 642/1297] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:45:36 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:45:36.853419 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cae663-ea38-4549-b553-54569fe63364 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:36.952566 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cae663-ea38-4549-b553-54569fe63364 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:36.986398 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff730e1-035b-48c8-8158-ee9f5c24f82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:36.987126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff730e1-035b-48c8-8158-ee9f5c24f82c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:36.987408 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff730e1-035b-48c8-8158-ee9f5c24f82c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:36.987685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff730e1-035b-48c8-8158-ee9f5c24f82c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:36.988336 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff730e1-035b-48c8-8158-ee9f5c24f82c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:36.990269 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff730e1-035b-48c8-8158-ee9f5c24f82c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:37.001797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-dff730e1-035b-48c8-8158-ee9f5c24f82c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 12:45:37.001797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:37.001797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:45:37.001797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:45:37.001797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:45:37.001797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:45:37.001797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:45:37.001797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:45:37.001797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 12:45:37.001797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:37.001797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:45:37.001797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:37.001797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:37.001797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:37.001797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:37.001797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:37.001797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:37.008651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:37.008651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:37.008651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:37.008651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:37.008651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:37.008651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:37.008651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:45:37.008651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:45:37.008651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:45:37.008651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:45:37.008651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:37.008651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:37.008651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:37.008651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:37.008651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:37.008651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:37.010410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:37.010410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:37.010410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:37.010410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:37.010410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:37.010410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:37.010410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:37.010410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:37.010410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:37.010410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:37.010410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:45:37.010410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:45:37.010410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 12:45:37.010410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:37.010410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 656/1298] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jul 5 12:45:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:37.011451 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e292f75-354c-4b99-97a2-71d2e3fc17db None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:37.027553 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:37.106143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e292f75-354c-4b99-97a2-71d2e3fc17db None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:37.139122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44839c-7a43-4bba-8310-7dbf1bb9a9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:37.139774 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44839c-7a43-4bba-8310-7dbf1bb9a9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:37.140055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44839c-7a43-4bba-8310-7dbf1bb9a9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:37.140331 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44839c-7a43-4bba-8310-7dbf1bb9a9e5 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:37.141061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44839c-7a43-4bba-8310-7dbf1bb9a9e5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:37.141366 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44839c-7a43-4bba-8310-7dbf1bb9a9e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:37.142715 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44839c-7a43-4bba-8310-7dbf1bb9a9e5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:37.147766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 643/1299] 10.222.0.36 () {56 vars in 1116 bytes} [Tue Jul 5 12:45:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 12:45:37.153814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff730e1-035b-48c8-8158-ee9f5c24f82c None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:37.186284 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:37.252599 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff730e1-035b-48c8-8158-ee9f5c24f82c None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:37.289745 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182b7c6-9338-44bf-86ac-8e3c1caff894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:37.290409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182b7c6-9338-44bf-86ac-8e3c1caff894 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:37.290691 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182b7c6-9338-44bf-86ac-8e3c1caff894 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:37.290970 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182b7c6-9338-44bf-86ac-8e3c1caff894 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:37.291760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182b7c6-9338-44bf-86ac-8e3c1caff894 None admin] RBAC: Adding query filter params (interface=public, service_id=2c8fbee616114782bb351452988e2288, region_id=RegionOne) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:37.292072 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182b7c6-9338-44bf-86ac-8e3c1caff894 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:37.293477 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182b7c6-9338-44bf-86ac-8e3c1caff894 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:37.298522 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 657/1300] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jul 5 12:45:37 2022] GET /identity/v3/endpoints?service_id=2c8fbee616114782bb351452988e2288&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:37.304911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44839c-7a43-4bba-8310-7dbf1bb9a9e5 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:37.385016 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:37.402277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44839c-7a43-4bba-8310-7dbf1bb9a9e5 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:37.435713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7451bf-a239-4029-8d53-bafcccf4c22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:37.436362 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7451bf-a239-4029-8d53-bafcccf4c22b None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:37.436675 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7451bf-a239-4029-8d53-bafcccf4c22b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:37.436956 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7451bf-a239-4029-8d53-bafcccf4c22b None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:37.437630 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7451bf-a239-4029-8d53-bafcccf4c22b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:37.438993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7451bf-a239-4029-8d53-bafcccf4c22b None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:37.445634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 644/1301] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jul 5 12:45:37 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:45:39.457778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2dc00-7c4e-4eb5-9c12-9e94b5c057c9 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:39.458908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2dc00-7c4e-4eb5-9c12-9e94b5c057c9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:39.458908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2dc00-7c4e-4eb5-9c12-9e94b5c057c9 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:39.460187 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 658/1302] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:45:39.465435 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb960df-0fa5-48f2-a1a7-b61253e742b9 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:39.465836 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb960df-0fa5-48f2-a1a7-b61253e742b9 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:39.465982 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb960df-0fa5-48f2-a1a7-b61253e742b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:39.482300 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2cb960df-0fa5-48f2-a1a7-b61253e742b9 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:45:39.483496 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2cb960df-0fa5-48f2-a1a7-b61253e742b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:45:39.549169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 645/1303] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:45:39 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 12:45:39.572109 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2dc00-7c4e-4eb5-9c12-9e94b5c057c9 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:39.667517 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:39.674063 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2dc00-7c4e-4eb5-9c12-9e94b5c057c9 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:39.707347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207744e-ae43-4700-aa17-780d302960d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:39.708865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207744e-ae43-4700-aa17-780d302960d1 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:39.709092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207744e-ae43-4700-aa17-780d302960d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:39.709369 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207744e-ae43-4700-aa17-780d302960d1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:39.710016 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207744e-ae43-4700-aa17-780d302960d1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:39.711380 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207744e-ae43-4700-aa17-780d302960d1 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:39.723224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-c207744e-ae43-4700-aa17-780d302960d1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 12:45:39.723224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:39.723224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 12:45:39.723224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 12:45:39.723224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 12:45:39.723224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 12:45:39.723224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 12:45:39.723224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:45:39.723224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 12:45:39.723224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:39.723224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 12:45:39.723224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:39.723224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 12:45:39.723224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 12:45:39.723224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 12:45:39.723224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 12:45:39.723224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 12:45:39.729908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 12:45:39.729908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 12:45:39.729908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 12:45:39.729908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 12:45:39.729908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 12:45:39.729908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 12:45:39.729908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 12:45:39.729908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 12:45:39.729908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 12:45:39.729908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 12:45:39.729908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 12:45:39.729908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 12:45:39.729908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 12:45:39.729908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 12:45:39.729908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 12:45:39.729908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 12:45:39.730760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 12:45:39.730760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 05 12:45:39.730760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 12:45:39.730760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 05 12:45:39.730760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 12:45:39.730760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 12:45:39.730760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 12:45:39.730760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 05 12:45:39.730760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 12:45:39.730760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 05 12:45:39.730760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 12:45:39.730760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 12:45:39.730760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 12:45:39.730760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 05 12:45:39.730760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 659/1304] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jul 5 12:45:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 12:45:39.731592 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb960df-0fa5-48f2-a1a7-b61253e742b9 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:39.804534 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:39.826764 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb960df-0fa5-48f2-a1a7-b61253e742b9 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:39.859869 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65415f-d8c4-49ca-a4d9-b2234941d62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:39.860522 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65415f-d8c4-49ca-a4d9-b2234941d62e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:39.860846 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65415f-d8c4-49ca-a4d9-b2234941d62e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:39.861152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65415f-d8c4-49ca-a4d9-b2234941d62e None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:39.861877 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65415f-d8c4-49ca-a4d9-b2234941d62e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:45:39.862214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65415f-d8c4-49ca-a4d9-b2234941d62e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:39.863594 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65415f-d8c4-49ca-a4d9-b2234941d62e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:39.869222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 646/1305] 10.222.0.36 () {56 vars in 1116 bytes} [Tue Jul 5 12:45:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:45:39.875182 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207744e-ae43-4700-aa17-780d302960d1 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:45:39.978636 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207744e-ae43-4700-aa17-780d302960d1 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:45:40.012231 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296cf94-609c-4990-bad7-871b2bcbacb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:45:40.012917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296cf94-609c-4990-bad7-871b2bcbacb6 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:45:40.013198 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296cf94-609c-4990-bad7-871b2bcbacb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:45:40.013473 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296cf94-609c-4990-bad7-871b2bcbacb6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:45:40.014216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296cf94-609c-4990-bad7-871b2bcbacb6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:45:40.015597 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296cf94-609c-4990-bad7-871b2bcbacb6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:45:40.142800 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 660/1306] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jul 5 12:45:39 2022] POST /identity/v3/endpoints => generated 331 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:45:49.866120 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=30 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:45:50.138232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:52:47.458525 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ff352-bfdd-451d-b8d4-e6747b27de65 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:47.458984 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ff352-bfdd-451d-b8d4-e6747b27de65 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:47.458984 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ff352-bfdd-451d-b8d4-e6747b27de65 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:47.460360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 647/1307] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:47.467899 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1aea0-66fd-4d42-b7fe-5451e402c410 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:47.469054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1aea0-66fd-4d42-b7fe-5451e402c410 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:47.469759 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1aea0-66fd-4d42-b7fe-5451e402c410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:47.556761 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a5b1aea0-66fd-4d42-b7fe-5451e402c410 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:47.557981 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a5b1aea0-66fd-4d42-b7fe-5451e402c410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:47.661586 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 661/1308] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:52:47.712105 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48367636-b717-49fa-85ea-ab1f4b48e2ec None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:47.712830 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48367636-b717-49fa-85ea-ab1f4b48e2ec None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:47.713355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48367636-b717-49fa-85ea-ab1f4b48e2ec None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:47.715054 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 648/1309] 10.222.0.36 () {54 vars in 964 bytes} [Tue Jul 5 12:52:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:47.721914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7d0c0-98eb-44de-83c5-af3f4950a5be None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:47.722410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7d0c0-98eb-44de-83c5-af3f4950a5be None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:47.722819 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7d0c0-98eb-44de-83c5-af3f4950a5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:47.809583 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-dca7d0c0-98eb-44de-83c5-af3f4950a5be None None] MFA Rules not processed for user `07ab8f60c4ff4969a277b33dca05e685`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:47.810868 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-dca7d0c0-98eb-44de-83c5-af3f4950a5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:47.838931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:52:47.902179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 662/1310] 10.222.0.36 () {58 vars in 1061 bytes} [Tue Jul 5 12:52:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:52:47.911734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48367636-b717-49fa-85ea-ab1f4b48e2ec None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:47.913826 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-48367636-b717-49fa-85ea-ab1f4b48e2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:48.033597 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48367636-b717-49fa-85ea-ab1f4b48e2ec None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:48.116049 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84280183-c57b-44f8-8eef-6a8362400e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:48.117095 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84280183-c57b-44f8-8eef-6a8362400e6c service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:48.117383 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84280183-c57b-44f8-8eef-6a8362400e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:48.117663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84280183-c57b-44f8-8eef-6a8362400e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:48.119302 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-84280183-c57b-44f8-8eef-6a8362400e6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:48.175204 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:52:48.231181 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84280183-c57b-44f8-8eef-6a8362400e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:48.232659 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84280183-c57b-44f8-8eef-6a8362400e6c service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:48.252656 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 649/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:52:50.620175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d81cba-ad7d-458e-abcd-08fc8ce962d7 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:50.620732 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d81cba-ad7d-458e-abcd-08fc8ce962d7 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:50.620839 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d81cba-ad7d-458e-abcd-08fc8ce962d7 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:50.622185 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 663/1312] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:52:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:50.628503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18346fee-abfa-47d9-ba76-0070e99cdbd5 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:50.629100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18346fee-abfa-47d9-ba76-0070e99cdbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:50.629601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18346fee-abfa-47d9-ba76-0070e99cdbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:50.709379 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-18346fee-abfa-47d9-ba76-0070e99cdbd5 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:50.710596 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-18346fee-abfa-47d9-ba76-0070e99cdbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:50.807328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 650/1313] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:52:50.846615 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d81cba-ad7d-458e-abcd-08fc8ce962d7 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:50.848187 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d6d81cba-ad7d-458e-abcd-08fc8ce962d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:50.970789 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d81cba-ad7d-458e-abcd-08fc8ce962d7 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:51.054081 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:52:51.056045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aee4f8-23cf-497d-b673-50eef16e7b14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:51.056965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aee4f8-23cf-497d-b673-50eef16e7b14 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:51.057349 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aee4f8-23cf-497d-b673-50eef16e7b14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:51.057726 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aee4f8-23cf-497d-b673-50eef16e7b14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:51.059768 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-48aee4f8-23cf-497d-b673-50eef16e7b14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:51.176680 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aee4f8-23cf-497d-b673-50eef16e7b14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:51.178039 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aee4f8-23cf-497d-b673-50eef16e7b14 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:51.197478 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 664/1314] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:52:53.767029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedf763-fff7-4da6-90e1-e4b4892cd378 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:53.767571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedf763-fff7-4da6-90e1-e4b4892cd378 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:53.767571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedf763-fff7-4da6-90e1-e4b4892cd378 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:53.769004 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 651/1315] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:53.773976 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29496ab-d58d-4b33-af7d-663b969c4ddc None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:53.774356 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29496ab-d58d-4b33-af7d-663b969c4ddc None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:53.774533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29496ab-d58d-4b33-af7d-663b969c4ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:53.837541 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-f29496ab-d58d-4b33-af7d-663b969c4ddc None None] MFA Rules not processed for user `52ebb4f8be97463abd2bc87a56c1e3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:53.838739 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f29496ab-d58d-4b33-af7d-663b969c4ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:53.889313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:52:53.932121 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 665/1316] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:52:53 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:52:53.971576 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedf763-fff7-4da6-90e1-e4b4892cd378 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:53.973161 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ebedf763-fff7-4da6-90e1-e4b4892cd378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:53.982976 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:52:54.077160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedf763-fff7-4da6-90e1-e4b4892cd378 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:54.149997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789dfec-b750-4b77-94dc-6ffe5e2e2492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:54.150654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789dfec-b750-4b77-94dc-6ffe5e2e2492 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:54.150941 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789dfec-b750-4b77-94dc-6ffe5e2e2492 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:54.151220 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789dfec-b750-4b77-94dc-6ffe5e2e2492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:54.152990 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1789dfec-b750-4b77-94dc-6ffe5e2e2492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:54.212921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:52:54.258365 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789dfec-b750-4b77-94dc-6ffe5e2e2492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:54.259830 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789dfec-b750-4b77-94dc-6ffe5e2e2492 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:54.277852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 652/1317] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:53 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:52:57.028278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27f882-9a2b-48aa-871b-6f6f1d253942 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:57.030331 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27f882-9a2b-48aa-871b-6f6f1d253942 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:57.030331 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27f882-9a2b-48aa-871b-6f6f1d253942 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:57.030331 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 666/1318] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:52:57.035554 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66baec5-ad01-4bd1-8e53-ed2bde0a4137 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:57.035984 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66baec5-ad01-4bd1-8e53-ed2bde0a4137 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:57.036098 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66baec5-ad01-4bd1-8e53-ed2bde0a4137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:57.100353 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e66baec5-ad01-4bd1-8e53-ed2bde0a4137 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:52:57.101612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e66baec5-ad01-4bd1-8e53-ed2bde0a4137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:57.197231 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 653/1319] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:52:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:52:57.234725 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27f882-9a2b-48aa-871b-6f6f1d253942 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:52:57.236827 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-db27f882-9a2b-48aa-871b-6f6f1d253942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:57.337396 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27f882-9a2b-48aa-871b-6f6f1d253942 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:52:57.411896 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54104a5-0916-4d76-ab6d-b32993d0ce21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:52:57.412550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54104a5-0916-4d76-ab6d-b32993d0ce21 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:52:57.412866 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54104a5-0916-4d76-ab6d-b32993d0ce21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:52:57.413144 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54104a5-0916-4d76-ab6d-b32993d0ce21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:52:57.414799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b54104a5-0916-4d76-ab6d-b32993d0ce21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:52:57.421569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:52:57.520530 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54104a5-0916-4d76-ab6d-b32993d0ce21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:52:57.521997 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54104a5-0916-4d76-ab6d-b32993d0ce21 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:52:57.540356 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 667/1320] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:52:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:53:00.533682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a8261-c8ad-44a3-ad49-461abcffd4e1 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:00.534205 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a8261-c8ad-44a3-ad49-461abcffd4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:00.534296 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a8261-c8ad-44a3-ad49-461abcffd4e1 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:00.535597 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 654/1321] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:53:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:00.540694 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f7673-d922-4a6c-86f5-fa8f8879ddbf None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:00.541130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f7673-d922-4a6c-86f5-fa8f8879ddbf None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:00.541234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f7673-d922-4a6c-86f5-fa8f8879ddbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:00.606970 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-dc1f7673-d922-4a6c-86f5-fa8f8879ddbf None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:00.608184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-dc1f7673-d922-4a6c-86f5-fa8f8879ddbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:00.664687 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:00.704867 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 668/1322] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:00.740680 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a8261-c8ad-44a3-ad49-461abcffd4e1 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:53:00.742311 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5f9a8261-c8ad-44a3-ad49-461abcffd4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:00.762504 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:00.855049 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a8261-c8ad-44a3-ad49-461abcffd4e1 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:53:00.936687 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d660586-c769-4e69-9c82-50ca3d2500df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:53:00.937346 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d660586-c769-4e69-9c82-50ca3d2500df service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:00.937630 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d660586-c769-4e69-9c82-50ca3d2500df service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:00.937910 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d660586-c769-4e69-9c82-50ca3d2500df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:00.939592 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5d660586-c769-4e69-9c82-50ca3d2500df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:01.011882 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:01.052982 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d660586-c769-4e69-9c82-50ca3d2500df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:53:01.054434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d660586-c769-4e69-9c82-50ca3d2500df service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:53:01.073879 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 655/1323] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:53:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:53:03.134507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734c09d-bbc2-4ccf-be04-19a3a077df87 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:03.135103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734c09d-bbc2-4ccf-be04-19a3a077df87 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:03.135103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734c09d-bbc2-4ccf-be04-19a3a077df87 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:03.136416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 669/1324] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:03.141597 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675112b-b417-4cce-8f5b-75a906cf2e39 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:03.142027 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675112b-b417-4cce-8f5b-75a906cf2e39 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:03.142159 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675112b-b417-4cce-8f5b-75a906cf2e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:03.205303 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2675112b-b417-4cce-8f5b-75a906cf2e39 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:03.206495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2675112b-b417-4cce-8f5b-75a906cf2e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:03.301331 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 656/1325] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:03.351628 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dc474-6859-4891-92ed-f2b9400efd4f None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:03.351907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dc474-6859-4891-92ed-f2b9400efd4f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:03.352181 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dc474-6859-4891-92ed-f2b9400efd4f None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:03.353583 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 670/1326] 10.222.0.36 () {54 vars in 964 bytes} [Tue Jul 5 12:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:03.360684 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c8ca2-fd72-41b3-b714-90ecd81e4a8d None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:03.360983 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c8ca2-fd72-41b3-b714-90ecd81e4a8d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:03.361262 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c8ca2-fd72-41b3-b714-90ecd81e4a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:03.391450 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:03.435532 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-9a3c8ca2-fd72-41b3-b714-90ecd81e4a8d None None] MFA Rules not processed for user `07ab8f60c4ff4969a277b33dca05e685`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:03.436774 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9a3c8ca2-fd72-41b3-b714-90ecd81e4a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:03.511620 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 657/1327] 10.222.0.36 () {58 vars in 1061 bytes} [Tue Jul 5 12:53:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:03.520568 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4dc474-6859-4891-92ed-f2b9400efd4f None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:53:03.522265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3f4dc474-6859-4891-92ed-f2b9400efd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:03.626790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4dc474-6859-4891-92ed-f2b9400efd4f None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:53:03.703291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c7598-ed90-4798-8434-5447027b3f4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:53:03.704489 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c7598-ed90-4798-8434-5447027b3f4a service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:03.704804 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c7598-ed90-4798-8434-5447027b3f4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:03.705083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c7598-ed90-4798-8434-5447027b3f4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:03.706734 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a80c7598-ed90-4798-8434-5447027b3f4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:03.724149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:03.824533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c7598-ed90-4798-8434-5447027b3f4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:53:03.826032 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c7598-ed90-4798-8434-5447027b3f4a service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:53:03.845563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 671/1328] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:53:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:53:06.134500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2b53b-2e9f-45c0-81eb-1cd6ea790b1a None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:06.135100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2b53b-2e9f-45c0-81eb-1cd6ea790b1a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:06.135100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2b53b-2e9f-45c0-81eb-1cd6ea790b1a None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:06.136576 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 658/1329] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:06.142351 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadd207-7cb5-40ab-bb8e-342ae2d0d1d5 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:06.142801 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadd207-7cb5-40ab-bb8e-342ae2d0d1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:06.142904 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadd207-7cb5-40ab-bb8e-342ae2d0d1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:06.206660 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-aeadd207-7cb5-40ab-bb8e-342ae2d0d1d5 None None] MFA Rules not processed for user `52ebb4f8be97463abd2bc87a56c1e3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:06.207798 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-aeadd207-7cb5-40ab-bb8e-342ae2d0d1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:06.274176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:06.306189 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 672/1330] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:06.346788 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2b53b-2e9f-45c0-81eb-1cd6ea790b1a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:53:06.348353 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-abe2b53b-2e9f-45c0-81eb-1cd6ea790b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:06.467468 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2b53b-2e9f-45c0-81eb-1cd6ea790b1a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:53:06.488052 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:06.544880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bbde4-c4a2-4e22-a705-b3350fd0598d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:53:06.545526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bbde4-c4a2-4e22-a705-b3350fd0598d service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:06.545883 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bbde4-c4a2-4e22-a705-b3350fd0598d service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:06.546158 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bbde4-c4a2-4e22-a705-b3350fd0598d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:06.547809 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4a8bbde4-c4a2-4e22-a705-b3350fd0598d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:06.659628 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bbde4-c4a2-4e22-a705-b3350fd0598d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:53:06.661041 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bbde4-c4a2-4e22-a705-b3350fd0598d service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:53:06.679008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 659/1331] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:53:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:53:09.510370 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a42f97-d8f2-494f-a2cd-9d1669606748 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:09.510883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a42f97-d8f2-494f-a2cd-9d1669606748 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:09.511007 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a42f97-d8f2-494f-a2cd-9d1669606748 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:09.512286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 673/1332] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:09.517481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb3d04-b56b-4f5b-826e-7c1f64801cfc None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:09.517911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb3d04-b56b-4f5b-826e-7c1f64801cfc None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:09.518064 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb3d04-b56b-4f5b-826e-7c1f64801cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:09.579291 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:09.581865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-4bcb3d04-b56b-4f5b-826e-7c1f64801cfc None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:09.583083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4bcb3d04-b56b-4f5b-826e-7c1f64801cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:09.677203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 660/1333] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:09.712269 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a42f97-d8f2-494f-a2cd-9d1669606748 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:53:09.713840 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-38a42f97-d8f2-494f-a2cd-9d1669606748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:09.813833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a42f97-d8f2-494f-a2cd-9d1669606748 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:53:09.884156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585645e2-823c-4d3d-8525-7104593107b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:53:09.884826 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585645e2-823c-4d3d-8525-7104593107b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:09.885108 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585645e2-823c-4d3d-8525-7104593107b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:09.885388 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585645e2-823c-4d3d-8525-7104593107b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:09.887781 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-585645e2-823c-4d3d-8525-7104593107b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:09.916608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:09.996296 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585645e2-823c-4d3d-8525-7104593107b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:53:09.997699 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585645e2-823c-4d3d-8525-7104593107b9 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:53:10.017315 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 674/1334] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:53:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:53:12.065728 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa4c45-7668-40bd-889d-eafad71549d2 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:12.066160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa4c45-7668-40bd-889d-eafad71549d2 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:12.066285 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa4c45-7668-40bd-889d-eafad71549d2 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:12.067663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 661/1335] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:12.072808 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebe007-1aa7-467f-aec7-ae7a27849aba None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:12.073251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebe007-1aa7-467f-aec7-ae7a27849aba None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:12.073365 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebe007-1aa7-467f-aec7-ae7a27849aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:12.136024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-75ebe007-1aa7-467f-aec7-ae7a27849aba None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:12.137297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-75ebe007-1aa7-467f-aec7-ae7a27849aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:12.209901 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:12.231380 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 675/1336] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:53:12.271065 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa4c45-7668-40bd-889d-eafad71549d2 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:53:12.272592 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d4fa4c45-7668-40bd-889d-eafad71549d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:12.374717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa4c45-7668-40bd-889d-eafad71549d2 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:53:12.402709 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:12.446574 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa5a4c-41f7-4c73-8cba-b12a815b7718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:53:12.447214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa5a4c-41f7-4c73-8cba-b12a815b7718 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:12.447501 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa5a4c-41f7-4c73-8cba-b12a815b7718 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:12.447781 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa5a4c-41f7-4c73-8cba-b12a815b7718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:12.449444 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-30fa5a4c-41f7-4c73-8cba-b12a815b7718 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:12.554754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa5a4c-41f7-4c73-8cba-b12a815b7718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:53:12.556183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa5a4c-41f7-4c73-8cba-b12a815b7718 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:53:12.573658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 662/1337] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:53:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:53:15.238609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cd03c-9b06-4242-a4b2-72b77c5ba443 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:15.239176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cd03c-9b06-4242-a4b2-72b77c5ba443 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:15.239176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cd03c-9b06-4242-a4b2-72b77c5ba443 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:15.240545 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 676/1338] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:15.245848 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b0c17-e4ad-43ab-bd3c-59e2cbe292f9 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:15.246235 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b0c17-e4ad-43ab-bd3c-59e2cbe292f9 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:15.246405 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b0c17-e4ad-43ab-bd3c-59e2cbe292f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:15.318093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-df7b0c17-e4ad-43ab-bd3c-59e2cbe292f9 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:15.319224 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-df7b0c17-e4ad-43ab-bd3c-59e2cbe292f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:15.327311 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:15.415133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 663/1339] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:53:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:15.451216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cd03c-9b06-4242-a4b2-72b77c5ba443 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:53:15.452778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b80cd03c-9b06-4242-a4b2-72b77c5ba443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:15.553875 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cd03c-9b06-4242-a4b2-72b77c5ba443 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:53:15.632312 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0642e5f-5bc2-40cd-a678-2fa21e94d7ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:53:15.632883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0642e5f-5bc2-40cd-a678-2fa21e94d7ff service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:15.633162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0642e5f-5bc2-40cd-a678-2fa21e94d7ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:15.633433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0642e5f-5bc2-40cd-a678-2fa21e94d7ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:15.635064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e0642e5f-5bc2-40cd-a678-2fa21e94d7ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:15.669334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:15.741425 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0642e5f-5bc2-40cd-a678-2fa21e94d7ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:53:15.742865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0642e5f-5bc2-40cd-a678-2fa21e94d7ff service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:53:15.761664 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 677/1340] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:53:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:53:20.005094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bf085-2e45-46f7-bbbf-5aed574a1645 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:20.005666 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bf085-2e45-46f7-bbbf-5aed574a1645 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:20.005770 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bf085-2e45-46f7-bbbf-5aed574a1645 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:20.007267 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 664/1341] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:20.012508 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628eb8d-0071-4d2d-9eff-b793c7bbe053 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:20.013040 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628eb8d-0071-4d2d-9eff-b793c7bbe053 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:20.013120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628eb8d-0071-4d2d-9eff-b793c7bbe053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:20.094907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b628eb8d-0071-4d2d-9eff-b793c7bbe053 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:20.094907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b628eb8d-0071-4d2d-9eff-b793c7bbe053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:20.187045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:20.200028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 678/1342] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:53:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:20.239762 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bf085-2e45-46f7-bbbf-5aed574a1645 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:53:20.242064 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e29bf085-2e45-46f7-bbbf-5aed574a1645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:20.337044 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bf085-2e45-46f7-bbbf-5aed574a1645 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:53:20.340488 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31374c2f-f4ef-4c1f-b4cd-611cec394b76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:53:20.341168 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31374c2f-f4ef-4c1f-b4cd-611cec394b76 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:20.341459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31374c2f-f4ef-4c1f-b4cd-611cec394b76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:20.341737 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31374c2f-f4ef-4c1f-b4cd-611cec394b76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:20.351501 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31374c2f-f4ef-4c1f-b4cd-611cec394b76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:53:20.352993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31374c2f-f4ef-4c1f-b4cd-611cec394b76 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:53:20.362889 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 665/1343] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:53:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:53:23.409358 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a6567-c855-4533-b40f-f5f09f6c4a67 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:23.409952 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a6567-c855-4533-b40f-f5f09f6c4a67 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:23.409952 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a6567-c855-4533-b40f-f5f09f6c4a67 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:23.411303 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 679/1344] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:53:23.416774 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e08989-dae5-472b-b0c4-9ef776111db2 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:23.417258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e08989-dae5-472b-b0c4-9ef776111db2 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:23.417380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e08989-dae5-472b-b0c4-9ef776111db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:23.446106 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-39e08989-dae5-472b-b0c4-9ef776111db2 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:23.447359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-39e08989-dae5-472b-b0c4-9ef776111db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:23.479541 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:23.530400 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 666/1345] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:53:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:23.569266 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a6567-c855-4533-b40f-f5f09f6c4a67 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:53:23.581679 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a6567-c855-4533-b40f-f5f09f6c4a67 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:53:23.585146 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1239296-f65b-40a6-9122-b7d0565a1dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:53:23.585840 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1239296-f65b-40a6-9122-b7d0565a1dcc service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:23.586126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1239296-f65b-40a6-9122-b7d0565a1dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:23.586398 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1239296-f65b-40a6-9122-b7d0565a1dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:23.595661 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1239296-f65b-40a6-9122-b7d0565a1dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:53:23.597131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1239296-f65b-40a6-9122-b7d0565a1dcc service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:53:23.606947 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 680/1346] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:53:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:53:27.805449 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e717e2-bd6c-4870-8e66-55f32ef15b26 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:27.806023 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e717e2-bd6c-4870-8e66-55f32ef15b26 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:27.806023 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e717e2-bd6c-4870-8e66-55f32ef15b26 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:27.807445 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 667/1347] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:27.813553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e20f-a81a-482b-987a-e9d343dd1008 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:27.813990 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e20f-a81a-482b-987a-e9d343dd1008 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:27.814113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e20f-a81a-482b-987a-e9d343dd1008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:27.831376 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-0d89e20f-a81a-482b-987a-e9d343dd1008 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:27.832620 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0d89e20f-a81a-482b-987a-e9d343dd1008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:27.840496 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 681/1348] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:27.878750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e717e2-bd6c-4870-8e66-55f32ef15b26 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:53:27.889155 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e717e2-bd6c-4870-8e66-55f32ef15b26 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:53:27.892603 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfa9dd-a05b-4946-8e7d-bf8063c3567f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:53:27.893239 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfa9dd-a05b-4946-8e7d-bf8063c3567f service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:27.893525 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfa9dd-a05b-4946-8e7d-bf8063c3567f service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:27.893799 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfa9dd-a05b-4946-8e7d-bf8063c3567f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:27.902620 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfa9dd-a05b-4946-8e7d-bf8063c3567f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:53:27.904051 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfa9dd-a05b-4946-8e7d-bf8063c3567f service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:53:27.913507 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 668/1349] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:53:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:53:32.993097 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cd0a7-8561-4815-8883-49f99d626fb9 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:32.993926 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cd0a7-8561-4815-8883-49f99d626fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:32.994366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cd0a7-8561-4815-8883-49f99d626fb9 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:32.996147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 682/1350] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jul 5 12:53:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:33.002456 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f4530-caea-41ae-a70a-70713f4ff68c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:33.003594 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f4530-caea-41ae-a70a-70713f4ff68c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:33.004112 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f4530-caea-41ae-a70a-70713f4ff68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:33.088902 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-cc5f4530-caea-41ae-a70a-70713f4ff68c None None] MFA Rules not processed for user `43b85b5c7b1e4d73b29fb96f4fa6db71`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:33.090456 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-cc5f4530-caea-41ae-a70a-70713f4ff68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:33.179237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 669/1351] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jul 5 12:53:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:37.205523 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961212d-0485-4d66-8ec7-bcf9335f9359 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:37.206099 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961212d-0485-4d66-8ec7-bcf9335f9359 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:37.206099 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961212d-0485-4d66-8ec7-bcf9335f9359 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:37.207689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 683/1352] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jul 5 12:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:37.212663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dfed0-1e7d-4b5d-b1da-dcfabc068e5a None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:37.213517 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dfed0-1e7d-4b5d-b1da-dcfabc068e5a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:37.214028 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dfed0-1e7d-4b5d-b1da-dcfabc068e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:37.234883 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-150dfed0-1e7d-4b5d-b1da-dcfabc068e5a None None] MFA Rules not processed for user `43b85b5c7b1e4d73b29fb96f4fa6db71`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:37.236077 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-150dfed0-1e7d-4b5d-b1da-dcfabc068e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:37.244775 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 670/1353] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jul 5 12:53:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:37.826414 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=13 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:38.861116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ab186-f9c3-485f-a198-09a9e761e791 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:38.861762 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ab186-f9c3-485f-a198-09a9e761e791 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:38.861762 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ab186-f9c3-485f-a198-09a9e761e791 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:38.863218 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 684/1354] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jul 5 12:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:38.868407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ec071-aec5-4a56-90ba-aa44df9a615c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:38.869592 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ec071-aec5-4a56-90ba-aa44df9a615c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:38.870317 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ec071-aec5-4a56-90ba-aa44df9a615c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:38.890402 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-548ec071-aec5-4a56-90ba-aa44df9a615c None None] MFA Rules not processed for user `43b85b5c7b1e4d73b29fb96f4fa6db71`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:38.891679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-548ec071-aec5-4a56-90ba-aa44df9a615c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:38.900886 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 671/1355] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jul 5 12:53:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:42.404018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606f215-17ac-4ccc-ad12-0491da332b58 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:42.404524 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606f215-17ac-4ccc-ad12-0491da332b58 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:42.404524 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606f215-17ac-4ccc-ad12-0491da332b58 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:42.406604 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 685/1356] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:53:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:42.412498 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2f926-0061-41e9-898f-89b136af1404 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:42.414291 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2f926-0061-41e9-898f-89b136af1404 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:42.414737 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2f926-0061-41e9-898f-89b136af1404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:42.433858 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f6b2f926-0061-41e9-898f-89b136af1404 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:42.435046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f6b2f926-0061-41e9-898f-89b136af1404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:42.443157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 672/1357] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:42.494435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdee0f-0687-4bdf-b61c-5ba216cb8bee None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:42.494728 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdee0f-0687-4bdf-b61c-5ba216cb8bee None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:42.495008 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdee0f-0687-4bdf-b61c-5ba216cb8bee None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:42.496580 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 686/1358] 10.222.0.36 () {54 vars in 961 bytes} [Tue Jul 5 12:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:42.506265 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195472f-eea9-4d85-a948-00c47fe47791 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:42.506967 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195472f-eea9-4d85-a948-00c47fe47791 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:42.507734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195472f-eea9-4d85-a948-00c47fe47791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:42.552256 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:42.561786 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-5195472f-eea9-4d85-a948-00c47fe47791 None None] MFA Rules not processed for user `cdf37a42279a466b85906b23751f9c22`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:42.563063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5195472f-eea9-4d85-a948-00c47fe47791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:42.644285 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 673/1359] 10.222.0.36 () {58 vars in 1058 bytes} [Tue Jul 5 12:53:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:42.662649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdee0f-0687-4bdf-b61c-5ba216cb8bee None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:53:42.671817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdee0f-0687-4bdf-b61c-5ba216cb8bee None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:53:42.678344 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877f07c-cd68-45c1-94fd-ccb16838a2f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:53:42.678986 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877f07c-cd68-45c1-94fd-ccb16838a2f5 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:42.679267 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877f07c-cd68-45c1-94fd-ccb16838a2f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:42.679545 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877f07c-cd68-45c1-94fd-ccb16838a2f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:42.688560 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877f07c-cd68-45c1-94fd-ccb16838a2f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:53:42.690174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877f07c-cd68-45c1-94fd-ccb16838a2f5 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:53:42.700157 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 687/1360] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:53:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:53:44.938033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a782b1a-300e-431d-b019-486ae226f06e None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:44.938567 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a782b1a-300e-431d-b019-486ae226f06e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:44.938689 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a782b1a-300e-431d-b019-486ae226f06e None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:44.940309 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 674/1361] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:44.945107 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072f895-8c7b-499d-9d31-1631ef322bf1 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:44.945511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072f895-8c7b-499d-9d31-1631ef322bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:44.945680 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072f895-8c7b-499d-9d31-1631ef322bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:44.963817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-3072f895-8c7b-499d-9d31-1631ef322bf1 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:44.965069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3072f895-8c7b-499d-9d31-1631ef322bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:44.973253 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 688/1362] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:45.017488 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a782b1a-300e-431d-b019-486ae226f06e None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:53:45.032775 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a782b1a-300e-431d-b019-486ae226f06e None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:53:45.038735 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698a15e-2528-41d0-9fe3-7d27aa2deccf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:53:45.039378 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698a15e-2528-41d0-9fe3-7d27aa2deccf service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:45.039674 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698a15e-2528-41d0-9fe3-7d27aa2deccf service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:45.039953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698a15e-2528-41d0-9fe3-7d27aa2deccf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:45.052877 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698a15e-2528-41d0-9fe3-7d27aa2deccf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:53:45.054802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698a15e-2528-41d0-9fe3-7d27aa2deccf service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:53:45.068083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 675/1363] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:53:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:53:47.589621 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb16f0-3e79-4cda-93bd-f0e278222c6c None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:47.590178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb16f0-3e79-4cda-93bd-f0e278222c6c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:47.590178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb16f0-3e79-4cda-93bd-f0e278222c6c None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:47.591862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 689/1364] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:47.597028 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d4638-92e8-429b-b7f0-1374258744c5 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:47.597495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d4638-92e8-429b-b7f0-1374258744c5 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:47.600328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d4638-92e8-429b-b7f0-1374258744c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:47.616360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-773d4638-92e8-429b-b7f0-1374258744c5 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:47.617538 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-773d4638-92e8-429b-b7f0-1374258744c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:47.625860 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 676/1365] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:47.671393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f6a69-fca0-4365-8321-225380292bf9 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:47.671675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f6a69-fca0-4365-8321-225380292bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:47.671948 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f6a69-fca0-4365-8321-225380292bf9 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:47.673359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 690/1366] 10.222.0.36 () {54 vars in 961 bytes} [Tue Jul 5 12:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:47.678636 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604f939-beb9-4e5d-b0af-7fc36c8b8c61 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:47.679019 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604f939-beb9-4e5d-b0af-7fc36c8b8c61 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:47.680452 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604f939-beb9-4e5d-b0af-7fc36c8b8c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:47.698622 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-4604f939-beb9-4e5d-b0af-7fc36c8b8c61 None None] MFA Rules not processed for user `cdf37a42279a466b85906b23751f9c22`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:47.700071 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4604f939-beb9-4e5d-b0af-7fc36c8b8c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:47.711041 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 677/1367] 10.222.0.36 () {58 vars in 1058 bytes} [Tue Jul 5 12:53:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:47.719400 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f6a69-fca0-4365-8321-225380292bf9 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:53:47.734333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f6a69-fca0-4365-8321-225380292bf9 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:53:47.739749 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710aedc9-a84b-480f-847e-1b81e4b2abef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:53:47.740388 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710aedc9-a84b-480f-847e-1b81e4b2abef service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:47.740706 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710aedc9-a84b-480f-847e-1b81e4b2abef service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:47.741023 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710aedc9-a84b-480f-847e-1b81e4b2abef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:47.749213 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710aedc9-a84b-480f-847e-1b81e4b2abef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:53:47.750834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710aedc9-a84b-480f-847e-1b81e4b2abef service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:53:47.760509 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 691/1368] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:53:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:53:49.983873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f68c53-39fe-4882-b4f6-cc585abe37d3 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:49.984400 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f68c53-39fe-4882-b4f6-cc585abe37d3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:49.984400 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f68c53-39fe-4882-b4f6-cc585abe37d3 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:49.985781 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 678/1369] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:49.990982 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0459e-8b54-496e-8790-ba47960f9dcc None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:49.991764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0459e-8b54-496e-8790-ba47960f9dcc None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:49.992289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0459e-8b54-496e-8790-ba47960f9dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:50.010076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-62a0459e-8b54-496e-8790-ba47960f9dcc None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:50.011461 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-62a0459e-8b54-496e-8790-ba47960f9dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:50.020058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 692/1370] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:50.064317 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f68c53-39fe-4882-b4f6-cc585abe37d3 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:53:50.080499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f68c53-39fe-4882-b4f6-cc585abe37d3 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:53:50.086193 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e714e-ca88-4d60-9e9d-484bb68af6a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:53:50.087070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e714e-ca88-4d60-9e9d-484bb68af6a8 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:50.087500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e714e-ca88-4d60-9e9d-484bb68af6a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:50.087989 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e714e-ca88-4d60-9e9d-484bb68af6a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:50.097668 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e714e-ca88-4d60-9e9d-484bb68af6a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:53:50.099513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e714e-ca88-4d60-9e9d-484bb68af6a8 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:53:50.112965 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 679/1371] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:53:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:53:50.439047 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc7232-91f1-436d-80f7-8e75d0fb3993 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:50.439334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc7232-91f1-436d-80f7-8e75d0fb3993 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:50.439840 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc7232-91f1-436d-80f7-8e75d0fb3993 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:50.441557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 693/1372] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:50.446720 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab050f6d-c931-47d7-94c5-1ad73c200f68 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:50.447028 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab050f6d-c931-47d7-94c5-1ad73c200f68 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:50.447301 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab050f6d-c931-47d7-94c5-1ad73c200f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:50.466056 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ab050f6d-c931-47d7-94c5-1ad73c200f68 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:50.467415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ab050f6d-c931-47d7-94c5-1ad73c200f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:50.475729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 680/1373] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:50.818219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb99ee-c7f1-4378-8963-c122a96b1966 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:50.818219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb99ee-c7f1-4378-8963-c122a96b1966 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:50.818219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb99ee-c7f1-4378-8963-c122a96b1966 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:50.820739 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 694/1374] 10.222.0.36 () {54 vars in 963 bytes} [Tue Jul 5 12:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:53:50.825848 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711647d-92c8-4bb2-88c9-05df266d9385 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:50.825848 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711647d-92c8-4bb2-88c9-05df266d9385 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:50.825848 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711647d-92c8-4bb2-88c9-05df266d9385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:50.875927 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f711647d-92c8-4bb2-88c9-05df266d9385 None None] MFA Rules not processed for user `4bb924cdb5aa48ba9dfcc7be7e912991`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:50.877187 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f711647d-92c8-4bb2-88c9-05df266d9385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:50.948383 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 681/1375] 10.222.0.36 () {58 vars in 1060 bytes} [Tue Jul 5 12:53:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:50.957878 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb99ee-c7f1-4378-8963-c122a96b1966 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:53:50.972826 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb99ee-c7f1-4378-8963-c122a96b1966 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:53:50.976450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1376f7b-dd6c-4fdc-8fdb-19b68dfe4eb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:53:50.977144 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1376f7b-dd6c-4fdc-8fdb-19b68dfe4eb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:50.977545 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1376f7b-dd6c-4fdc-8fdb-19b68dfe4eb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:50.978053 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1376f7b-dd6c-4fdc-8fdb-19b68dfe4eb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:50.992867 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1376f7b-dd6c-4fdc-8fdb-19b68dfe4eb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:53:50.994338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1376f7b-dd6c-4fdc-8fdb-19b68dfe4eb8 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:53:51.006725 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 695/1376] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:53:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:53:52.292954 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8caccd9-dade-4454-a611-c9f1ec6501e1 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:52.293521 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8caccd9-dade-4454-a611-c9f1ec6501e1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:52.293521 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8caccd9-dade-4454-a611-c9f1ec6501e1 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:52.294886 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 682/1377] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:52.300078 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff14874-8867-49a7-ba88-db692c998a9c None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:52.300532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff14874-8867-49a7-ba88-db692c998a9c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:52.300665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff14874-8867-49a7-ba88-db692c998a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:52.318044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-fff14874-8867-49a7-ba88-db692c998a9c None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:52.319347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-fff14874-8867-49a7-ba88-db692c998a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:52.327798 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 696/1378] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:53:52.371350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8caccd9-dade-4454-a611-c9f1ec6501e1 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:53:52.386105 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8caccd9-dade-4454-a611-c9f1ec6501e1 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:53:52.391701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad0162-89d1-422e-abc3-0be726d95c58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:53:52.392336 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad0162-89d1-422e-abc3-0be726d95c58 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:52.392650 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad0162-89d1-422e-abc3-0be726d95c58 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:52.392980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad0162-89d1-422e-abc3-0be726d95c58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:52.401267 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad0162-89d1-422e-abc3-0be726d95c58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:53:52.402844 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad0162-89d1-422e-abc3-0be726d95c58 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:53:52.406880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:53:52.412903 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 683/1379] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:53:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:53:54.614963 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e510b4c-0e8d-4277-a4ab-2af1ed24cbf0 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:54.614963 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e510b4c-0e8d-4277-a4ab-2af1ed24cbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:54.614963 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e510b4c-0e8d-4277-a4ab-2af1ed24cbf0 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:54.616475 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 697/1380] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:53:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:54.622833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459461d5-c4e2-4dbc-9551-3af42f66be6f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:54.623903 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459461d5-c4e2-4dbc-9551-3af42f66be6f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:54.624018 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459461d5-c4e2-4dbc-9551-3af42f66be6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:54.643919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-459461d5-c4e2-4dbc-9551-3af42f66be6f None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:54.645429 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-459461d5-c4e2-4dbc-9551-3af42f66be6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:54.660732 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 684/1381] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:54.701997 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e510b4c-0e8d-4277-a4ab-2af1ed24cbf0 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:53:54.719854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e510b4c-0e8d-4277-a4ab-2af1ed24cbf0 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:53:54.725886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13a2b8-dd64-4b7a-86fd-b173f6d76b26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:53:54.726767 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13a2b8-dd64-4b7a-86fd-b173f6d76b26 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:54.727058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13a2b8-dd64-4b7a-86fd-b173f6d76b26 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:54.727336 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13a2b8-dd64-4b7a-86fd-b173f6d76b26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:54.737919 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13a2b8-dd64-4b7a-86fd-b173f6d76b26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:53:54.739969 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13a2b8-dd64-4b7a-86fd-b173f6d76b26 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:53:54.751649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 698/1382] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:53:56.946864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514c1d7-a85b-4af9-8637-e8d20007a139 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:56.947369 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514c1d7-a85b-4af9-8637-e8d20007a139 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:56.947479 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514c1d7-a85b-4af9-8637-e8d20007a139 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:56.948828 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 685/1383] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:56.954534 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247b1d-f63b-4ecf-aff6-4115b7743b84 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:56.954943 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247b1d-f63b-4ecf-aff6-4115b7743b84 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:56.955118 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247b1d-f63b-4ecf-aff6-4115b7743b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:56.973499 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-3e247b1d-f63b-4ecf-aff6-4115b7743b84 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:56.974609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3e247b1d-f63b-4ecf-aff6-4115b7743b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:56.996759 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 699/1384] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:57.024625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514c1d7-a85b-4af9-8637-e8d20007a139 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:53:57.039305 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514c1d7-a85b-4af9-8637-e8d20007a139 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:53:57.045207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc628c2-6c33-406c-8a55-5f9dd138cba4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:53:57.045981 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc628c2-6c33-406c-8a55-5f9dd138cba4 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:57.046329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc628c2-6c33-406c-8a55-5f9dd138cba4 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:57.046678 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc628c2-6c33-406c-8a55-5f9dd138cba4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:57.056217 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc628c2-6c33-406c-8a55-5f9dd138cba4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:53:57.057850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc628c2-6c33-406c-8a55-5f9dd138cba4 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:53:57.075758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 686/1385] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:53:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:53:59.106042 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46febfcf-f869-47da-be83-1da76c41b5f5 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:59.106773 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46febfcf-f869-47da-be83-1da76c41b5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:59.106927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46febfcf-f869-47da-be83-1da76c41b5f5 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:59.109014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 700/1386] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:53:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:53:59.114015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5038be-6acf-4cf4-80d6-60e501533849 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:59.114644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5038be-6acf-4cf4-80d6-60e501533849 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:59.114644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5038be-6acf-4cf4-80d6-60e501533849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:59.135885 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-8a5038be-6acf-4cf4-80d6-60e501533849 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:53:59.137693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8a5038be-6acf-4cf4-80d6-60e501533849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:53:59.146646 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 687/1387] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:53:59.212511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46febfcf-f869-47da-be83-1da76c41b5f5 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:53:59.231074 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46febfcf-f869-47da-be83-1da76c41b5f5 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:53:59.239362 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0293c2-5d8b-40e0-96c3-ced301dc1e12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:53:59.240279 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0293c2-5d8b-40e0-96c3-ced301dc1e12 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:53:59.240834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0293c2-5d8b-40e0-96c3-ced301dc1e12 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:53:59.241265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0293c2-5d8b-40e0-96c3-ced301dc1e12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:53:59.254439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0293c2-5d8b-40e0-96c3-ced301dc1e12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:53:59.256905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0293c2-5d8b-40e0-96c3-ced301dc1e12 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:53:59.271299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 701/1388] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:53:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:02.052717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec6b76-8091-4651-9dc8-c3d378192287 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:02.053252 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec6b76-8091-4651-9dc8-c3d378192287 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:02.053354 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec6b76-8091-4651-9dc8-c3d378192287 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:02.054715 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 688/1389] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:02.062135 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77150eb-b5c3-407e-bda4-d95cead4f751 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:02.062576 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77150eb-b5c3-407e-bda4-d95cead4f751 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:02.062846 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77150eb-b5c3-407e-bda4-d95cead4f751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:02.081816 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b77150eb-b5c3-407e-bda4-d95cead4f751 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:02.083058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b77150eb-b5c3-407e-bda4-d95cead4f751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:02.091588 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 702/1390] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:02.146393 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec6b76-8091-4651-9dc8-c3d378192287 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:02.163860 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec6b76-8091-4651-9dc8-c3d378192287 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:02.171584 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca1621-4124-46b2-aaf9-b61b6647da9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:02.172472 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca1621-4124-46b2-aaf9-b61b6647da9a service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:02.172968 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca1621-4124-46b2-aaf9-b61b6647da9a service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:02.173369 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca1621-4124-46b2-aaf9-b61b6647da9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:02.186536 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca1621-4124-46b2-aaf9-b61b6647da9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:02.188923 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca1621-4124-46b2-aaf9-b61b6647da9a service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:02.202073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 689/1391] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:04.585265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9eb04-6d25-460c-9317-dcc40d03890d None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:04.585870 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9eb04-6d25-460c-9317-dcc40d03890d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:04.585870 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9eb04-6d25-460c-9317-dcc40d03890d None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:04.587179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 703/1392] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:04.592905 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d781e-169c-46a7-aa2c-db3a03ac668f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:04.593686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d781e-169c-46a7-aa2c-db3a03ac668f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:04.593976 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d781e-169c-46a7-aa2c-db3a03ac668f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:04.613096 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-0d5d781e-169c-46a7-aa2c-db3a03ac668f None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:04.614315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0d5d781e-169c-46a7-aa2c-db3a03ac668f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:04.622259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 690/1393] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:04.666144 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9eb04-6d25-460c-9317-dcc40d03890d None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:04.681101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9eb04-6d25-460c-9317-dcc40d03890d None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:04.687240 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9d27a-1e95-4c6c-97cd-5467449c6e13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:04.687887 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9d27a-1e95-4c6c-97cd-5467449c6e13 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:04.688172 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9d27a-1e95-4c6c-97cd-5467449c6e13 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:04.688450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9d27a-1e95-4c6c-97cd-5467449c6e13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:04.697094 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9d27a-1e95-4c6c-97cd-5467449c6e13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:04.698685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9d27a-1e95-4c6c-97cd-5467449c6e13 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:04.708957 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 704/1394] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:06.524961 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dcb17-ec8d-443b-8456-c9eeb620d00b None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:06.525546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dcb17-ec8d-443b-8456-c9eeb620d00b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:06.525546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dcb17-ec8d-443b-8456-c9eeb620d00b None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:06.526821 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 691/1395] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:06.532477 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a5e80-2158-40dc-898e-ddc258e4e89f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:06.532921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a5e80-2158-40dc-898e-ddc258e4e89f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:06.533066 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a5e80-2158-40dc-898e-ddc258e4e89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:06.550871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-5d5a5e80-2158-40dc-898e-ddc258e4e89f None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:06.552061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5d5a5e80-2158-40dc-898e-ddc258e4e89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:06.559882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 705/1396] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:06.615668 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e96a5f-b47c-4aca-974d-ed57786c8788 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:06.615962 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e96a5f-b47c-4aca-974d-ed57786c8788 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:06.616243 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e96a5f-b47c-4aca-974d-ed57786c8788 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:06.617683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 692/1397] 10.222.0.36 () {54 vars in 962 bytes} [Tue Jul 5 12:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:06.622620 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98737698-47d2-434f-a3ba-95d3417ae5e8 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:06.622906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98737698-47d2-434f-a3ba-95d3417ae5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:06.623185 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98737698-47d2-434f-a3ba-95d3417ae5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:06.672950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-98737698-47d2-434f-a3ba-95d3417ae5e8 None None] MFA Rules not processed for user `7e7c4b0bd50c474996a21b69bde4e227`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:06.674168 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-98737698-47d2-434f-a3ba-95d3417ae5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:06.735366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 706/1398] 10.222.0.36 () {58 vars in 1059 bytes} [Tue Jul 5 12:54:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:06.742778 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e96a5f-b47c-4aca-974d-ed57786c8788 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:06.754048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e96a5f-b47c-4aca-974d-ed57786c8788 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:06.757552 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57577b1b-88b1-41e2-9de3-7db3f285a46c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e7c4b0bd50c474996a21b69bde4e227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:06.758192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57577b1b-88b1-41e2-9de3-7db3f285a46c service glance] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:06.758482 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57577b1b-88b1-41e2-9de3-7db3f285a46c service glance] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:06.758767 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57577b1b-88b1-41e2-9de3-7db3f285a46c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:06.768397 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57577b1b-88b1-41e2-9de3-7db3f285a46c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:06.769869 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57577b1b-88b1-41e2-9de3-7db3f285a46c service glance] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:06.779231 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 693/1399] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:06.901877 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a879960-1f7d-4f4f-a6be-3e8964fd43de None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:06.902166 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a879960-1f7d-4f4f-a6be-3e8964fd43de None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:06.902446 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a879960-1f7d-4f4f-a6be-3e8964fd43de None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:06.903872 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 707/1400] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:06.909159 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c63621-2d5f-49ce-8222-3a99d5aaa38f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:06.909449 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c63621-2d5f-49ce-8222-3a99d5aaa38f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:06.909730 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c63621-2d5f-49ce-8222-3a99d5aaa38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:06.927517 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-61c63621-2d5f-49ce-8222-3a99d5aaa38f None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:06.928747 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-61c63621-2d5f-49ce-8222-3a99d5aaa38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:06.937349 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 694/1401] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:06.982803 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a879960-1f7d-4f4f-a6be-3e8964fd43de None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:06.997983 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a879960-1f7d-4f4f-a6be-3e8964fd43de None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:07.003580 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3080b08-4e8e-405d-b87c-67754257b412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:07.004250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3080b08-4e8e-405d-b87c-67754257b412 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:07.004528 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3080b08-4e8e-405d-b87c-67754257b412 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:07.004836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3080b08-4e8e-405d-b87c-67754257b412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:07.015153 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3080b08-4e8e-405d-b87c-67754257b412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:07.016998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3080b08-4e8e-405d-b87c-67754257b412 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:07.028929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 708/1402] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:07.716859 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c0d73-dadd-42c4-bfcb-94ff00be3bed None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:07.717403 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c0d73-dadd-42c4-bfcb-94ff00be3bed None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:07.717566 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c0d73-dadd-42c4-bfcb-94ff00be3bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:07.765381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-484c0d73-dadd-42c4-bfcb-94ff00be3bed None None] MFA Rules not processed for user `ab47c91ba7854bc09f656607dbb41cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:07.766589 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-484c0d73-dadd-42c4-bfcb-94ff00be3bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:07.829362 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 695/1403] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jul 5 12:54:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:07.870425 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9b3b4-a3e7-4986-9d70-6e1081e1c262 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:07.870909 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9b3b4-a3e7-4986-9d70-6e1081e1c262 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:07.871115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9b3b4-a3e7-4986-9d70-6e1081e1c262 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:07.872575 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 709/1404] 10.222.0.36 () {54 vars in 942 bytes} [Tue Jul 5 12:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:07.879709 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194529f-023a-41c1-913f-4f6e1af3ecf1 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:07.880003 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194529f-023a-41c1-913f-4f6e1af3ecf1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:07.880283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194529f-023a-41c1-913f-4f6e1af3ecf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:07.931031 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f194529f-023a-41c1-913f-4f6e1af3ecf1 None None] MFA Rules not processed for user `1fb7db02f8e945a7af39cb30c3d606f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:07.932237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f194529f-023a-41c1-913f-4f6e1af3ecf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:07.966673 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:54:08.004784 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 696/1405] 10.222.0.36 () {58 vars in 1039 bytes} [Tue Jul 5 12:54:07 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:54:08.014850 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9b3b4-a3e7-4986-9d70-6e1081e1c262 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:08.022292 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:54:08.028315 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9b3b4-a3e7-4986-9d70-6e1081e1c262 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:08.034144 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fb127-7947-46d7-a7e0-2d241ee33edb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fb7db02f8e945a7af39cb30c3d606f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:08.035275 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fb127-7947-46d7-a7e0-2d241ee33edb service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:08.035275 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fb127-7947-46d7-a7e0-2d241ee33edb service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:08.035529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fb127-7947-46d7-a7e0-2d241ee33edb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:08.043604 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326fb127-7947-46d7-a7e0-2d241ee33edb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:08.045262 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326fb127-7947-46d7-a7e0-2d241ee33edb service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:08.053442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 710/1406] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jul 5 12:54:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 12:54:09.247461 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efddce6-60d5-42f2-9776-c6fb4c7d54b4 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:09.247461 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efddce6-60d5-42f2-9776-c6fb4c7d54b4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:09.247461 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efddce6-60d5-42f2-9776-c6fb4c7d54b4 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:09.251817 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 697/1407] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:54:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:09.253579 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1394b4-8d3e-4b33-8adf-c3a7cf1a5656 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:09.254706 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1394b4-8d3e-4b33-8adf-c3a7cf1a5656 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:09.255235 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1394b4-8d3e-4b33-8adf-c3a7cf1a5656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:09.273761 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-5a1394b4-8d3e-4b33-8adf-c3a7cf1a5656 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:09.275366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5a1394b4-8d3e-4b33-8adf-c3a7cf1a5656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:09.286335 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 711/1408] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:54:09.330143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efddce6-60d5-42f2-9776-c6fb4c7d54b4 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:09.347384 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efddce6-60d5-42f2-9776-c6fb4c7d54b4 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:09.353134 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4e5c5-052e-4d14-b812-a23c42a5750b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:09.354546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4e5c5-052e-4d14-b812-a23c42a5750b service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:09.355059 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4e5c5-052e-4d14-b812-a23c42a5750b service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:09.355340 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4e5c5-052e-4d14-b812-a23c42a5750b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:09.377437 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4e5c5-052e-4d14-b812-a23c42a5750b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:09.379238 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4e5c5-052e-4d14-b812-a23c42a5750b service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:09.395151 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 698/1409] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:19.268818 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=8 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:54:19.386359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=21 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:54:31.582496 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5626ea-d9c3-455c-b684-009616bea560 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:31.583102 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5626ea-d9c3-455c-b684-009616bea560 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:31.583102 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5626ea-d9c3-455c-b684-009616bea560 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:31.584415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 712/1410] 10.222.0.36 () {54 vars in 918 bytes} [Tue Jul 5 12:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:31.589424 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c64302-c670-4110-aa6b-78223b0a5472 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:31.590415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c64302-c670-4110-aa6b-78223b0a5472 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:31.590521 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c64302-c670-4110-aa6b-78223b0a5472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:31.608641 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-75c64302-c670-4110-aa6b-78223b0a5472 None None] MFA Rules not processed for user `43b85b5c7b1e4d73b29fb96f4fa6db71`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:31.609849 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-75c64302-c670-4110-aa6b-78223b0a5472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:31.618268 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 699/1411] 10.222.0.36 () {58 vars in 1015 bytes} [Tue Jul 5 12:54:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:31.632118 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf3ea8-f871-471b-ab12-d37f47e33965 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:31.632413 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf3ea8-f871-471b-ab12-d37f47e33965 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:31.632730 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf3ea8-f871-471b-ab12-d37f47e33965 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:31.634078 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 713/1412] 10.222.0.36 () {54 vars in 918 bytes} [Tue Jul 5 12:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:31.638478 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77339ea4-860d-4c42-ab0a-3a1a41ee5d45 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:31.638783 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77339ea4-860d-4c42-ab0a-3a1a41ee5d45 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:31.639062 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77339ea4-860d-4c42-ab0a-3a1a41ee5d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:31.656859 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-77339ea4-860d-4c42-ab0a-3a1a41ee5d45 None None] MFA Rules not processed for user `cdf37a42279a466b85906b23751f9c22`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:31.658031 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-77339ea4-860d-4c42-ab0a-3a1a41ee5d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:31.666983 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 700/1413] 10.222.0.36 () {58 vars in 1015 bytes} [Tue Jul 5 12:54:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:54:34.149076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159858c-eff2-4d56-93aa-30c7303cfe91 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:34.149486 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159858c-eff2-4d56-93aa-30c7303cfe91 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:34.149634 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159858c-eff2-4d56-93aa-30c7303cfe91 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:34.151047 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:34.156453 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a5951-401b-4423-9c95-ad35ec9c7f6b None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:34.159173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a5951-401b-4423-9c95-ad35ec9c7f6b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:34.159173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a5951-401b-4423-9c95-ad35ec9c7f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:34.175458 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d07a5951-401b-4423-9c95-ad35ec9c7f6b None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:34.176699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d07a5951-401b-4423-9c95-ad35ec9c7f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:34.185327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:34.227636 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159858c-eff2-4d56-93aa-30c7303cfe91 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:34.242671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159858c-eff2-4d56-93aa-30c7303cfe91 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:34.248888 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f307f-23f9-4b89-9426-e74ee769e72a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:34.249537 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f307f-23f9-4b89-9426-e74ee769e72a service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:34.249824 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f307f-23f9-4b89-9426-e74ee769e72a service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:34.250106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f307f-23f9-4b89-9426-e74ee769e72a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:34.258379 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f307f-23f9-4b89-9426-e74ee769e72a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:34.259975 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f307f-23f9-4b89-9426-e74ee769e72a service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:34.269459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 715/1416] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:35.163607 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6d304-2c1a-48a5-8b4a-5b9add7d3a1e None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:35.164159 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6d304-2c1a-48a5-8b4a-5b9add7d3a1e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:35.164159 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6d304-2c1a-48a5-8b4a-5b9add7d3a1e None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:35.165586 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:35.170471 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710d905-8788-4cbb-bfe8-06384c613209 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:35.170910 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710d905-8788-4cbb-bfe8-06384c613209 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:35.171045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710d905-8788-4cbb-bfe8-06384c613209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:35.189288 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-7710d905-8788-4cbb-bfe8-06384c613209 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:35.190498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7710d905-8788-4cbb-bfe8-06384c613209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:35.198238 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:35.348636 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6d304-2c1a-48a5-8b4a-5b9add7d3a1e None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:35.362954 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6d304-2c1a-48a5-8b4a-5b9add7d3a1e None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:35.368319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02fcec-9fac-4db9-becc-90f4096435d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:35.368982 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02fcec-9fac-4db9-becc-90f4096435d1 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:35.369265 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02fcec-9fac-4db9-becc-90f4096435d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:35.369544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02fcec-9fac-4db9-becc-90f4096435d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:35.378097 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02fcec-9fac-4db9-becc-90f4096435d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:35.379722 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02fcec-9fac-4db9-becc-90f4096435d1 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:35.389626 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 703/1419] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:36.261724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5044f-c90d-4eb2-bc9f-dfc67b029fee None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:36.262255 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5044f-c90d-4eb2-bc9f-dfc67b029fee None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:36.262373 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5044f-c90d-4eb2-bc9f-dfc67b029fee None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:36.263705 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:36.268770 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e392d-3866-4a47-bc35-176a4bdaa621 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:36.269224 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e392d-3866-4a47-bc35-176a4bdaa621 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:36.269321 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e392d-3866-4a47-bc35-176a4bdaa621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:36.286761 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f43e392d-3866-4a47-bc35-176a4bdaa621 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:36.287958 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f43e392d-3866-4a47-bc35-176a4bdaa621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:36.296239 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:36.446299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5044f-c90d-4eb2-bc9f-dfc67b029fee None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:36.461003 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5044f-c90d-4eb2-bc9f-dfc67b029fee None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:36.467257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea1fb5-5bf8-4513-8c4f-b6ae657e47f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:36.467893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea1fb5-5bf8-4513-8c4f-b6ae657e47f5 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:36.468178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea1fb5-5bf8-4513-8c4f-b6ae657e47f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:36.468456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea1fb5-5bf8-4513-8c4f-b6ae657e47f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:36.476800 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea1fb5-5bf8-4513-8c4f-b6ae657e47f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:36.478393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea1fb5-5bf8-4513-8c4f-b6ae657e47f5 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:36.488143 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 718/1422] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:37.334344 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcf87c-09db-48c6-b87d-c9321b8fa025 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:37.334804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcf87c-09db-48c6-b87d-c9321b8fa025 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:37.334912 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcf87c-09db-48c6-b87d-c9321b8fa025 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:37.336236 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:54:37.341207 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af582e-ba07-4cd1-9d39-f3afd9783054 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:37.341621 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af582e-ba07-4cd1-9d39-f3afd9783054 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:37.341770 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af582e-ba07-4cd1-9d39-f3afd9783054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:37.359574 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-e7af582e-ba07-4cd1-9d39-f3afd9783054 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:37.360816 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e7af582e-ba07-4cd1-9d39-f3afd9783054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:37.368522 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:54:37.522094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcf87c-09db-48c6-b87d-c9321b8fa025 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:37.536066 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcf87c-09db-48c6-b87d-c9321b8fa025 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:37.541293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d42c7b-69a5-4182-a6f2-d1447ce3a60d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:37.541918 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d42c7b-69a5-4182-a6f2-d1447ce3a60d service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:37.542200 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d42c7b-69a5-4182-a6f2-d1447ce3a60d service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:37.542476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d42c7b-69a5-4182-a6f2-d1447ce3a60d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:37.550573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d42c7b-69a5-4182-a6f2-d1447ce3a60d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:37.552162 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d42c7b-69a5-4182-a6f2-d1447ce3a60d service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:37.562217 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 706/1425] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:38.422690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fda35a-f137-4c20-a1b9-1a8e5c51da2c None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:38.423221 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fda35a-f137-4c20-a1b9-1a8e5c51da2c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:38.423221 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fda35a-f137-4c20-a1b9-1a8e5c51da2c None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:38.424528 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:38.429434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68300b-020b-4f61-a31f-03635fddc211 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:38.429866 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68300b-020b-4f61-a31f-03635fddc211 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:38.430022 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68300b-020b-4f61-a31f-03635fddc211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:38.448093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ed68300b-020b-4f61-a31f-03635fddc211 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:38.449336 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ed68300b-020b-4f61-a31f-03635fddc211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:38.457062 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:38.606508 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fda35a-f137-4c20-a1b9-1a8e5c51da2c None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:38.620531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fda35a-f137-4c20-a1b9-1a8e5c51da2c None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:38.626429 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87eca8-7908-41c3-ad77-c05ffc91b1cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:38.627063 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87eca8-7908-41c3-ad77-c05ffc91b1cb service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:38.627348 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87eca8-7908-41c3-ad77-c05ffc91b1cb service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:38.627627 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87eca8-7908-41c3-ad77-c05ffc91b1cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:38.635597 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87eca8-7908-41c3-ad77-c05ffc91b1cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:38.637226 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87eca8-7908-41c3-ad77-c05ffc91b1cb service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:38.646509 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 721/1428] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:39.531666 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc586ff-2191-4d4c-8d43-771d1b8c9cc1 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:39.532193 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc586ff-2191-4d4c-8d43-771d1b8c9cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:39.532292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc586ff-2191-4d4c-8d43-771d1b8c9cc1 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:39.533658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:39.538527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1738f8b-4051-417d-8b64-0615660fdf9b None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:39.538959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1738f8b-4051-417d-8b64-0615660fdf9b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:39.539069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1738f8b-4051-417d-8b64-0615660fdf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:39.557212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-f1738f8b-4051-417d-8b64-0615660fdf9b None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:39.558438 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f1738f8b-4051-417d-8b64-0615660fdf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:39.566143 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:39.717000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc586ff-2191-4d4c-8d43-771d1b8c9cc1 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:39.731821 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc586ff-2191-4d4c-8d43-771d1b8c9cc1 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:39.737103 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf70ed3-c313-421d-beea-d09cbf983ce4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:39.737736 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf70ed3-c313-421d-beea-d09cbf983ce4 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:39.738015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf70ed3-c313-421d-beea-d09cbf983ce4 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:39.738287 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf70ed3-c313-421d-beea-d09cbf983ce4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:39.746254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf70ed3-c313-421d-beea-d09cbf983ce4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:39.747819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf70ed3-c313-421d-beea-d09cbf983ce4 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:39.757119 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 709/1431] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:40.629139 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a108d59-e788-44bb-8da1-8ec25197751c None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:40.629712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a108d59-e788-44bb-8da1-8ec25197751c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:40.629712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a108d59-e788-44bb-8da1-8ec25197751c None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:40.631114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:40.635876 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d643e-0b48-4df0-9ec0-735340a77c91 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:40.636319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d643e-0b48-4df0-9ec0-735340a77c91 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:40.636429 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d643e-0b48-4df0-9ec0-735340a77c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:40.654938 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-047d643e-0b48-4df0-9ec0-735340a77c91 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:40.656147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-047d643e-0b48-4df0-9ec0-735340a77c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:40.663924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:40.848522 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a108d59-e788-44bb-8da1-8ec25197751c None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:40.863006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a108d59-e788-44bb-8da1-8ec25197751c None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:40.868622 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4df8f-e88f-4f29-be69-b8625871f5db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:40.869265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4df8f-e88f-4f29-be69-b8625871f5db service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:40.869581 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4df8f-e88f-4f29-be69-b8625871f5db service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:40.869863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4df8f-e88f-4f29-be69-b8625871f5db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:40.878330 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4df8f-e88f-4f29-be69-b8625871f5db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:40.880001 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4df8f-e88f-4f29-be69-b8625871f5db service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:40.889943 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 724/1434] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:41.751573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031ed92-0c07-4702-962a-b0822cd24888 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:41.752110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031ed92-0c07-4702-962a-b0822cd24888 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:41.752110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031ed92-0c07-4702-962a-b0822cd24888 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:41.753471 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:41.758461 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51880e1e-aa53-45f2-b068-9dd4b3cbe413 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:41.758923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51880e1e-aa53-45f2-b068-9dd4b3cbe413 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:41.759022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51880e1e-aa53-45f2-b068-9dd4b3cbe413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:41.777622 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-51880e1e-aa53-45f2-b068-9dd4b3cbe413 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:41.778818 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-51880e1e-aa53-45f2-b068-9dd4b3cbe413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:41.786430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:41.938859 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031ed92-0c07-4702-962a-b0822cd24888 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:41.953456 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031ed92-0c07-4702-962a-b0822cd24888 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:41.958699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dd656-b27b-4e6a-8bf1-894288ef7f32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:41.959330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dd656-b27b-4e6a-8bf1-894288ef7f32 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:41.959612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dd656-b27b-4e6a-8bf1-894288ef7f32 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:41.959888 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dd656-b27b-4e6a-8bf1-894288ef7f32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:41.967737 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71dd656-b27b-4e6a-8bf1-894288ef7f32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:41.969353 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71dd656-b27b-4e6a-8bf1-894288ef7f32 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:41.978407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 712/1437] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:42.846441 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96ba4a-2542-4ab7-a0ea-68b36b0d3f2f None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:42.847034 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96ba4a-2542-4ab7-a0ea-68b36b0d3f2f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:42.847034 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96ba4a-2542-4ab7-a0ea-68b36b0d3f2f None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:42.848367 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:42.853239 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f43da-3925-4849-8466-94c8636c0fe3 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:42.853646 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f43da-3925-4849-8466-94c8636c0fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:42.853862 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f43da-3925-4849-8466-94c8636c0fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:42.872210 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c08f43da-3925-4849-8466-94c8636c0fe3 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:42.873434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c08f43da-3925-4849-8466-94c8636c0fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:42.881436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:43.030013 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96ba4a-2542-4ab7-a0ea-68b36b0d3f2f None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:43.044312 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96ba4a-2542-4ab7-a0ea-68b36b0d3f2f None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:43.049829 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36446da0-c611-43ff-8424-1f0bc7af742b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:43.050476 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36446da0-c611-43ff-8424-1f0bc7af742b service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:43.050763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36446da0-c611-43ff-8424-1f0bc7af742b service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:43.051040 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36446da0-c611-43ff-8424-1f0bc7af742b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:43.059467 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36446da0-c611-43ff-8424-1f0bc7af742b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:43.061099 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36446da0-c611-43ff-8424-1f0bc7af742b service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:43.070905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 727/1440] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:44.976400 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbdf58-93df-49bb-bb39-618d88349efa None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:44.976996 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbdf58-93df-49bb-bb39-618d88349efa None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:44.976996 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbdf58-93df-49bb-bb39-618d88349efa None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:44.978417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:44.983913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34684ce4-45c5-496e-a4bb-64d84a12e51a None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:44.984363 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34684ce4-45c5-496e-a4bb-64d84a12e51a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:44.984463 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34684ce4-45c5-496e-a4bb-64d84a12e51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:45.002836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-34684ce4-45c5-496e-a4bb-64d84a12e51a None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:45.004060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-34684ce4-45c5-496e-a4bb-64d84a12e51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:45.012511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:45.049858 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbdf58-93df-49bb-bb39-618d88349efa None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:45.061138 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbdf58-93df-49bb-bb39-618d88349efa None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:45.064698 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0ad7c-7483-4e00-9c34-b20189c112df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:45.065345 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0ad7c-7483-4e00-9c34-b20189c112df service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:45.065632 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0ad7c-7483-4e00-9c34-b20189c112df service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:45.066298 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0ad7c-7483-4e00-9c34-b20189c112df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:45.075521 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0ad7c-7483-4e00-9c34-b20189c112df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:45.077018 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0ad7c-7483-4e00-9c34-b20189c112df service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:45.086601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 715/1443] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:47.244096 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ff68e-032a-457f-bfe4-a05fb936909e None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:47.244628 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ff68e-032a-457f-bfe4-a05fb936909e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:47.244628 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ff68e-032a-457f-bfe4-a05fb936909e None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:47.246507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:54:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:47.251927 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff77b2c-59a4-4225-9b49-f06b5dc1dc1c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:47.252331 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff77b2c-59a4-4225-9b49-f06b5dc1dc1c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:47.252491 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff77b2c-59a4-4225-9b49-f06b5dc1dc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:47.270416 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2ff77b2c-59a4-4225-9b49-f06b5dc1dc1c None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:47.271608 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2ff77b2c-59a4-4225-9b49-f06b5dc1dc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:47.279333 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:47.316858 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ff68e-032a-457f-bfe4-a05fb936909e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:47.327959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ff68e-032a-457f-bfe4-a05fb936909e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:47.331428 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055481bb-b86c-4979-a6b1-5cf7ad44d57d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:47.332057 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055481bb-b86c-4979-a6b1-5cf7ad44d57d service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:47.332340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055481bb-b86c-4979-a6b1-5cf7ad44d57d service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:47.332643 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055481bb-b86c-4979-a6b1-5cf7ad44d57d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:47.341427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055481bb-b86c-4979-a6b1-5cf7ad44d57d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:47.342861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055481bb-b86c-4979-a6b1-5cf7ad44d57d service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:47.352178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 730/1446] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:49.759427 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22e7e2-2cec-4133-8135-ed727b1cb0e7 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:49.759983 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22e7e2-2cec-4133-8135-ed727b1cb0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:49.759983 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22e7e2-2cec-4133-8135-ed727b1cb0e7 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:49.761919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:54:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:49.767229 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e066a-a118-4ecc-8855-e382eb83152f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:49.767660 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e066a-a118-4ecc-8855-e382eb83152f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:49.767802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e066a-a118-4ecc-8855-e382eb83152f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:49.785949 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-599e066a-a118-4ecc-8855-e382eb83152f None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:49.788075 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-599e066a-a118-4ecc-8855-e382eb83152f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:49.795007 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:49.832744 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22e7e2-2cec-4133-8135-ed727b1cb0e7 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:49.843994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22e7e2-2cec-4133-8135-ed727b1cb0e7 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:49.847497 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa974f-a272-458f-874c-2a1140b02e51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:49.848130 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa974f-a272-458f-874c-2a1140b02e51 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:49.848412 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa974f-a272-458f-874c-2a1140b02e51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:49.848728 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa974f-a272-458f-874c-2a1140b02e51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:49.860173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa974f-a272-458f-874c-2a1140b02e51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:49.861586 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa974f-a272-458f-874c-2a1140b02e51 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:49.875670 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 718/1449] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:52.014716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a4002-dffa-49f2-9648-4939d60c80c9 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:52.015372 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a4002-dffa-49f2-9648-4939d60c80c9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:52.015372 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a4002-dffa-49f2-9648-4939d60c80c9 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:52.016668 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:52.021753 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9495689-2082-40ea-8dd7-da15235a714b None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:52.022167 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9495689-2082-40ea-8dd7-da15235a714b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:52.022307 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9495689-2082-40ea-8dd7-da15235a714b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:52.039614 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b9495689-2082-40ea-8dd7-da15235a714b None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:52.040838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b9495689-2082-40ea-8dd7-da15235a714b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:52.049353 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:52.087677 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a4002-dffa-49f2-9648-4939d60c80c9 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:52.098247 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a4002-dffa-49f2-9648-4939d60c80c9 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:52.101717 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb005e10-4f1b-4f8c-882a-3324085fd24f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:52.102353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb005e10-4f1b-4f8c-882a-3324085fd24f service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:52.102637 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb005e10-4f1b-4f8c-882a-3324085fd24f service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:52.102914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb005e10-4f1b-4f8c-882a-3324085fd24f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:52.112910 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb005e10-4f1b-4f8c-882a-3324085fd24f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:52.114336 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb005e10-4f1b-4f8c-882a-3324085fd24f service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:52.124208 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 733/1452] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:54.186418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45541f54-9532-41de-85d3-c9994eadfd9b None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:54.187014 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45541f54-9532-41de-85d3-c9994eadfd9b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:54.187014 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45541f54-9532-41de-85d3-c9994eadfd9b None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:54.188354 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:54.193676 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f29b3-a362-464e-84c1-0c11144255eb None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:54.194099 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f29b3-a362-464e-84c1-0c11144255eb None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:54.194234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f29b3-a362-464e-84c1-0c11144255eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:54.211547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-252f29b3-a362-464e-84c1-0c11144255eb None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:54.212770 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-252f29b3-a362-464e-84c1-0c11144255eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:54.220368 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:54.261398 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45541f54-9532-41de-85d3-c9994eadfd9b None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:54.272162 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45541f54-9532-41de-85d3-c9994eadfd9b None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:54.275668 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc6b2f-b7d7-411d-857b-7b8dce0daf7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:54.276301 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc6b2f-b7d7-411d-857b-7b8dce0daf7e service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:54.276612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc6b2f-b7d7-411d-857b-7b8dce0daf7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:54.276893 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc6b2f-b7d7-411d-857b-7b8dce0daf7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:54.285637 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc6b2f-b7d7-411d-857b-7b8dce0daf7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:54.287054 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc6b2f-b7d7-411d-857b-7b8dce0daf7e service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:54.296822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 721/1455] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:54:56.367473 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a098a5-8cab-4b0b-aa60-a28c94932138 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:56.367983 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a098a5-8cab-4b0b-aa60-a28c94932138 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:56.367983 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a098a5-8cab-4b0b-aa60-a28c94932138 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:56.369356 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:56.375157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2eed3b-d93c-40bb-a66d-d68b74732521 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:56.375557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2eed3b-d93c-40bb-a66d-d68b74732521 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:56.375747 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2eed3b-d93c-40bb-a66d-d68b74732521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:56.393935 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-8a2eed3b-d93c-40bb-a66d-d68b74732521 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:56.395141 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8a2eed3b-d93c-40bb-a66d-d68b74732521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:56.402921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:56.440790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a098a5-8cab-4b0b-aa60-a28c94932138 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:56.451383 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a098a5-8cab-4b0b-aa60-a28c94932138 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:56.454894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503a987-8a50-4d61-a6c8-39b68bd2faa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:56.455526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503a987-8a50-4d61-a6c8-39b68bd2faa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:56.455811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503a987-8a50-4d61-a6c8-39b68bd2faa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:56.456089 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503a987-8a50-4d61-a6c8-39b68bd2faa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:56.464944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503a987-8a50-4d61-a6c8-39b68bd2faa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:56.466376 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503a987-8a50-4d61-a6c8-39b68bd2faa6 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:56.480101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 736/1458] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:54:58.635549 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0be757-63af-4ede-bad8-ce06bb912c00 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:58.636113 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0be757-63af-4ede-bad8-ce06bb912c00 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:58.636113 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0be757-63af-4ede-bad8-ce06bb912c00 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:58.637519 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:54:58.642668 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dc3b4-e5e9-4249-aaeb-9dc5733cee7f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:58.643089 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dc3b4-e5e9-4249-aaeb-9dc5733cee7f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:58.643231 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dc3b4-e5e9-4249-aaeb-9dc5733cee7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:58.660964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-194dc3b4-e5e9-4249-aaeb-9dc5733cee7f None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:54:58.662169 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-194dc3b4-e5e9-4249-aaeb-9dc5733cee7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:54:58.670466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:54:58.707984 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0be757-63af-4ede-bad8-ce06bb912c00 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:54:58.719083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0be757-63af-4ede-bad8-ce06bb912c00 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:54:58.722545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c7e1a-6606-4822-a2f5-9e5498ea505b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:54:58.723169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c7e1a-6606-4822-a2f5-9e5498ea505b service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:54:58.723451 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c7e1a-6606-4822-a2f5-9e5498ea505b service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:54:58.723725 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c7e1a-6606-4822-a2f5-9e5498ea505b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:54:58.732646 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c7e1a-6606-4822-a2f5-9e5498ea505b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:54:58.734074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c7e1a-6606-4822-a2f5-9e5498ea505b service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:54:58.743225 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 724/1461] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:54:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:55:00.805232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a9d4e-c726-4d28-a2ea-86a3658746d7 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:00.805801 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a9d4e-c726-4d28-a2ea-86a3658746d7 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:00.805801 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a9d4e-c726-4d28-a2ea-86a3658746d7 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:00.807767 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:55:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:55:00.813025 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db2f3f-201a-4093-9e71-55250cb0fc50 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:00.813470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db2f3f-201a-4093-9e71-55250cb0fc50 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:00.813598 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db2f3f-201a-4093-9e71-55250cb0fc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:00.819527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=79 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:55:00.832362 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f4db2f3f-201a-4093-9e71-55250cb0fc50 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:55:00.835713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f4db2f3f-201a-4093-9e71-55250cb0fc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:55:00.843741 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:55:00.896740 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a9d4e-c726-4d28-a2ea-86a3658746d7 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:55:00.902246 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=73 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:55:00.908030 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a9d4e-c726-4d28-a2ea-86a3658746d7 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:55:00.911513 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201f382-1baf-45a9-bcee-b26367e91c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:55:00.921765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201f382-1baf-45a9-bcee-b26367e91c50 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:00.921765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201f382-1baf-45a9-bcee-b26367e91c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:00.921765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201f382-1baf-45a9-bcee-b26367e91c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:00.922156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201f382-1baf-45a9-bcee-b26367e91c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:55:00.923598 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201f382-1baf-45a9-bcee-b26367e91c50 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:55:00.933594 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 739/1464] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:55:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:55:02.958943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3a633-d040-4f64-a3c9-873b49fac2dd None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:02.959520 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3a633-d040-4f64-a3c9-873b49fac2dd None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:02.959520 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3a633-d040-4f64-a3c9-873b49fac2dd None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:02.960894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:55:02.966620 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4c6cc-bb00-465c-9806-895f8d2ee96c None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:02.967024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4c6cc-bb00-465c-9806-895f8d2ee96c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:02.967171 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4c6cc-bb00-465c-9806-895f8d2ee96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:02.985368 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-c8e4c6cc-bb00-465c-9806-895f8d2ee96c None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:55:02.986559 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c8e4c6cc-bb00-465c-9806-895f8d2ee96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:55:02.994309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:55:03.029800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3a633-d040-4f64-a3c9-873b49fac2dd None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:55:03.040451 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3a633-d040-4f64-a3c9-873b49fac2dd None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:55:03.044487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2fc62-e643-4cb2-8a7f-9823826f2616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:55:03.045152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2fc62-e643-4cb2-8a7f-9823826f2616 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:03.045437 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2fc62-e643-4cb2-8a7f-9823826f2616 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:03.045714 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2fc62-e643-4cb2-8a7f-9823826f2616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:03.055000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2fc62-e643-4cb2-8a7f-9823826f2616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:55:03.059343 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2fc62-e643-4cb2-8a7f-9823826f2616 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:55:03.065996 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 727/1467] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:55:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:55:05.149188 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fccc47-26af-43d9-b5d1-4a1d210fc29a None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:05.149714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fccc47-26af-43d9-b5d1-4a1d210fc29a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:05.149843 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fccc47-26af-43d9-b5d1-4a1d210fc29a None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:05.151628 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:55:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:55:05.157048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61bac3-fa66-456d-9abc-a13b023c80f7 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:05.157482 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61bac3-fa66-456d-9abc-a13b023c80f7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:05.157614 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61bac3-fa66-456d-9abc-a13b023c80f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:05.176141 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-8e61bac3-fa66-456d-9abc-a13b023c80f7 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:55:05.177382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8e61bac3-fa66-456d-9abc-a13b023c80f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:55:05.185233 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:55:05.221724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fccc47-26af-43d9-b5d1-4a1d210fc29a None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:55:05.223402 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-52fccc47-26af-43d9-b5d1-4a1d210fc29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:55:05.237010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fccc47-26af-43d9-b5d1-4a1d210fc29a None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:55:05.240463 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cd09a-db61-4982-a504-ed65a5554a5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:55:05.241131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cd09a-db61-4982-a504-ed65a5554a5e service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:05.241416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cd09a-db61-4982-a504-ed65a5554a5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:05.241695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cd09a-db61-4982-a504-ed65a5554a5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:05.250584 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cd09a-db61-4982-a504-ed65a5554a5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:55:05.252035 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cd09a-db61-4982-a504-ed65a5554a5e service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:55:05.261537 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 742/1470] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:55:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:55:15.170467 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=11 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:55:15.257333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=14 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:55:25.049908 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea73a1-c3f2-46e8-be84-2b46de60529f None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:25.050507 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea73a1-c3f2-46e8-be84-2b46de60529f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:25.050507 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea73a1-c3f2-46e8-be84-2b46de60529f None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:25.051996 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 729/1471] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:55:25.057361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c35ef-e619-4772-9560-3901fcb2014b None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:25.057818 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c35ef-e619-4772-9560-3901fcb2014b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:25.057927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c35ef-e619-4772-9560-3901fcb2014b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:25.076647 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a72c35ef-e619-4772-9560-3901fcb2014b None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:55:25.077841 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a72c35ef-e619-4772-9560-3901fcb2014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:55:25.085576 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 743/1472] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:55:25.169491 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437bbb0-ee46-406e-88b4-fd62e1764705 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:25.169786 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437bbb0-ee46-406e-88b4-fd62e1764705 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:25.170066 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437bbb0-ee46-406e-88b4-fd62e1764705 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:25.171425 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 730/1473] 10.222.0.36 () {54 vars in 962 bytes} [Tue Jul 5 12:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:55:25.176102 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23995d72-8cea-46cb-b2ab-5402ee3dc6d2 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:25.176390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23995d72-8cea-46cb-b2ab-5402ee3dc6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:25.176703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23995d72-8cea-46cb-b2ab-5402ee3dc6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:25.194050 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-23995d72-8cea-46cb-b2ab-5402ee3dc6d2 None None] MFA Rules not processed for user `7e7c4b0bd50c474996a21b69bde4e227`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:55:25.195237 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-23995d72-8cea-46cb-b2ab-5402ee3dc6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:55:25.202108 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 744/1474] 10.222.0.36 () {58 vars in 1059 bytes} [Tue Jul 5 12:55:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:55:25.209305 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437bbb0-ee46-406e-88b4-fd62e1764705 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:55:25.220260 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437bbb0-ee46-406e-88b4-fd62e1764705 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:55:25.223777 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0acdb-ad2b-4df8-83d3-0d3dcaefbe11 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e7c4b0bd50c474996a21b69bde4e227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:55:25.224399 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0acdb-ad2b-4df8-83d3-0d3dcaefbe11 service glance] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:25.224716 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0acdb-ad2b-4df8-83d3-0d3dcaefbe11 service glance] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:25.224998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0acdb-ad2b-4df8-83d3-0d3dcaefbe11 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:25.234010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0acdb-ad2b-4df8-83d3-0d3dcaefbe11 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:55:25.235427 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0acdb-ad2b-4df8-83d3-0d3dcaefbe11 service glance] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:55:25.244941 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 731/1475] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:55:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 12:55:27.357801 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48c410-ecb4-4163-87b5-afc4e9e32d86 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:27.358251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48c410-ecb4-4163-87b5-afc4e9e32d86 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:27.358357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48c410-ecb4-4163-87b5-afc4e9e32d86 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:27.359745 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 745/1476] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:55:27.365037 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110841bc-99ae-4d88-a151-3caaa06d78cb None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:27.365466 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110841bc-99ae-4d88-a151-3caaa06d78cb None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:27.365624 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110841bc-99ae-4d88-a151-3caaa06d78cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:27.383389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-110841bc-99ae-4d88-a151-3caaa06d78cb None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:55:27.384664 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-110841bc-99ae-4d88-a151-3caaa06d78cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:55:27.392263 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 732/1477] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:55:27.414748 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48c410-ecb4-4163-87b5-afc4e9e32d86 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:55:27.427673 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48c410-ecb4-4163-87b5-afc4e9e32d86 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:55:27.432839 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca2be0-4375-4fd1-b853-db96198cccfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:55:27.433487 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca2be0-4375-4fd1-b853-db96198cccfc admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:27.433771 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca2be0-4375-4fd1-b853-db96198cccfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:27.434051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca2be0-4375-4fd1-b853-db96198cccfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:27.434799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca2be0-4375-4fd1-b853-db96198cccfc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:55:27.436566 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: WARNING py.warnings [None req-a0ca2be0-4375-4fd1-b853-db96198cccfc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:55:27.436566 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: warnings.warn(msg) Jul 05 12:55:27.436566 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: Jul 05 12:55:27.437737 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca2be0-4375-4fd1-b853-db96198cccfc admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:55:27.456443 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 746/1478] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jul 5 12:55:27 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:55:29.504549 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096d3a0-f677-47b9-bc31-821a48aa2f63 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:29.505159 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096d3a0-f677-47b9-bc31-821a48aa2f63 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:29.505159 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096d3a0-f677-47b9-bc31-821a48aa2f63 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:29.506521 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 733/1479] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:55:29.512425 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1b0a4-1654-466f-b673-7fab4b73ddc9 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:29.512912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1b0a4-1654-466f-b673-7fab4b73ddc9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:29.513024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1b0a4-1654-466f-b673-7fab4b73ddc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:29.531778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-51e1b0a4-1654-466f-b673-7fab4b73ddc9 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:55:29.533048 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-51e1b0a4-1654-466f-b673-7fab4b73ddc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:55:29.541396 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 747/1480] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:55:29.585025 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096d3a0-f677-47b9-bc31-821a48aa2f63 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:55:29.599707 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096d3a0-f677-47b9-bc31-821a48aa2f63 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:55:29.605103 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364fc7f-9d4b-479d-b50a-fea4ba1f4faf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:55:29.605985 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364fc7f-9d4b-479d-b50a-fea4ba1f4faf service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:29.606266 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364fc7f-9d4b-479d-b50a-fea4ba1f4faf service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:29.606539 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364fc7f-9d4b-479d-b50a-fea4ba1f4faf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:29.614619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364fc7f-9d4b-479d-b50a-fea4ba1f4faf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:55:29.616203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364fc7f-9d4b-479d-b50a-fea4ba1f4faf service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:55:29.625779 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 734/1481] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:55:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:55:31.813992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac21d3b-aa62-42e6-8bb3-c2ea9ef48058 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:31.814546 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac21d3b-aa62-42e6-8bb3-c2ea9ef48058 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:31.814546 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac21d3b-aa62-42e6-8bb3-c2ea9ef48058 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:31.815919 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 748/1482] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:55:31.821663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41604153-4635-4987-beeb-c9f9a10a8a68 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:31.822096 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41604153-4635-4987-beeb-c9f9a10a8a68 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:31.822219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41604153-4635-4987-beeb-c9f9a10a8a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:31.840098 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-41604153-4635-4987-beeb-c9f9a10a8a68 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:55:31.841357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-41604153-4635-4987-beeb-c9f9a10a8a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:55:31.849122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 735/1483] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:55:31.885489 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac21d3b-aa62-42e6-8bb3-c2ea9ef48058 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:55:31.896107 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac21d3b-aa62-42e6-8bb3-c2ea9ef48058 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:55:31.900195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993896e9-69ed-49de-90a5-b2249fee4e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:55:31.900865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993896e9-69ed-49de-90a5-b2249fee4e15 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:31.901150 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993896e9-69ed-49de-90a5-b2249fee4e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:31.901432 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993896e9-69ed-49de-90a5-b2249fee4e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:31.910309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993896e9-69ed-49de-90a5-b2249fee4e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:55:31.911760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993896e9-69ed-49de-90a5-b2249fee4e15 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:55:31.921236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 749/1484] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:55:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:55:34.017766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f1c70-a8dc-4cc0-82da-1d28349d0ab8 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:34.018337 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f1c70-a8dc-4cc0-82da-1d28349d0ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:34.018337 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f1c70-a8dc-4cc0-82da-1d28349d0ab8 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:34.019700 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 736/1485] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:55:34.024873 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89594dc5-0a45-489d-88ef-dfe5e2a27e15 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:34.025335 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89594dc5-0a45-489d-88ef-dfe5e2a27e15 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:34.025436 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89594dc5-0a45-489d-88ef-dfe5e2a27e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:34.043196 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-89594dc5-0a45-489d-88ef-dfe5e2a27e15 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:55:34.049822 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-89594dc5-0a45-489d-88ef-dfe5e2a27e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:55:34.052401 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 750/1486] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:55:34.090933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f1c70-a8dc-4cc0-82da-1d28349d0ab8 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:55:34.103150 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f1c70-a8dc-4cc0-82da-1d28349d0ab8 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:55:34.107078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e3c8b-3fe4-4909-aa94-8ea3ce2d0811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:55:34.107717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e3c8b-3fe4-4909-aa94-8ea3ce2d0811 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:34.108007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e3c8b-3fe4-4909-aa94-8ea3ce2d0811 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:34.108290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e3c8b-3fe4-4909-aa94-8ea3ce2d0811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:34.117259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e3c8b-3fe4-4909-aa94-8ea3ce2d0811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:55:34.119360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e3c8b-3fe4-4909-aa94-8ea3ce2d0811 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:55:34.128773 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 737/1487] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:55:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:55:36.297634 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e8753-2281-450d-9a22-27c658399f8a None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:36.298216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e8753-2281-450d-9a22-27c658399f8a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:36.298216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e8753-2281-450d-9a22-27c658399f8a None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:36.299621 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 751/1488] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:55:36.304897 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc43f8d-bd82-4bce-b625-7a577c14b258 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:36.305845 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc43f8d-bd82-4bce-b625-7a577c14b258 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:36.306062 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc43f8d-bd82-4bce-b625-7a577c14b258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:36.323434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-0dc43f8d-bd82-4bce-b625-7a577c14b258 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:55:36.324611 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0dc43f8d-bd82-4bce-b625-7a577c14b258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:55:36.332403 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 738/1489] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:55:36.373317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e8753-2281-450d-9a22-27c658399f8a None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:55:36.383919 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e8753-2281-450d-9a22-27c658399f8a None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:55:36.387404 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf8946-4f29-421a-a35a-3d20e9765d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:55:36.388040 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf8946-4f29-421a-a35a-3d20e9765d78 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:36.388320 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf8946-4f29-421a-a35a-3d20e9765d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:36.388613 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf8946-4f29-421a-a35a-3d20e9765d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:36.397405 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf8946-4f29-421a-a35a-3d20e9765d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:55:36.398855 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf8946-4f29-421a-a35a-3d20e9765d78 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:55:36.408129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 752/1490] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:55:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:55:38.817932 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d9b8b-ab97-4ca3-8c7d-efe47a41975e None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:38.818516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d9b8b-ab97-4ca3-8c7d-efe47a41975e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:38.818516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d9b8b-ab97-4ca3-8c7d-efe47a41975e None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:38.819852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 739/1491] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jul 5 12:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:55:38.825250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4ced1-6717-482e-b36f-f3a8dda94ea0 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:38.825705 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4ced1-6717-482e-b36f-f3a8dda94ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:38.825840 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4ced1-6717-482e-b36f-f3a8dda94ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:38.843781 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-f3b4ced1-6717-482e-b36f-f3a8dda94ea0 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:55:38.845022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f3b4ced1-6717-482e-b36f-f3a8dda94ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:55:38.853351 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 753/1492] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jul 5 12:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:55:38.891571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d9b8b-ab97-4ca3-8c7d-efe47a41975e None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:55:38.902714 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d9b8b-ab97-4ca3-8c7d-efe47a41975e None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:55:38.906230 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2ea38-e49a-463e-990f-a431e45de179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:55:38.906869 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2ea38-e49a-463e-990f-a431e45de179 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:55:38.907154 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2ea38-e49a-463e-990f-a431e45de179 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:55:38.907432 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2ea38-e49a-463e-990f-a431e45de179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:55:38.916969 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2ea38-e49a-463e-990f-a431e45de179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:55:38.918402 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2ea38-e49a-463e-990f-a431e45de179 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:55:38.928098 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 740/1493] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:55:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:55:48.838847 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=33 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:55:48.923779 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=33 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:57:14.201312 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e313c1d-ce48-4d42-be31-d1df7a3d3a9a None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:57:14.201900 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e313c1d-ce48-4d42-be31-d1df7a3d3a9a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:57:14.201900 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e313c1d-ce48-4d42-be31-d1df7a3d3a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:57:14.219978 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-2e313c1d-ce48-4d42-be31-d1df7a3d3a9a None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:57:14.221206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2e313c1d-ce48-4d42-be31-d1df7a3d3a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:57:14.228927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 754/1494] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 12:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:57:14.237243 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e77d24-d19e-44c2-9890-6718413b4bcd None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:57:14.237724 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e77d24-d19e-44c2-9890-6718413b4bcd None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:57:14.237816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e77d24-d19e-44c2-9890-6718413b4bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:57:14.256045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d3e77d24-d19e-44c2-9890-6718413b4bcd None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:57:14.257264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d3e77d24-d19e-44c2-9890-6718413b4bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:57:14.265036 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 741/1495] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 12:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:57:14.269443 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e313c1d-ce48-4d42-be31-d1df7a3d3a9a None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:57:14.279655 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e313c1d-ce48-4d42-be31-d1df7a3d3a9a None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:57:14.284125 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edffe5-6bfb-4601-b175-1d8d6fe6b7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:57:14.284816 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edffe5-6bfb-4601-b175-1d8d6fe6b7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:57:14.285102 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edffe5-6bfb-4601-b175-1d8d6fe6b7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:57:14.285379 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edffe5-6bfb-4601-b175-1d8d6fe6b7d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:57:14.286108 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edffe5-6bfb-4601-b175-1d8d6fe6b7d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 12:57:14.286417 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edffe5-6bfb-4601-b175-1d8d6fe6b7d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:57:14.287433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: WARNING py.warnings [None req-c0edffe5-6bfb-4601-b175-1d8d6fe6b7d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:57:14.287433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: warnings.warn(msg) Jul 05 12:57:14.287433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: Jul 05 12:57:14.288320 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edffe5-6bfb-4601-b175-1d8d6fe6b7d4 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:57:14.299564 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 755/1496] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 12:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:57:14.307375 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e77d24-d19e-44c2-9890-6718413b4bcd None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:57:14.317010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e77d24-d19e-44c2-9890-6718413b4bcd None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:57:14.321432 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff76375-4cb7-4d36-9370-00a50c884ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:57:14.322073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff76375-4cb7-4d36-9370-00a50c884ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:57:14.322360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff76375-4cb7-4d36-9370-00a50c884ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:57:14.322646 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff76375-4cb7-4d36-9370-00a50c884ac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:57:14.323335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff76375-4cb7-4d36-9370-00a50c884ac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:57:14.325122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: WARNING py.warnings [None req-dff76375-4cb7-4d36-9370-00a50c884ac0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:57:14.325122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: warnings.warn(msg) Jul 05 12:57:14.325122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: Jul 05 12:57:14.326337 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff76375-4cb7-4d36-9370-00a50c884ac0 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:57:14.444847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 742/1497] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 12:57:14 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:57:14.449002 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edffe5-6bfb-4601-b175-1d8d6fe6b7d4 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:57:14.459766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edffe5-6bfb-4601-b175-1d8d6fe6b7d4 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:57:14.517696 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb124d-9fce-4599-aec0-1f031cf5a874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:57:14.518362 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb124d-9fce-4599-aec0-1f031cf5a874 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:57:14.518642 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb124d-9fce-4599-aec0-1f031cf5a874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:57:14.518919 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb124d-9fce-4599-aec0-1f031cf5a874 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:57:14.519607 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb124d-9fce-4599-aec0-1f031cf5a874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:57:14.520648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: WARNING py.warnings [None req-91cb124d-9fce-4599-aec0-1f031cf5a874 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:57:14.520648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: warnings.warn(msg) Jul 05 12:57:14.520648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: Jul 05 12:57:14.521869 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb124d-9fce-4599-aec0-1f031cf5a874 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:57:14.627879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 756/1498] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 12:57:14 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 12:57:14.632233 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff76375-4cb7-4d36-9370-00a50c884ac0 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:57:14.642556 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff76375-4cb7-4d36-9370-00a50c884ac0 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:57:14.647270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042d438-06e7-4b5f-b317-349da5301e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:57:14.647927 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042d438-06e7-4b5f-b317-349da5301e68 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:57:14.648211 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042d438-06e7-4b5f-b317-349da5301e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:57:14.648484 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042d438-06e7-4b5f-b317-349da5301e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:57:14.649256 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042d438-06e7-4b5f-b317-349da5301e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:57:14.650257 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: WARNING py.warnings [None req-c042d438-06e7-4b5f-b317-349da5301e68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:57:14.650257 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: warnings.warn(msg) Jul 05 12:57:14.650257 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: Jul 05 12:57:14.651262 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042d438-06e7-4b5f-b317-349da5301e68 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:57:14.664140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 743/1499] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 12:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:57:14.668191 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb124d-9fce-4599-aec0-1f031cf5a874 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:57:14.678545 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb124d-9fce-4599-aec0-1f031cf5a874 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:57:14.683040 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915cf50-3487-423d-9d10-4bcaabdfbe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:57:14.683690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915cf50-3487-423d-9d10-4bcaabdfbe74 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:57:14.684002 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915cf50-3487-423d-9d10-4bcaabdfbe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:57:14.684277 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915cf50-3487-423d-9d10-4bcaabdfbe74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:57:14.685039 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915cf50-3487-423d-9d10-4bcaabdfbe74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:57:14.686040 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: WARNING py.warnings [None req-b915cf50-3487-423d-9d10-4bcaabdfbe74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:57:14.686040 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: warnings.warn(msg) Jul 05 12:57:14.686040 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: Jul 05 12:57:14.686925 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915cf50-3487-423d-9d10-4bcaabdfbe74 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:57:14.700092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 757/1500] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 12:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 12:57:14.704050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042d438-06e7-4b5f-b317-349da5301e68 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:57:14.713950 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042d438-06e7-4b5f-b317-349da5301e68 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:57:14.718379 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1ed58-aacd-4f59-83e4-5620b86297cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:57:14.719239 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1ed58-aacd-4f59-83e4-5620b86297cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:57:14.719523 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1ed58-aacd-4f59-83e4-5620b86297cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:57:14.719798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1ed58-aacd-4f59-83e4-5620b86297cf admin admin] PATH_INFO: `/v3/projects/782659ccfd384012af054e267e122dae/users/b0874b00bc2147e6a6e4768f4c54fde0/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:57:14.734371 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1ed58-aacd-4f59-83e4-5620b86297cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=782659ccfd384012af054e267e122dae, user_id=b0874b00bc2147e6a6e4768f4c54fde0, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:57:14.735374 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: WARNING py.warnings [None req-b0f1ed58-aacd-4f59-83e4-5620b86297cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:57:14.735374 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: warnings.warn(msg) Jul 05 12:57:14.735374 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: Jul 05 12:57:14.737342 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1ed58-aacd-4f59-83e4-5620b86297cf admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:57:14.832723 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 744/1501] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 12:57:14 2022] PUT /identity/v3/projects/782659ccfd384012af054e267e122dae/users/b0874b00bc2147e6a6e4768f4c54fde0/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:57:14.845075 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2ff39-b5e1-4e1e-b65b-b104ec41b5b7 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:57:14.845369 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2ff39-b5e1-4e1e-b65b-b104ec41b5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:57:14.845651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2ff39-b5e1-4e1e-b65b-b104ec41b5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:57:14.872954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-37b2ff39-b5e1-4e1e-b65b-b104ec41b5b7 None None] MFA Rules not processed for user `b0874b00bc2147e6a6e4768f4c54fde0`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:57:14.874157 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-37b2ff39-b5e1-4e1e-b65b-b104ec41b5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:57:14.935554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 758/1502] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 12:57:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 12:57:14.948826 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b9e32-ba77-447d-8079-d1bfbf578710 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:57:14.949115 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b9e32-ba77-447d-8079-d1bfbf578710 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:57:14.949390 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b9e32-ba77-447d-8079-d1bfbf578710 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:57:14.950777 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 745/1503] 10.222.0.36 () {54 vars in 963 bytes} [Tue Jul 5 12:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:57:14.955665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656d57d-cc49-422c-977b-bde917a824cc None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:57:14.955959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656d57d-cc49-422c-977b-bde917a824cc None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:57:14.956238 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656d57d-cc49-422c-977b-bde917a824cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:57:14.974395 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-0656d57d-cc49-422c-977b-bde917a824cc None None] MFA Rules not processed for user `4bb924cdb5aa48ba9dfcc7be7e912991`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:57:14.975604 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0656d57d-cc49-422c-977b-bde917a824cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:57:15.019096 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:57:15.026407 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 759/1504] 10.222.0.36 () {58 vars in 1060 bytes} [Tue Jul 5 12:57:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:57:15.034295 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b9e32-ba77-447d-8079-d1bfbf578710 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:57:15.045421 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b9e32-ba77-447d-8079-d1bfbf578710 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:57:15.048998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498c3b4-9b48-4a08-bf27-2dfa03c0508e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:57:15.054505 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498c3b4-9b48-4a08-bf27-2dfa03c0508e service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:57:15.054505 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498c3b4-9b48-4a08-bf27-2dfa03c0508e service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:57:15.054505 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498c3b4-9b48-4a08-bf27-2dfa03c0508e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:57:15.059317 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498c3b4-9b48-4a08-bf27-2dfa03c0508e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:57:15.060850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498c3b4-9b48-4a08-bf27-2dfa03c0508e service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:57:15.069813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 746/1505] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:57:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:57:15.119850 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c063dad-539b-487d-852a-550e88781455 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:57:15.123551 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c063dad-539b-487d-852a-550e88781455 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:57:15.123551 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c063dad-539b-487d-852a-550e88781455 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:57:15.123551 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 760/1506] 10.222.0.36 () {52 vars in 829 bytes} [Tue Jul 5 12:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:57:15.125165 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498c3b4-9b48-4a08-bf27-2dfa03c0508e service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:57:15.188072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498c3b4-9b48-4a08-bf27-2dfa03c0508e service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:57:15.192552 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf47c5-a085-499b-962b-075988374597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:57:15.193436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf47c5-a085-499b-962b-075988374597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:57:15.193739 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf47c5-a085-499b-962b-075988374597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:57:15.193994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf47c5-a085-499b-962b-075988374597 admin admin] PATH_INFO: `/v3/users/b0874b00bc2147e6a6e4768f4c54fde0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:57:15.195171 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf47c5-a085-499b-962b-075988374597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0874b00bc2147e6a6e4768f4c54fde0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:57:15.196168 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: WARNING py.warnings [None req-8abf47c5-a085-499b-962b-075988374597 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:57:15.196168 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: warnings.warn(msg) Jul 05 12:57:15.196168 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: Jul 05 12:57:15.197452 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf47c5-a085-499b-962b-075988374597 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:57:15.600171 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8abf47c5-a085-499b-962b-075988374597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0874b00bc2147e6a6e4768f4c54fde0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:57:15.612624 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8abf47c5-a085-499b-962b-075988374597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0874b00bc2147e6a6e4768f4c54fde0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:57:15.613373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8abf47c5-a085-499b-962b-075988374597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0874b00bc2147e6a6e4768f4c54fde0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:57:15.613991 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8abf47c5-a085-499b-962b-075988374597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0874b00bc2147e6a6e4768f4c54fde0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:57:15.632706 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8abf47c5-a085-499b-962b-075988374597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0874b00bc2147e6a6e4768f4c54fde0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:57:15.636739 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:57:15.776459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 747/1507] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 12:57:15 2022] DELETE /identity/v3/users/b0874b00bc2147e6a6e4768f4c54fde0 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:57:15.781071 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf2eb5-fba1-4327-9b14-519aaf39c52f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:57:15.781542 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf2eb5-fba1-4327-9b14-519aaf39c52f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:57:15.781684 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf2eb5-fba1-4327-9b14-519aaf39c52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:57:15.798917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-eedf2eb5-fba1-4327-9b14-519aaf39c52f None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:57:15.800138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-eedf2eb5-fba1-4327-9b14-519aaf39c52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:57:15.858248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 761/1508] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 12:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:57:15.867747 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf47c5-a085-499b-962b-075988374597 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:57:15.881126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8abf47c5-a085-499b-962b-075988374597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:57:15.926659 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf47c5-a085-499b-962b-075988374597 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:57:15.930403 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d7553-9e1f-4175-90cf-2f4f8ebdc290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:57:15.931050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d7553-9e1f-4175-90cf-2f4f8ebdc290 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:57:15.931359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d7553-9e1f-4175-90cf-2f4f8ebdc290 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:57:15.931639 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d7553-9e1f-4175-90cf-2f4f8ebdc290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:57:15.940610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d7553-9e1f-4175-90cf-2f4f8ebdc290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:57:15.942566 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d7553-9e1f-4175-90cf-2f4f8ebdc290 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:57:15.952282 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 748/1509] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:57:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:57:16.514143 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf2eb5-fba1-4327-9b14-519aaf39c52f None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:57:16.515682 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-eedf2eb5-fba1-4327-9b14-519aaf39c52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:57:16.529603 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf2eb5-fba1-4327-9b14-519aaf39c52f None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:57:16.537571 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4a532-8e8f-4b6d-a2ee-dce063001766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:57:16.538441 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4a532-8e8f-4b6d-a2ee-dce063001766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:57:16.538721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4a532-8e8f-4b6d-a2ee-dce063001766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:57:16.539039 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4a532-8e8f-4b6d-a2ee-dce063001766 admin admin] PATH_INFO: `/v3/projects/782659ccfd384012af054e267e122dae` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:57:16.540255 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4a532-8e8f-4b6d-a2ee-dce063001766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=782659ccfd384012af054e267e122dae)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:57:16.541349 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: WARNING py.warnings [None req-cee4a532-8e8f-4b6d-a2ee-dce063001766 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 12:57:16.541349 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: warnings.warn(msg) Jul 05 12:57:16.541349 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: Jul 05 12:57:16.542564 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4a532-8e8f-4b6d-a2ee-dce063001766 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:57:16.666673 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-cee4a532-8e8f-4b6d-a2ee-dce063001766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '782659ccfd384012af054e267e122dae', 'request_id': 'req-cee4a532-8e8f-4b6d-a2ee-dce063001766'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:57:16.672760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-cee4a532-8e8f-4b6d-a2ee-dce063001766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '782659ccfd384012af054e267e122dae', 'request_id': 'req-cee4a532-8e8f-4b6d-a2ee-dce063001766'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:57:16.686458 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-cee4a532-8e8f-4b6d-a2ee-dce063001766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '782659ccfd384012af054e267e122dae', 'request_id': 'req-cee4a532-8e8f-4b6d-a2ee-dce063001766'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:57:16.776018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-cee4a532-8e8f-4b6d-a2ee-dce063001766 admin admin] The token cache is being invalidate because project 782659ccfd384012af054e267e122dae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 12:57:16.776264 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-cee4a532-8e8f-4b6d-a2ee-dce063001766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:57:16.777047 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-cee4a532-8e8f-4b6d-a2ee-dce063001766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 12:57:16.778606 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 762/1510] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 12:57:16 2022] DELETE /identity/v3/projects/782659ccfd384012af054e267e122dae => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 12:57:25.948016 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:57:26.772818 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:58:54.444704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c12587-7c4a-4719-bddf-fead0eb7faaa None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:54.445285 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c12587-7c4a-4719-bddf-fead0eb7faaa None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:54.445285 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c12587-7c4a-4719-bddf-fead0eb7faaa None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:54.446672 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:58:54.451548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ed808-b976-4504-9778-3cf34032ae04 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:54.452002 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ed808-b976-4504-9778-3cf34032ae04 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:54.452105 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ed808-b976-4504-9778-3cf34032ae04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:54.475477 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b95ed808-b976-4504-9778-3cf34032ae04 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:54.476760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b95ed808-b976-4504-9778-3cf34032ae04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:54.536203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:54.690878 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c12587-7c4a-4719-bddf-fead0eb7faaa None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:54.692578 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b4c12587-7c4a-4719-bddf-fead0eb7faaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:54.766653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c12587-7c4a-4719-bddf-fead0eb7faaa None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:54.771957 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c33ce-52a8-485a-925b-a72f91090378 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:54.772621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c33ce-52a8-485a-925b-a72f91090378 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:54.772913 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c33ce-52a8-485a-925b-a72f91090378 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:54.773193 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c33ce-52a8-485a-925b-a72f91090378 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:54.781263 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c33ce-52a8-485a-925b-a72f91090378 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:54.783642 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c33ce-52a8-485a-925b-a72f91090378 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:54.797148 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 750/1513] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:55.627774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239b94c-cdf2-4079-8047-51194077db71 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:55.628331 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239b94c-cdf2-4079-8047-51194077db71 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:55.628331 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239b94c-cdf2-4079-8047-51194077db71 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:55.629742 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:58:55.634666 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda250af-ce32-4804-b24e-3f64f6452443 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:55.635120 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda250af-ce32-4804-b24e-3f64f6452443 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:55.635229 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda250af-ce32-4804-b24e-3f64f6452443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:55.653187 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-fda250af-ce32-4804-b24e-3f64f6452443 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:55.654386 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-fda250af-ce32-4804-b24e-3f64f6452443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:55.662587 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:58:55.813080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239b94c-cdf2-4079-8047-51194077db71 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:58:55.827111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239b94c-cdf2-4079-8047-51194077db71 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:58:55.832350 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51ed7d-51b3-4850-8d9c-b6ad965607b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:58:55.833040 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51ed7d-51b3-4850-8d9c-b6ad965607b8 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:55.833324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51ed7d-51b3-4850-8d9c-b6ad965607b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:55.833599 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51ed7d-51b3-4850-8d9c-b6ad965607b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:55.841523 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51ed7d-51b3-4850-8d9c-b6ad965607b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:58:55.843175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51ed7d-51b3-4850-8d9c-b6ad965607b8 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:58:55.853969 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 765/1516] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:58:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:58:56.646204 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badce4ae-1d45-4d3c-b246-ed24544d0546 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:56.646804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badce4ae-1d45-4d3c-b246-ed24544d0546 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:56.646804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badce4ae-1d45-4d3c-b246-ed24544d0546 None None] PATH_INFO: `/v3` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:56.648056 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 752/1517] 10.222.0.16 () {54 vars in 925 bytes} [Tue Jul 5 12:58:56 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 12:58:56.669591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132203d5-25f9-4ac4-8664-720721cc74e9 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:58:56.670027 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132203d5-25f9-4ac4-8664-720721cc74e9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:58:56.670149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132203d5-25f9-4ac4-8664-720721cc74e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:58:56.687896 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-132203d5-25f9-4ac4-8664-720721cc74e9 None None] MFA Rules not processed for user `43b85b5c7b1e4d73b29fb96f4fa6db71`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:58:56.689158 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-132203d5-25f9-4ac4-8664-720721cc74e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:58:56.750126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 766/1518] 10.222.0.16 () {58 vars in 1015 bytes} [Tue Jul 5 12:58:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:00.840728 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34108a2d-f484-4817-9cc6-157e849c2f2d None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:00.841305 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34108a2d-f484-4817-9cc6-157e849c2f2d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:00.841305 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34108a2d-f484-4817-9cc6-157e849c2f2d None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:00.842662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 753/1519] 10.222.0.36 () {54 vars in 960 bytes} [Tue Jul 5 12:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:59:00.847526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692436d-4522-40a9-b24b-e127b6c08999 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:00.847948 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692436d-4522-40a9-b24b-e127b6c08999 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:00.848102 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692436d-4522-40a9-b24b-e127b6c08999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:00.866323 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a692436d-4522-40a9-b24b-e127b6c08999 None None] MFA Rules not processed for user `43b85b5c7b1e4d73b29fb96f4fa6db71`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:00.867518 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a692436d-4522-40a9-b24b-e127b6c08999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:00.876547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 767/1520] 10.222.0.36 () {58 vars in 1057 bytes} [Tue Jul 5 12:59:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:00.883838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34108a2d-f484-4817-9cc6-157e849c2f2d None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:00.897982 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34108a2d-f484-4817-9cc6-157e849c2f2d None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:00.902835 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924d512-12c7-4dd1-8539-4a258632baf8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43b85b5c7b1e4d73b29fb96f4fa6db71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:00.903465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924d512-12c7-4dd1-8539-4a258632baf8 service placement] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:00.903748 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924d512-12c7-4dd1-8539-4a258632baf8 service placement] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:00.904026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924d512-12c7-4dd1-8539-4a258632baf8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:00.912254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924d512-12c7-4dd1-8539-4a258632baf8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:00.913854 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924d512-12c7-4dd1-8539-4a258632baf8 service placement] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:00.924279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 754/1521] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:07.081392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61830e00-840c-4e1c-8073-b68128a21194 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:07.081913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61830e00-840c-4e1c-8073-b68128a21194 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:07.082030 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61830e00-840c-4e1c-8073-b68128a21194 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:07.083392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:59:07.088754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33018d-af9f-4ae5-9f0e-1afc7c7bbe35 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:07.091723 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33018d-af9f-4ae5-9f0e-1afc7c7bbe35 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:07.091723 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33018d-af9f-4ae5-9f0e-1afc7c7bbe35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:07.108288 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2d33018d-af9f-4ae5-9f0e-1afc7c7bbe35 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:07.109542 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2d33018d-af9f-4ae5-9f0e-1afc7c7bbe35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:07.117553 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:07.289050 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61830e00-840c-4e1c-8073-b68128a21194 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:07.303665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61830e00-840c-4e1c-8073-b68128a21194 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:07.309113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047023cd-7edf-4d6f-b0b1-9bee37524f2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:07.309749 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047023cd-7edf-4d6f-b0b1-9bee37524f2a service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:07.310030 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047023cd-7edf-4d6f-b0b1-9bee37524f2a service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:07.310304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047023cd-7edf-4d6f-b0b1-9bee37524f2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:07.318842 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047023cd-7edf-4d6f-b0b1-9bee37524f2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:07.320446 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047023cd-7edf-4d6f-b0b1-9bee37524f2a service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:07.330333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 769/1524] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:08.153360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43556f-3229-43a4-ac82-ef7944d7afb0 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:08.154188 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43556f-3229-43a4-ac82-ef7944d7afb0 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:08.154369 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43556f-3229-43a4-ac82-ef7944d7afb0 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:08.156427 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 12:59:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:59:08.161356 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f118139-d9e2-41fd-8322-5dc6b8704536 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:08.161793 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f118139-d9e2-41fd-8322-5dc6b8704536 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:08.161898 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f118139-d9e2-41fd-8322-5dc6b8704536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:08.179745 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-7f118139-d9e2-41fd-8322-5dc6b8704536 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:08.181014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7f118139-d9e2-41fd-8322-5dc6b8704536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:08.189322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 12:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:08.340743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43556f-3229-43a4-ac82-ef7944d7afb0 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:08.358072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43556f-3229-43a4-ac82-ef7944d7afb0 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:08.366032 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71658df7-174e-425b-bf56-2eec6ee459bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:08.366949 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71658df7-174e-425b-bf56-2eec6ee459bb service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:08.367238 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71658df7-174e-425b-bf56-2eec6ee459bb service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:08.367674 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71658df7-174e-425b-bf56-2eec6ee459bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:08.376715 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71658df7-174e-425b-bf56-2eec6ee459bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:08.378809 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71658df7-174e-425b-bf56-2eec6ee459bb service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:08.389845 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 757/1527] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:12.189703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd964d1e-9255-4811-b236-68b7d1581704 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:12.190584 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd964d1e-9255-4811-b236-68b7d1581704 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:12.190584 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd964d1e-9255-4811-b236-68b7d1581704 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:12.192600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 12:59:12.197844 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122f37d-9d90-4f3e-9952-46650c565612 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:12.198277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122f37d-9d90-4f3e-9952-46650c565612 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:12.198387 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122f37d-9d90-4f3e-9952-46650c565612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:12.216498 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-5122f37d-9d90-4f3e-9952-46650c565612 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:12.218312 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5122f37d-9d90-4f3e-9952-46650c565612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:12.226128 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:12.299035 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd964d1e-9255-4811-b236-68b7d1581704 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:12.300884 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-bd964d1e-9255-4811-b236-68b7d1581704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:12.361074 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd964d1e-9255-4811-b236-68b7d1581704 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:12.364579 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4f0d3-aac8-4e1e-80c9-095455fb5597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:12.365244 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4f0d3-aac8-4e1e-80c9-095455fb5597 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:12.365525 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4f0d3-aac8-4e1e-80c9-095455fb5597 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:12.365800 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4f0d3-aac8-4e1e-80c9-095455fb5597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:12.375708 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4f0d3-aac8-4e1e-80c9-095455fb5597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:12.377308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4f0d3-aac8-4e1e-80c9-095455fb5597 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:12.382236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:12.387374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 772/1530] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:14.437624 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a051bb4-03db-4715-8b1a-3398eae3f48f None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:14.438162 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a051bb4-03db-4715-8b1a-3398eae3f48f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:14.438283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a051bb4-03db-4715-8b1a-3398eae3f48f None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:14.439716 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:59:14.445249 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e186ba-ba38-48a2-bfb7-1924e0def80c None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:14.445686 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e186ba-ba38-48a2-bfb7-1924e0def80c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:14.445797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e186ba-ba38-48a2-bfb7-1924e0def80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:14.585349 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-58e186ba-ba38-48a2-bfb7-1924e0def80c None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:14.586772 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-58e186ba-ba38-48a2-bfb7-1924e0def80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:14.598418 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:14.631937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a051bb4-03db-4715-8b1a-3398eae3f48f None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:14.643727 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a051bb4-03db-4715-8b1a-3398eae3f48f None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:14.647487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f30d8e-b58f-4c43-a822-b87e06fdb31b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:14.648211 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f30d8e-b58f-4c43-a822-b87e06fdb31b service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:14.648487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f30d8e-b58f-4c43-a822-b87e06fdb31b service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:14.648858 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f30d8e-b58f-4c43-a822-b87e06fdb31b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:14.658882 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f30d8e-b58f-4c43-a822-b87e06fdb31b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:14.661637 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f30d8e-b58f-4c43-a822-b87e06fdb31b service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:14.670537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 760/1533] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:18.317936 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd9334-6d29-4d87-8318-3df2e42036e6 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:18.318482 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd9334-6d29-4d87-8318-3df2e42036e6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:18.318482 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd9334-6d29-4d87-8318-3df2e42036e6 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:18.319778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:59:18.325063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36b27d-0970-4a81-8ce8-eb47f6bbd2d0 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:18.325491 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36b27d-0970-4a81-8ce8-eb47f6bbd2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:18.325635 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36b27d-0970-4a81-8ce8-eb47f6bbd2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:18.332774 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=62 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:18.350364 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-0c36b27d-0970-4a81-8ce8-eb47f6bbd2d0 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:18.351585 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0c36b27d-0970-4a81-8ce8-eb47f6bbd2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:18.362093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:18.671679 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd9334-6d29-4d87-8318-3df2e42036e6 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:18.673393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7ecd9334-6d29-4d87-8318-3df2e42036e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:18.731346 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd9334-6d29-4d87-8318-3df2e42036e6 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:18.735241 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f06ad-f535-4449-b2d4-627bf7a9bb47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:18.735890 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f06ad-f535-4449-b2d4-627bf7a9bb47 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:18.736172 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f06ad-f535-4449-b2d4-627bf7a9bb47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:18.736446 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f06ad-f535-4449-b2d4-627bf7a9bb47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:18.745588 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f06ad-f535-4449-b2d4-627bf7a9bb47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:18.747018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f06ad-f535-4449-b2d4-627bf7a9bb47 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:18.756841 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 775/1536] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:20.823647 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c554d0d-f026-445f-bcaa-670f9d342f63 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:20.824197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c554d0d-f026-445f-bcaa-670f9d342f63 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:20.824197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c554d0d-f026-445f-bcaa-670f9d342f63 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:20.825714 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 12:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 12:59:20.831522 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d3ede-57fb-4b3e-bd2c-25ef9b6c0c3d None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:20.831957 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d3ede-57fb-4b3e-bd2c-25ef9b6c0c3d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:20.832084 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d3ede-57fb-4b3e-bd2c-25ef9b6c0c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:20.849620 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-ed3d3ede-57fb-4b3e-bd2c-25ef9b6c0c3d None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 12:59:20.850837 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ed3d3ede-57fb-4b3e-bd2c-25ef9b6c0c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:20.858958 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 12:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 12:59:21.166091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c554d0d-f026-445f-bcaa-670f9d342f63 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 12:59:21.167874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7c554d0d-f026-445f-bcaa-670f9d342f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 12:59:21.181140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c554d0d-f026-445f-bcaa-670f9d342f63 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 12:59:21.184563 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c476a-5ea5-45aa-acca-39130985872e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 12:59:21.185863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c476a-5ea5-45aa-acca-39130985872e service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 12:59:21.186144 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c476a-5ea5-45aa-acca-39130985872e service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 12:59:21.186420 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c476a-5ea5-45aa-acca-39130985872e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 12:59:21.195406 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c476a-5ea5-45aa-acca-39130985872e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 12:59:21.196861 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c476a-5ea5-45aa-acca-39130985872e service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 12:59:21.206050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 763/1539] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 12:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 12:59:30.844703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=32 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 12:59:31.202062 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=8 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:51.913924 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bedec-d35c-469c-824d-28358af2cf75 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:51.915253 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bedec-d35c-469c-824d-28358af2cf75 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:51.915908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bedec-d35c-469c-824d-28358af2cf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:51.945713 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-fd1bedec-d35c-469c-824d-28358af2cf75 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:51.951352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-fd1bedec-d35c-469c-824d-28358af2cf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:51.961250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 777/1540] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:00:51.971444 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c80beb-7146-4d7e-a32f-1794eae933da None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:51.972699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c80beb-7146-4d7e-a32f-1794eae933da None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:51.973200 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c80beb-7146-4d7e-a32f-1794eae933da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.001063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c9c80beb-7146-4d7e-a32f-1794eae933da None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:52.002739 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c9c80beb-7146-4d7e-a32f-1794eae933da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:52.016427 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 764/1541] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:52.022078 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bedec-d35c-469c-824d-28358af2cf75 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:52.033155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bedec-d35c-469c-824d-28358af2cf75 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:52.040891 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f7c29-89f0-4117-9f6d-9e37b90d9a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:52.041649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f7c29-89f0-4117-9f6d-9e37b90d9a50 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.041937 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f7c29-89f0-4117-9f6d-9e37b90d9a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.042217 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f7c29-89f0-4117-9f6d-9e37b90d9a50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.042960 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f7c29-89f0-4117-9f6d-9e37b90d9a50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:00:52.043269 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f7c29-89f0-4117-9f6d-9e37b90d9a50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:52.045197 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f7c29-89f0-4117-9f6d-9e37b90d9a50 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:52.062028 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445210c-b828-4217-a4b3-280b3cfe8653 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.062708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445210c-b828-4217-a4b3-280b3cfe8653 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.063222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445210c-b828-4217-a4b3-280b3cfe8653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.079269 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 778/1542] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:00:52.090232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f7c29-89f0-4117-9f6d-9e37b90d9a50 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:52.095044 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c445210c-b828-4217-a4b3-280b3cfe8653 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:52.096904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c445210c-b828-4217-a4b3-280b3cfe8653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:52.102396 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f7c29-89f0-4117-9f6d-9e37b90d9a50 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:52.117988 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 765/1543] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:00:52.118408 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906b39b-2506-40d2-876b-309aa8526179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:52.119101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906b39b-2506-40d2-876b-309aa8526179 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.119913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906b39b-2506-40d2-876b-309aa8526179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.120039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbb968-dc5d-4fd0-9d1b-75aa8d5a8599 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.120213 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906b39b-2506-40d2-876b-309aa8526179 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.120315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbb968-dc5d-4fd0-9d1b-75aa8d5a8599 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.120564 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbb968-dc5d-4fd0-9d1b-75aa8d5a8599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.120991 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906b39b-2506-40d2-876b-309aa8526179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:52.122169 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: WARNING py.warnings [None req-d906b39b-2506-40d2-876b-309aa8526179 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 13:00:52.122169 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: warnings.warn(msg) Jul 05 13:00:52.122169 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: Jul 05 13:00:52.123375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906b39b-2506-40d2-876b-309aa8526179 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:52.153641 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-8dbbb968-dc5d-4fd0-9d1b-75aa8d5a8599 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:52.154877 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8dbbb968-dc5d-4fd0-9d1b-75aa8d5a8599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:52.175877 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 766/1544] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:52.183008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b583c1a-f1ef-4658-92f6-107370ab0a69 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.183310 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b583c1a-f1ef-4658-92f6-107370ab0a69 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.183609 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b583c1a-f1ef-4658-92f6-107370ab0a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.209626 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-7b583c1a-f1ef-4658-92f6-107370ab0a69 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:52.210881 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7b583c1a-f1ef-4658-92f6-107370ab0a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:52.227471 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 767/1545] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:52.229630 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae81281-f3c9-4fa6-9212-958b61193a5c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.229918 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae81281-f3c9-4fa6-9212-958b61193a5c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.230196 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae81281-f3c9-4fa6-9212-958b61193a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.230374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 779/1546] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:00:52 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:52.234590 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906b39b-2506-40d2-876b-309aa8526179 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:52.253509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-4ae81281-f3c9-4fa6-9212-958b61193a5c None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:52.254794 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4ae81281-f3c9-4fa6-9212-958b61193a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:52.324123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906b39b-2506-40d2-876b-309aa8526179 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:52.335382 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5f203-1ea0-4681-9e84-20942525a6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:52.336300 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5f203-1ea0-4681-9e84-20942525a6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.336609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5f203-1ea0-4681-9e84-20942525a6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.336891 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5f203-1ea0-4681-9e84-20942525a6f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.337795 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5f203-1ea0-4681-9e84-20942525a6f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:52.340304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5f203-1ea0-4681-9e84-20942525a6f0 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:52.340883 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 768/1547] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:52.341747 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae81281-f3c9-4fa6-9212-958b61193a5c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:52.352637 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae81281-f3c9-4fa6-9212-958b61193a5c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:52.359389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569d48a-7d5c-4860-a27d-6d5120e6f0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:52.360047 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569d48a-7d5c-4860-a27d-6d5120e6f0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.360337 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569d48a-7d5c-4860-a27d-6d5120e6f0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.360643 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569d48a-7d5c-4860-a27d-6d5120e6f0f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.361376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569d48a-7d5c-4860-a27d-6d5120e6f0f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:00:52.361688 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569d48a-7d5c-4860-a27d-6d5120e6f0f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:52.362839 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: WARNING py.warnings [None req-4569d48a-7d5c-4860-a27d-6d5120e6f0f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 13:00:52.362839 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: warnings.warn(msg) Jul 05 13:00:52.362839 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: Jul 05 13:00:52.363864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569d48a-7d5c-4860-a27d-6d5120e6f0f2 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:52.376735 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 769/1548] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:00:52.378212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b6aab-4c6a-46ba-8828-867c1f5b459a None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.378515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b6aab-4c6a-46ba-8828-867c1f5b459a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.378788 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b6aab-4c6a-46ba-8828-867c1f5b459a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.397823 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ab8b6aab-4c6a-46ba-8828-867c1f5b459a None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:52.399097 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ab8b6aab-4c6a-46ba-8828-867c1f5b459a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:52.407218 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 770/1549] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:52.420606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2c3de-cf16-403b-ab86-09bd44510255 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.420606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2c3de-cf16-403b-ab86-09bd44510255 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.420606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2c3de-cf16-403b-ab86-09bd44510255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.427004 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-0ba2c3de-cf16-403b-ab86-09bd44510255 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:52.428154 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0ba2c3de-cf16-403b-ab86-09bd44510255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:52.437029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 771/1550] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:52.438276 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c757d5-f550-4c35-86be-f602595fe029 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.438569 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c757d5-f550-4c35-86be-f602595fe029 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.438895 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c757d5-f550-4c35-86be-f602595fe029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.456912 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c3c757d5-f550-4c35-86be-f602595fe029 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:52.458091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c3c757d5-f550-4c35-86be-f602595fe029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:52.466691 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 772/1551] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:52.467978 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a04480-5a4b-47f8-a34a-19e832a99867 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.468196 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a04480-5a4b-47f8-a34a-19e832a99867 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.468474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a04480-5a4b-47f8-a34a-19e832a99867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.473065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 780/1552] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:00:52 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:00:52.474167 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5f203-1ea0-4681-9e84-20942525a6f0 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:52.486290 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5f203-1ea0-4681-9e84-20942525a6f0 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:52.490882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de9423-b6a0-4796-8aee-25b558f831c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:52.491544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de9423-b6a0-4796-8aee-25b558f831c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.491831 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de9423-b6a0-4796-8aee-25b558f831c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.492290 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de9423-b6a0-4796-8aee-25b558f831c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.492967 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de9423-b6a0-4796-8aee-25b558f831c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:00:52.493282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de9423-b6a0-4796-8aee-25b558f831c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:52.495553 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-15a04480-5a4b-47f8-a34a-19e832a99867 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:52.495553 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-15a04480-5a4b-47f8-a34a-19e832a99867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:52.495793 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de9423-b6a0-4796-8aee-25b558f831c1 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:52.503901 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 773/1553] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:52.504695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a04480-5a4b-47f8-a34a-19e832a99867 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:52.507922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 781/1554] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:00:52.509407 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87841752-0dac-454f-8d4c-b0214e6eaeee None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.509926 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87841752-0dac-454f-8d4c-b0214e6eaeee None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.510383 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87841752-0dac-454f-8d4c-b0214e6eaeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.520299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a04480-5a4b-47f8-a34a-19e832a99867 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:52.525003 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0555751-68dd-41bb-aea4-6918f369abe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:52.525748 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0555751-68dd-41bb-aea4-6918f369abe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.526088 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0555751-68dd-41bb-aea4-6918f369abe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.526370 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0555751-68dd-41bb-aea4-6918f369abe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.527067 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0555751-68dd-41bb-aea4-6918f369abe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:52.529042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0555751-68dd-41bb-aea4-6918f369abe6 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:52.529533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-87841752-0dac-454f-8d4c-b0214e6eaeee None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:52.531296 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-87841752-0dac-454f-8d4c-b0214e6eaeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:52.539526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 782/1555] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:52.546833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce341e4-6119-4226-ac75-ff576db70f51 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.546833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce341e4-6119-4226-ac75-ff576db70f51 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.546833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce341e4-6119-4226-ac75-ff576db70f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.561478 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-7ce341e4-6119-4226-ac75-ff576db70f51 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:52.562678 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7ce341e4-6119-4226-ac75-ff576db70f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:52.570422 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 783/1556] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:52.571747 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec89e1b-ee3d-493a-8254-d350e8bc9725 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.572036 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec89e1b-ee3d-493a-8254-d350e8bc9725 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.572503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec89e1b-ee3d-493a-8254-d350e8bc9725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.589206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-dec89e1b-ee3d-493a-8254-d350e8bc9725 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:52.590357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-dec89e1b-ee3d-493a-8254-d350e8bc9725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:52.598203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 784/1557] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:52.599084 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec89e1b-ee3d-493a-8254-d350e8bc9725 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:52.609045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec89e1b-ee3d-493a-8254-d350e8bc9725 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:52.613616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11c241-6efd-4fe0-bac0-61561307d107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:52.614254 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11c241-6efd-4fe0-bac0-61561307d107 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.614545 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11c241-6efd-4fe0-bac0-61561307d107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.614828 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11c241-6efd-4fe0-bac0-61561307d107 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.615603 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11c241-6efd-4fe0-bac0-61561307d107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:52.617332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11c241-6efd-4fe0-bac0-61561307d107 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:52.627721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 785/1558] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:52.628987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3f574-3002-4af3-9a08-8714f4266e76 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.629281 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3f574-3002-4af3-9a08-8714f4266e76 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.629561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3f574-3002-4af3-9a08-8714f4266e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.646005 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-2fd3f574-3002-4af3-9a08-8714f4266e76 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:52.647219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2fd3f574-3002-4af3-9a08-8714f4266e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:52.655844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 786/1559] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:52.673908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf12b2-be08-48e6-9b5f-2d4f4cab22eb None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.673908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf12b2-be08-48e6-9b5f-2d4f4cab22eb None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.673908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf12b2-be08-48e6-9b5f-2d4f4cab22eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.675401 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-fabf12b2-be08-48e6-9b5f-2d4f4cab22eb None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:52.676600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-fabf12b2-be08-48e6-9b5f-2d4f4cab22eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:52.684564 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 787/1560] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:52.685350 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf12b2-be08-48e6-9b5f-2d4f4cab22eb None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:52.694833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf12b2-be08-48e6-9b5f-2d4f4cab22eb None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:52.699360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b44be-7344-47ee-9f00-a97333435526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:52.699972 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b44be-7344-47ee-9f00-a97333435526 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.700254 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b44be-7344-47ee-9f00-a97333435526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.700531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b44be-7344-47ee-9f00-a97333435526 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.701245 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b44be-7344-47ee-9f00-a97333435526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:52.703128 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b44be-7344-47ee-9f00-a97333435526 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:52.870498 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 774/1561] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:00:52 2022] POST /identity/v3/projects => generated 385 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:52.870498 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f870f0a-a877-48d6-a254-f70135a5ebfa None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.870498 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f870f0a-a877-48d6-a254-f70135a5ebfa None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.870498 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f870f0a-a877-48d6-a254-f70135a5ebfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.887001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-3f870f0a-a877-48d6-a254-f70135a5ebfa None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:52.888212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3f870f0a-a877-48d6-a254-f70135a5ebfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:52.924657 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 788/1562] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:00:52 2022] POST /identity/v3/projects => generated 385 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:52.925661 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b44be-7344-47ee-9f00-a97333435526 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:52.948999 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 775/1563] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:52.949775 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f870f0a-a877-48d6-a254-f70135a5ebfa None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:52.958745 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f870f0a-a877-48d6-a254-f70135a5ebfa None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:52.958921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:52.967976 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:52.991618 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b44be-7344-47ee-9f00-a97333435526 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:52.996175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c1a2f-d1ec-438d-8849-6042a3a10b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:52.996897 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c1a2f-d1ec-438d-8849-6042a3a10b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:52.997180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c1a2f-d1ec-438d-8849-6042a3a10b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:52.997455 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c1a2f-d1ec-438d-8849-6042a3a10b32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:52.998183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c1a2f-d1ec-438d-8849-6042a3a10b32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:00:52.998489 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c1a2f-d1ec-438d-8849-6042a3a10b32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:53.000099 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c1a2f-d1ec-438d-8849-6042a3a10b32 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:53.014675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 789/1564] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:00:53.014675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c1a2f-d1ec-438d-8849-6042a3a10b32 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:53.018396 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369a8c9-bbcf-4272-8154-a5224a6c2eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:53.019078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369a8c9-bbcf-4272-8154-a5224a6c2eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:53.019451 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369a8c9-bbcf-4272-8154-a5224a6c2eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:53.019734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369a8c9-bbcf-4272-8154-a5224a6c2eaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:53.020497 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369a8c9-bbcf-4272-8154-a5224a6c2eaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:00:53.020838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369a8c9-bbcf-4272-8154-a5224a6c2eaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:53.022449 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369a8c9-bbcf-4272-8154-a5224a6c2eaa admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:53.024252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c1a2f-d1ec-438d-8849-6042a3a10b32 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:53.029573 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bd511-db5b-4659-a0fa-6ac22b6c0f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:53.030223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bd511-db5b-4659-a0fa-6ac22b6c0f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:53.030508 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bd511-db5b-4659-a0fa-6ac22b6c0f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:53.030785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bd511-db5b-4659-a0fa-6ac22b6c0f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:53.031503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bd511-db5b-4659-a0fa-6ac22b6c0f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:53.033116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bd511-db5b-4659-a0fa-6ac22b6c0f42 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:53.035202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 776/1565] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:00:53.035880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369a8c9-bbcf-4272-8154-a5224a6c2eaa admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:53.046872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369a8c9-bbcf-4272-8154-a5224a6c2eaa admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:53.047216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 790/1566] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:53.048347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bd511-db5b-4659-a0fa-6ac22b6c0f42 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:53.055961 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6420403-ed0a-4990-9e4d-b123707b5e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:53.056710 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6420403-ed0a-4990-9e4d-b123707b5e4a admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:53.062541 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6420403-ed0a-4990-9e4d-b123707b5e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:53.062541 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6420403-ed0a-4990-9e4d-b123707b5e4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:53.062541 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6420403-ed0a-4990-9e4d-b123707b5e4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:00:53.062541 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6420403-ed0a-4990-9e4d-b123707b5e4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:53.062541 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6420403-ed0a-4990-9e4d-b123707b5e4a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:53.063026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bd511-db5b-4659-a0fa-6ac22b6c0f42 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:53.067982 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fe239-7d9f-4ad9-bca9-e007c13555de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:53.068733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fe239-7d9f-4ad9-bca9-e007c13555de admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:53.069031 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fe239-7d9f-4ad9-bca9-e007c13555de admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:53.069313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fe239-7d9f-4ad9-bca9-e007c13555de admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:53.070049 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fe239-7d9f-4ad9-bca9-e007c13555de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:00:53.070391 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fe239-7d9f-4ad9-bca9-e007c13555de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:53.072023 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fe239-7d9f-4ad9-bca9-e007c13555de admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:53.074037 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 777/1567] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:00:53.077529 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6420403-ed0a-4990-9e4d-b123707b5e4a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:53.093619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 791/1568] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:00:53.093619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fe239-7d9f-4ad9-bca9-e007c13555de admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:53.097001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6420403-ed0a-4990-9e4d-b123707b5e4a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:53.097001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45308104-3579-4bfe-b975-aef92f6d9717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:53.097001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45308104-3579-4bfe-b975-aef92f6d9717 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:53.097001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45308104-3579-4bfe-b975-aef92f6d9717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:53.097423 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45308104-3579-4bfe-b975-aef92f6d9717 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:53.097423 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45308104-3579-4bfe-b975-aef92f6d9717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:53.097423 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: WARNING py.warnings [None req-45308104-3579-4bfe-b975-aef92f6d9717 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 13:00:53.097423 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: warnings.warn(msg) Jul 05 13:00:53.097423 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: Jul 05 13:00:53.097765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fe239-7d9f-4ad9-bca9-e007c13555de admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:53.097842 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45308104-3579-4bfe-b975-aef92f6d9717 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:53.101824 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad2c03-643d-4261-88a3-b989dae40e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:53.102504 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad2c03-643d-4261-88a3-b989dae40e54 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:53.102788 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad2c03-643d-4261-88a3-b989dae40e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:53.103377 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad2c03-643d-4261-88a3-b989dae40e54 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:53.104114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad2c03-643d-4261-88a3-b989dae40e54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:53.106046 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad2c03-643d-4261-88a3-b989dae40e54 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:53.243813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 778/1569] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:00:53 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:53.243813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45308104-3579-4bfe-b975-aef92f6d9717 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:53.253193 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45308104-3579-4bfe-b975-aef92f6d9717 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:53.258124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b34f2-33df-4d65-96b2-c556c82594c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:53.259065 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b34f2-33df-4d65-96b2-c556c82594c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:53.259407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b34f2-33df-4d65-96b2-c556c82594c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:53.260433 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b34f2-33df-4d65-96b2-c556c82594c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:53.261243 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b34f2-33df-4d65-96b2-c556c82594c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:00:53.261552 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b34f2-33df-4d65-96b2-c556c82594c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:53.263146 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b34f2-33df-4d65-96b2-c556c82594c0 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:53.274853 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 779/1570] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:00:53.276180 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b34f2-33df-4d65-96b2-c556c82594c0 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:53.286154 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b34f2-33df-4d65-96b2-c556c82594c0 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:53.290910 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f088ed-3a24-4030-8b1a-f4b7223a6c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:53.291519 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f088ed-3a24-4030-8b1a-f4b7223a6c0d admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:53.291953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f088ed-3a24-4030-8b1a-f4b7223a6c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:53.292431 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f088ed-3a24-4030-8b1a-f4b7223a6c0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:53.293429 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f088ed-3a24-4030-8b1a-f4b7223a6c0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:53.296740 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f088ed-3a24-4030-8b1a-f4b7223a6c0d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:53.303226 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 792/1571] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:00:53 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:53.303226 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad2c03-643d-4261-88a3-b989dae40e54 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:53.311064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad2c03-643d-4261-88a3-b989dae40e54 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:53.315843 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09404b3f-adf9-4f28-a46a-f2d7a95684e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:53.316484 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09404b3f-adf9-4f28-a46a-f2d7a95684e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:53.316885 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09404b3f-adf9-4f28-a46a-f2d7a95684e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:53.317165 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09404b3f-adf9-4f28-a46a-f2d7a95684e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:53.317845 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09404b3f-adf9-4f28-a46a-f2d7a95684e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:53.319736 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09404b3f-adf9-4f28-a46a-f2d7a95684e6 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:53.449495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 780/1572] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:00:53 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:53.449495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f088ed-3a24-4030-8b1a-f4b7223a6c0d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:53.449820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 793/1573] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:00:53 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:53.449940 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09404b3f-adf9-4f28-a46a-f2d7a95684e6 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:53.514513 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09404b3f-adf9-4f28-a46a-f2d7a95684e6 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:53.515539 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f088ed-3a24-4030-8b1a-f4b7223a6c0d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:53.519225 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c281ba0-c9fa-4f62-84bd-0de88b93978b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:53.520418 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c281ba0-c9fa-4f62-84bd-0de88b93978b admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:53.520418 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c281ba0-c9fa-4f62-84bd-0de88b93978b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:53.520694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a1c3f-0190-4399-ac6c-0782550d68d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:53.520821 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c281ba0-c9fa-4f62-84bd-0de88b93978b admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:53.521211 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c281ba0-c9fa-4f62-84bd-0de88b93978b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:53.521320 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a1c3f-0190-4399-ac6c-0782550d68d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:53.521579 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a1c3f-0190-4399-ac6c-0782550d68d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:53.521857 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a1c3f-0190-4399-ac6c-0782550d68d9 admin admin] PATH_INFO: `/v3/projects/cb21718b212946f4ae9d68290e43b46e/users/1f36ee437cac4538b20aa06cabaacc59/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:53.523137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c281ba0-c9fa-4f62-84bd-0de88b93978b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:53.536377 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a1c3f-0190-4399-ac6c-0782550d68d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb21718b212946f4ae9d68290e43b46e, user_id=1f36ee437cac4538b20aa06cabaacc59, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:53.539094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a1c3f-0190-4399-ac6c-0782550d68d9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:53.601398 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 781/1574] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:00:53 2022] PUT /identity/v3/projects/cb21718b212946f4ae9d68290e43b46e/users/1f36ee437cac4538b20aa06cabaacc59/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:53.602200 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a1c3f-0190-4399-ac6c-0782550d68d9 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:53.626576 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 794/1575] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:00:53 2022] POST /identity/v3/projects => generated 393 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:53.627574 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c281ba0-c9fa-4f62-84bd-0de88b93978b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:53.631417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:53.675284 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:53.678750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a1c3f-0190-4399-ac6c-0782550d68d9 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:53.691326 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c281ba0-c9fa-4f62-84bd-0de88b93978b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:53.695912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e27f16-89c1-4baf-a60b-7d68f9e072d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:53.696609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e27f16-89c1-4baf-a60b-7d68f9e072d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:53.696898 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e27f16-89c1-4baf-a60b-7d68f9e072d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:53.697174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e27f16-89c1-4baf-a60b-7d68f9e072d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:53.698501 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e27f16-89c1-4baf-a60b-7d68f9e072d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:53.700241 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e27f16-89c1-4baf-a60b-7d68f9e072d8 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:53.713306 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 795/1576] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:53.713647 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e27f16-89c1-4baf-a60b-7d68f9e072d8 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:53.723849 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e27f16-89c1-4baf-a60b-7d68f9e072d8 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:53.728658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c001a-ee1f-4212-8e03-be29d8660581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:53.729300 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c001a-ee1f-4212-8e03-be29d8660581 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:53.729583 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c001a-ee1f-4212-8e03-be29d8660581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:53.729859 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c001a-ee1f-4212-8e03-be29d8660581 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:53.730536 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c001a-ee1f-4212-8e03-be29d8660581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:53.732426 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c001a-ee1f-4212-8e03-be29d8660581 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:53.737661 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94443d1e-a81e-476f-b5c9-448bb1be262e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:53.738320 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94443d1e-a81e-476f-b5c9-448bb1be262e admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:53.738631 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94443d1e-a81e-476f-b5c9-448bb1be262e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:53.738905 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94443d1e-a81e-476f-b5c9-448bb1be262e admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:53.739596 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94443d1e-a81e-476f-b5c9-448bb1be262e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:53.741606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94443d1e-a81e-476f-b5c9-448bb1be262e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:53.825866 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 796/1577] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:00:53 2022] POST /identity/v3/projects => generated 405 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:53.826735 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c001a-ee1f-4212-8e03-be29d8660581 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:53.848871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 782/1578] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:00:53 2022] POST /identity/v3/projects => generated 373 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:53.858229 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94443d1e-a81e-476f-b5c9-448bb1be262e admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:53.890293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c001a-ee1f-4212-8e03-be29d8660581 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:53.913105 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94443d1e-a81e-476f-b5c9-448bb1be262e admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:53.918219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e8b0a-cdb3-4212-a62d-71bb558af4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:53.918891 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e8b0a-cdb3-4212-a62d-71bb558af4a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:53.919178 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e8b0a-cdb3-4212-a62d-71bb558af4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:53.919457 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e8b0a-cdb3-4212-a62d-71bb558af4a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:53.920160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e8b0a-cdb3-4212-a62d-71bb558af4a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:53.922113 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e8b0a-cdb3-4212-a62d-71bb558af4a4 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:53.946545 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca4b9c-875d-4ba6-b4f3-b78f339fb6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:53.947215 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca4b9c-875d-4ba6-b4f3-b78f339fb6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:53.947527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca4b9c-875d-4ba6-b4f3-b78f339fb6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:53.947808 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca4b9c-875d-4ba6-b4f3-b78f339fb6c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:53.948534 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca4b9c-875d-4ba6-b4f3-b78f339fb6c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:53.950164 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca4b9c-875d-4ba6-b4f3-b78f339fb6c0 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:53.959826 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 797/1579] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:53.960615 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca4b9c-875d-4ba6-b4f3-b78f339fb6c0 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:53.970081 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca4b9c-875d-4ba6-b4f3-b78f339fb6c0 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:53.975572 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f28b44-27fe-4357-adb9-7f4da40ed5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:53.976200 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f28b44-27fe-4357-adb9-7f4da40ed5e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:53.976544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f28b44-27fe-4357-adb9-7f4da40ed5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:53.976884 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f28b44-27fe-4357-adb9-7f4da40ed5e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:53.982680 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f28b44-27fe-4357-adb9-7f4da40ed5e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:53.982680 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f28b44-27fe-4357-adb9-7f4da40ed5e7 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:54.042495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 783/1580] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:00:53 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:54.043822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee96ba-99ed-4a99-a69d-30f7f7f858d8 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.044108 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee96ba-99ed-4a99-a69d-30f7f7f858d8 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.044383 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee96ba-99ed-4a99-a69d-30f7f7f858d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.071052 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-4cee96ba-99ed-4a99-a69d-30f7f7f858d8 None None] MFA Rules not processed for user `1f36ee437cac4538b20aa06cabaacc59`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:54.072454 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4cee96ba-99ed-4a99-a69d-30f7f7f858d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:54.075924 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 798/1581] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:00:53 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:54.076709 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f28b44-27fe-4357-adb9-7f4da40ed5e7 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:54.086436 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f28b44-27fe-4357-adb9-7f4da40ed5e7 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:54.090937 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5d470-710a-4541-995a-db86a6aa1ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:54.091584 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5d470-710a-4541-995a-db86a6aa1ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.096541 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5d470-710a-4541-995a-db86a6aa1ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.096541 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5d470-710a-4541-995a-db86a6aa1ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.096541 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5d470-710a-4541-995a-db86a6aa1ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:54.096541 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5d470-710a-4541-995a-db86a6aa1ac4 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:54.109279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:54.139414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 784/1582] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:54.140240 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee96ba-99ed-4a99-a69d-30f7f7f858d8 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:54.150114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee96ba-99ed-4a99-a69d-30f7f7f858d8 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:54.155745 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad989d4-624d-44d5-88a9-86ab873e1326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:54.156410 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad989d4-624d-44d5-88a9-86ab873e1326 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.156740 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad989d4-624d-44d5-88a9-86ab873e1326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.157027 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad989d4-624d-44d5-88a9-86ab873e1326 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.157762 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad989d4-624d-44d5-88a9-86ab873e1326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:54.159439 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad989d4-624d-44d5-88a9-86ab873e1326 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:54.173203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 785/1583] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:54.173203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad989d4-624d-44d5-88a9-86ab873e1326 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:54.182329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad989d4-624d-44d5-88a9-86ab873e1326 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:54.188882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 799/1584] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:00:54 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:54.188882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5d470-710a-4541-995a-db86a6aa1ac4 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:54.194084 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb71424-63fc-484b-8cb5-fac67495fe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:54.194084 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71424-63fc-484b-8cb5-fac67495fe2a admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.194084 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71424-63fc-484b-8cb5-fac67495fe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.194084 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71424-63fc-484b-8cb5-fac67495fe2a admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.194485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb71424-63fc-484b-8cb5-fac67495fe2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:54.194586 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb71424-63fc-484b-8cb5-fac67495fe2a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:54.196950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5d470-710a-4541-995a-db86a6aa1ac4 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:54.202171 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6f558-4c98-4661-bf8a-dc74781418ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:54.202834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6f558-4c98-4661-bf8a-dc74781418ac admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.203123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6f558-4c98-4661-bf8a-dc74781418ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.203403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6f558-4c98-4661-bf8a-dc74781418ac admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.204092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6f558-4c98-4661-bf8a-dc74781418ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:54.206192 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6f558-4c98-4661-bf8a-dc74781418ac admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:54.281538 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 786/1585] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:00:54 2022] POST /identity/v3/users => generated 303 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:54.282366 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb71424-63fc-484b-8cb5-fac67495fe2a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:54.291559 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb71424-63fc-484b-8cb5-fac67495fe2a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:54.296040 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53df2d-334f-403c-b563-96a8f7bf4244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:54.296698 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53df2d-334f-403c-b563-96a8f7bf4244 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.297073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53df2d-334f-403c-b563-96a8f7bf4244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.297351 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53df2d-334f-403c-b563-96a8f7bf4244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.298051 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53df2d-334f-403c-b563-96a8f7bf4244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:54.299618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53df2d-334f-403c-b563-96a8f7bf4244 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:54.310433 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 787/1586] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:54.311307 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53df2d-334f-403c-b563-96a8f7bf4244 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:54.324637 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 800/1587] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:00:54 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:54.324637 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6f558-4c98-4661-bf8a-dc74781418ac admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:54.330970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53df2d-334f-403c-b563-96a8f7bf4244 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:54.330970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515091e9-afd9-4310-b485-dc05edad5d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:54.330970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515091e9-afd9-4310-b485-dc05edad5d21 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.330970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515091e9-afd9-4310-b485-dc05edad5d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.331352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515091e9-afd9-4310-b485-dc05edad5d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.331808 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515091e9-afd9-4310-b485-dc05edad5d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:54.333428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515091e9-afd9-4310-b485-dc05edad5d21 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:54.334579 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6f558-4c98-4661-bf8a-dc74781418ac admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:54.339590 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001dd77-b63c-4717-a29b-00bef53b4dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:54.340245 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001dd77-b63c-4717-a29b-00bef53b4dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.340533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001dd77-b63c-4717-a29b-00bef53b4dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.340890 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001dd77-b63c-4717-a29b-00bef53b4dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.341624 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001dd77-b63c-4717-a29b-00bef53b4dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:54.343221 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001dd77-b63c-4717-a29b-00bef53b4dd0 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:54.346559 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 788/1588] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:54.346559 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3795a-3741-4dcd-974b-1b92bc7981ab None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.346559 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3795a-3741-4dcd-974b-1b92bc7981ab None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.346559 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3795a-3741-4dcd-974b-1b92bc7981ab None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.346999 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:54.347125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 789/1589] 10.222.0.36 () {54 vars in 961 bytes} [Tue Jul 5 13:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 13:00:54.347657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3795a-3741-4dcd-974b-1b92bc7981ab None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:54.361373 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 801/1590] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:54.361373 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001dd77-b63c-4717-a29b-00bef53b4dd0 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:54.361612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3795a-3741-4dcd-974b-1b92bc7981ab None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:54.365995 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b610c-3bdc-4ac2-8043-2302822daeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:54.366994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b610c-3bdc-4ac2-8043-2302822daeea admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.367280 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b610c-3bdc-4ac2-8043-2302822daeea admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.367555 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b610c-3bdc-4ac2-8043-2302822daeea admin admin] PATH_INFO: `/v3/projects/7265f843966e4334a5873ae840bc1a2b/users/a75457d8fe064a649ff2050a0a8896d5/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.369730 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001dd77-b63c-4717-a29b-00bef53b4dd0 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:54.374448 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c416f5-bb1b-4dbf-bbc4-d59e7789d512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:54.377047 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c416f5-bb1b-4dbf-bbc4-d59e7789d512 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.377047 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c416f5-bb1b-4dbf-bbc4-d59e7789d512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.377047 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c416f5-bb1b-4dbf-bbc4-d59e7789d512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.377047 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c416f5-bb1b-4dbf-bbc4-d59e7789d512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:54.378066 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c416f5-bb1b-4dbf-bbc4-d59e7789d512 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:54.383632 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b610c-3bdc-4ac2-8043-2302822daeea admin admin] RBAC: Authorizing `identity:create_grant(project_id=7265f843966e4334a5873ae840bc1a2b, user_id=a75457d8fe064a649ff2050a0a8896d5, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:54.386878 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b610c-3bdc-4ac2-8043-2302822daeea admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:54.388677 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 802/1591] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:54.389495 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c416f5-bb1b-4dbf-bbc4-d59e7789d512 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:54.398899 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c416f5-bb1b-4dbf-bbc4-d59e7789d512 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:54.403548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f325d5-580a-4b31-9902-f166247ec00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:54.411706 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f325d5-580a-4b31-9902-f166247ec00f admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.411706 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f325d5-580a-4b31-9902-f166247ec00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.411706 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f325d5-580a-4b31-9902-f166247ec00f admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.411706 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f325d5-580a-4b31-9902-f166247ec00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:54.411706 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f325d5-580a-4b31-9902-f166247ec00f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:54.417168 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 803/1592] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:54.417928 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f325d5-580a-4b31-9902-f166247ec00f admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:54.427202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f325d5-580a-4b31-9902-f166247ec00f admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:54.432238 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b72633-4d08-4cda-9a3c-f476f0ef8bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:54.433121 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b72633-4d08-4cda-9a3c-f476f0ef8bbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.433402 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b72633-4d08-4cda-9a3c-f476f0ef8bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.433675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b72633-4d08-4cda-9a3c-f476f0ef8bbb admin admin] PATH_INFO: `/v3/projects/6c201d76ac4e4cc08fdc38e7165d4764/users/475bac060a98475d858e6181eec7ce11/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.449264 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b72633-4d08-4cda-9a3c-f476f0ef8bbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c201d76ac4e4cc08fdc38e7165d4764, user_id=475bac060a98475d858e6181eec7ce11, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:54.450281 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: WARNING py.warnings [None req-13b72633-4d08-4cda-9a3c-f476f0ef8bbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 13:00:54.450281 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: warnings.warn(msg) Jul 05 13:00:54.450281 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: Jul 05 13:00:54.452200 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b72633-4d08-4cda-9a3c-f476f0ef8bbb admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:54.475986 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 790/1593] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:00:54 2022] PUT /identity/v3/projects/7265f843966e4334a5873ae840bc1a2b/users/a75457d8fe064a649ff2050a0a8896d5/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:54.492732 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b610c-3bdc-4ac2-8043-2302822daeea admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:54.533140 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 804/1594] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:00:54 2022] PUT /identity/v3/projects/6c201d76ac4e4cc08fdc38e7165d4764/users/475bac060a98475d858e6181eec7ce11/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:54.536951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b72633-4d08-4cda-9a3c-f476f0ef8bbb admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:54.537043 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b610c-3bdc-4ac2-8043-2302822daeea admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:54.592019 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329488b-b07f-42dd-a1e5-69da4c99d3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:54.592638 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329488b-b07f-42dd-a1e5-69da4c99d3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.592926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329488b-b07f-42dd-a1e5-69da4c99d3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.593205 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329488b-b07f-42dd-a1e5-69da4c99d3e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.593954 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329488b-b07f-42dd-a1e5-69da4c99d3e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:54.594570 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b72633-4d08-4cda-9a3c-f476f0ef8bbb admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:54.595559 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329488b-b07f-42dd-a1e5-69da4c99d3e1 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:54.599224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03ecdf-91e0-4e56-8982-b62bed451577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:54.602582 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03ecdf-91e0-4e56-8982-b62bed451577 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.602582 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03ecdf-91e0-4e56-8982-b62bed451577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.602582 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03ecdf-91e0-4e56-8982-b62bed451577 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.602582 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c03ecdf-91e0-4e56-8982-b62bed451577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:54.603255 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c03ecdf-91e0-4e56-8982-b62bed451577 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:54.606650 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 791/1595] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:54.607898 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c7cc9-1a00-4823-8a7e-200c9b16e642 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.608218 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c7cc9-1a00-4823-8a7e-200c9b16e642 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.608477 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c7cc9-1a00-4823-8a7e-200c9b16e642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.614251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 805/1596] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:54.615621 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03ecdf-91e0-4e56-8982-b62bed451577 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:54.616914 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:54.626912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03ecdf-91e0-4e56-8982-b62bed451577 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:54.628219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d36c7cc9-1a00-4823-8a7e-200c9b16e642 None None] MFA Rules not processed for user `cdf37a42279a466b85906b23751f9c22`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:54.629570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d36c7cc9-1a00-4823-8a7e-200c9b16e642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:54.631465 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f2676-b547-4abc-9eac-ea36fe434b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:54.632117 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f2676-b547-4abc-9eac-ea36fe434b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.632398 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f2676-b547-4abc-9eac-ea36fe434b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.632705 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f2676-b547-4abc-9eac-ea36fe434b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.633431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f2676-b547-4abc-9eac-ea36fe434b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:54.635175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f2676-b547-4abc-9eac-ea36fe434b2b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:54.645230 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 806/1597] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:54.646196 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f2676-b547-4abc-9eac-ea36fe434b2b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:54.656440 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f2676-b547-4abc-9eac-ea36fe434b2b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:54.661120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc7812-bf0c-405f-8993-e4998c1ce324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:54.661762 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc7812-bf0c-405f-8993-e4998c1ce324 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.662045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc7812-bf0c-405f-8993-e4998c1ce324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.662324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc7812-bf0c-405f-8993-e4998c1ce324 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.663035 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc7812-bf0c-405f-8993-e4998c1ce324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:54.664758 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc7812-bf0c-405f-8993-e4998c1ce324 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:54.675039 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 807/1598] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:54.677351 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc7812-bf0c-405f-8993-e4998c1ce324 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:54.686658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc7812-bf0c-405f-8993-e4998c1ce324 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:54.691293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7002fe-e15a-465f-a65e-300a498231e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:54.691933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7002fe-e15a-465f-a65e-300a498231e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.696718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7002fe-e15a-465f-a65e-300a498231e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.696718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7002fe-e15a-465f-a65e-300a498231e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.696718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7002fe-e15a-465f-a65e-300a498231e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:54.696718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7002fe-e15a-465f-a65e-300a498231e5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:54.697749 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 792/1599] 10.222.0.36 () {58 vars in 1058 bytes} [Tue Jul 5 13:00:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:54.699047 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb9901-4462-49c0-8f2e-3badb7a61393 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.699339 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb9901-4462-49c0-8f2e-3badb7a61393 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.699615 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb9901-4462-49c0-8f2e-3badb7a61393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.706350 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 808/1600] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:54.707671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70e0af-c80a-467a-af03-00b82b975148 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.707965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70e0af-c80a-467a-af03-00b82b975148 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.708248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70e0af-c80a-467a-af03-00b82b975148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.725535 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-4c70e0af-c80a-467a-af03-00b82b975148 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:54.726874 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4c70e0af-c80a-467a-af03-00b82b975148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:54.727213 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2bcb9901-4462-49c0-8f2e-3badb7a61393 None None] MFA Rules not processed for user `a75457d8fe064a649ff2050a0a8896d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:54.728797 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2bcb9901-4462-49c0-8f2e-3badb7a61393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:54.734971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 809/1601] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:54.735895 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70e0af-c80a-467a-af03-00b82b975148 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:54.745525 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70e0af-c80a-467a-af03-00b82b975148 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:54.750034 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41643077-3db0-46dd-ae1d-28fad5f28ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:54.750682 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41643077-3db0-46dd-ae1d-28fad5f28ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.750967 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41643077-3db0-46dd-ae1d-28fad5f28ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.751241 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41643077-3db0-46dd-ae1d-28fad5f28ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.751968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41643077-3db0-46dd-ae1d-28fad5f28ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:54.753611 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41643077-3db0-46dd-ae1d-28fad5f28ac5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:54.764482 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 810/1602] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:54.765541 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41643077-3db0-46dd-ae1d-28fad5f28ac5 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:54.776546 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41643077-3db0-46dd-ae1d-28fad5f28ac5 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:54.781049 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255be3fa-19fb-40e2-8939-259fb7dada47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:54.781902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255be3fa-19fb-40e2-8939-259fb7dada47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.782179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255be3fa-19fb-40e2-8939-259fb7dada47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.782474 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255be3fa-19fb-40e2-8939-259fb7dada47 admin admin] PATH_INFO: `/v3/projects/79d337ebe3a0475b9331780325e17451/users/ac264b6684ae4c3f9fc8903163693d6f/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.796391 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255be3fa-19fb-40e2-8939-259fb7dada47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d337ebe3a0475b9331780325e17451, user_id=ac264b6684ae4c3f9fc8903163693d6f, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:54.799077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255be3fa-19fb-40e2-8939-259fb7dada47 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:54.801093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 793/1603] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:54.801903 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb9901-4462-49c0-8f2e-3badb7a61393 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:54.811832 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb9901-4462-49c0-8f2e-3badb7a61393 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:54.816248 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc52580-4e23-4928-bb69-d3f5377a4c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:54.822856 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc52580-4e23-4928-bb69-d3f5377a4c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:54.822856 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc52580-4e23-4928-bb69-d3f5377a4c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:54.822856 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc52580-4e23-4928-bb69-d3f5377a4c07 admin admin] PATH_INFO: `/v3/projects/163f0d5f47be49f493296f228d1080a5/users/aa97e27060b3429bbad061a256db19f1/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:54.832453 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc52580-4e23-4928-bb69-d3f5377a4c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=163f0d5f47be49f493296f228d1080a5, user_id=aa97e27060b3429bbad061a256db19f1, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:54.835149 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc52580-4e23-4928-bb69-d3f5377a4c07 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:54.910507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 811/1604] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:00:54 2022] PUT /identity/v3/projects/79d337ebe3a0475b9331780325e17451/users/ac264b6684ae4c3f9fc8903163693d6f/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:54.911332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255be3fa-19fb-40e2-8939-259fb7dada47 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:54.921532 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 794/1605] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:00:54 2022] PUT /identity/v3/projects/163f0d5f47be49f493296f228d1080a5/users/aa97e27060b3429bbad061a256db19f1/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:54.922551 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc52580-4e23-4928-bb69-d3f5377a4c07 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:54.946901 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:54.975386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255be3fa-19fb-40e2-8939-259fb7dada47 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:54.981648 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:54.993606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc52580-4e23-4928-bb69-d3f5377a4c07 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:54.999809 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d349e3-0e38-4b06-b969-7ccc4698846d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:55.000454 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d349e3-0e38-4b06-b969-7ccc4698846d service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:55.000774 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d349e3-0e38-4b06-b969-7ccc4698846d service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:55.001054 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d349e3-0e38-4b06-b969-7ccc4698846d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:55.033730 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133aa229-f18a-42fc-8d9c-1c0ff97bffff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:55.034698 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aa229-f18a-42fc-8d9c-1c0ff97bffff admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:55.034980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aa229-f18a-42fc-8d9c-1c0ff97bffff admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:55.035263 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aa229-f18a-42fc-8d9c-1c0ff97bffff admin admin] PATH_INFO: `/v3/projects/7836a0ee154744b49a323e6b94860e50/users/ad3f91c024f8415cac4784fec0689757/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:55.050236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133aa229-f18a-42fc-8d9c-1c0ff97bffff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7836a0ee154744b49a323e6b94860e50, user_id=ad3f91c024f8415cac4784fec0689757, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:55.053209 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133aa229-f18a-42fc-8d9c-1c0ff97bffff admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:55.054734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d349e3-0e38-4b06-b969-7ccc4698846d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:55.056321 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d349e3-0e38-4b06-b969-7ccc4698846d service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:55.066381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 795/1606] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:55.066771 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d349e3-0e38-4b06-b969-7ccc4698846d service nova] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:55.077042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d349e3-0e38-4b06-b969-7ccc4698846d service nova] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:55.082477 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce612d-7c61-4cad-b2fe-34281ffc0ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:55.083477 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce612d-7c61-4cad-b2fe-34281ffc0ed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:55.083842 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce612d-7c61-4cad-b2fe-34281ffc0ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:55.084180 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce612d-7c61-4cad-b2fe-34281ffc0ed7 admin admin] PATH_INFO: `/v3/projects/69e545670056478d8df7d69da014d292/users/96f044bee015470a9281b62c4041d8cc/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:55.098708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce612d-7c61-4cad-b2fe-34281ffc0ed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69e545670056478d8df7d69da014d292, user_id=96f044bee015470a9281b62c4041d8cc, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:55.101408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce612d-7c61-4cad-b2fe-34281ffc0ed7 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:55.139986 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 812/1607] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:00:54 2022] PUT /identity/v3/projects/7836a0ee154744b49a323e6b94860e50/users/ad3f91c024f8415cac4784fec0689757/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:55.143102 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133aa229-f18a-42fc-8d9c-1c0ff97bffff admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:55.185756 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 796/1608] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:00:55 2022] PUT /identity/v3/projects/69e545670056478d8df7d69da014d292/users/96f044bee015470a9281b62c4041d8cc/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:55.186653 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce612d-7c61-4cad-b2fe-34281ffc0ed7 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:55.200983 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133aa229-f18a-42fc-8d9c-1c0ff97bffff admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:55.254036 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce612d-7c61-4cad-b2fe-34281ffc0ed7 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:55.261693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebdd9f1-1341-470e-96a8-cb8c0bdaba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:55.263259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdd9f1-1341-470e-96a8-cb8c0bdaba08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:55.263613 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdd9f1-1341-470e-96a8-cb8c0bdaba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:55.263899 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdd9f1-1341-470e-96a8-cb8c0bdaba08 admin admin] PATH_INFO: `/v3/projects/6e6d3f1f098d4520b1eec489c92e2ebd/users/6fb634208b9b4c57b6d0d3c01b1e5906/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:55.264570 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df13c1-aa0d-489c-9608-a3cc2e46b38c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:55.265449 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df13c1-aa0d-489c-9608-a3cc2e46b38c service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:55.265828 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df13c1-aa0d-489c-9608-a3cc2e46b38c service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:55.266175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df13c1-aa0d-489c-9608-a3cc2e46b38c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:55.276298 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df13c1-aa0d-489c-9608-a3cc2e46b38c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:55.277885 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df13c1-aa0d-489c-9608-a3cc2e46b38c service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:55.279528 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebdd9f1-1341-470e-96a8-cb8c0bdaba08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e6d3f1f098d4520b1eec489c92e2ebd, user_id=6fb634208b9b4c57b6d0d3c01b1e5906, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:55.282238 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebdd9f1-1341-470e-96a8-cb8c0bdaba08 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:55.288143 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 813/1609] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:55.293527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df13c1-aa0d-489c-9608-a3cc2e46b38c service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:55.303807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df13c1-aa0d-489c-9608-a3cc2e46b38c service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:55.308683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95256f-2a85-4982-ae3d-25484f23fb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:55.309354 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95256f-2a85-4982-ae3d-25484f23fb1d admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:55.309703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95256f-2a85-4982-ae3d-25484f23fb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:55.309984 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95256f-2a85-4982-ae3d-25484f23fb1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:55.310678 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95256f-2a85-4982-ae3d-25484f23fb1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:55.312766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95256f-2a85-4982-ae3d-25484f23fb1d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:55.345201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 797/1610] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:00:55 2022] PUT /identity/v3/projects/6e6d3f1f098d4520b1eec489c92e2ebd/users/6fb634208b9b4c57b6d0d3c01b1e5906/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:55.346501 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c2b61-8ab0-4be4-8477-b35ab9d5f269 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:55.346798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c2b61-8ab0-4be4-8477-b35ab9d5f269 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:55.347105 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c2b61-8ab0-4be4-8477-b35ab9d5f269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:55.364347 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c46c2b61-8ab0-4be4-8477-b35ab9d5f269 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:55.365596 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c46c2b61-8ab0-4be4-8477-b35ab9d5f269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:55.417179 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:55.427136 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 798/1611] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:55.428675 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba27ba-8e69-40b0-a00d-129807a74147 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:55.429112 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba27ba-8e69-40b0-a00d-129807a74147 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:55.429416 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba27ba-8e69-40b0-a00d-129807a74147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:55.432514 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:55.442841 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 814/1612] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:00:55 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:55.442841 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748197c6-ef3f-4b6a-bb54-0d67be4ca3a6 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:55.442841 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748197c6-ef3f-4b6a-bb54-0d67be4ca3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:55.442841 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748197c6-ef3f-4b6a-bb54-0d67be4ca3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:55.450094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b6ba27ba-8e69-40b0-a00d-129807a74147 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:55.451981 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b6ba27ba-8e69-40b0-a00d-129807a74147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:55.463257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-748197c6-ef3f-4b6a-bb54-0d67be4ca3a6 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:55.464487 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-748197c6-ef3f-4b6a-bb54-0d67be4ca3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:55.519248 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 799/1613] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:55.520617 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3651c28-1eb5-4386-ba55-2b97b99ea4ae None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:55.520940 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3651c28-1eb5-4386-ba55-2b97b99ea4ae None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:55.522715 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3651c28-1eb5-4386-ba55-2b97b99ea4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:55.528797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 815/1614] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:55.528797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a5650-39f6-4858-8d9e-95a4d35ccf7a None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:55.528797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a5650-39f6-4858-8d9e-95a4d35ccf7a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:55.529133 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a5650-39f6-4858-8d9e-95a4d35ccf7a None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:55.530237 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 816/1615] 10.222.0.36 () {54 vars in 912 bytes} [Tue Jul 5 13:00:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 13:00:55.531344 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6da3a-5f2f-457c-9e97-d3e3be8c620b None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:55.531606 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6da3a-5f2f-457c-9e97-d3e3be8c620b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:55.532833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6da3a-5f2f-457c-9e97-d3e3be8c620b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:55.551549 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b3651c28-1eb5-4386-ba55-2b97b99ea4ae None None] MFA Rules not processed for user `96f044bee015470a9281b62c4041d8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:55.552790 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b3651c28-1eb5-4386-ba55-2b97b99ea4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:55.563274 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-0ab6da3a-5f2f-457c-9e97-d3e3be8c620b None None] MFA Rules not processed for user `6fb634208b9b4c57b6d0d3c01b1e5906`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:55.564701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0ab6da3a-5f2f-457c-9e97-d3e3be8c620b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:55.637662 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 817/1616] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:55.638704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6da3a-5f2f-457c-9e97-d3e3be8c620b None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:55.640850 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0ab6da3a-5f2f-457c-9e97-d3e3be8c620b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:55.655065 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 800/1617] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:55.655065 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3651c28-1eb5-4386-ba55-2b97b99ea4ae None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:55.672630 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3651c28-1eb5-4386-ba55-2b97b99ea4ae None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:55.679376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afc59a-4329-4ee7-bc06-48f0c1ccba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:55.680532 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afc59a-4329-4ee7-bc06-48f0c1ccba27 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:55.681056 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afc59a-4329-4ee7-bc06-48f0c1ccba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:55.681796 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afc59a-4329-4ee7-bc06-48f0c1ccba27 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:55.682815 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afc59a-4329-4ee7-bc06-48f0c1ccba27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:55.685868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afc59a-4329-4ee7-bc06-48f0c1ccba27 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:55.727699 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6da3a-5f2f-457c-9e97-d3e3be8c620b None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:55.732439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c2206-1b63-4c83-b03f-64ab00db848e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:55.733125 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c2206-1b63-4c83-b03f-64ab00db848e service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:55.733415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c2206-1b63-4c83-b03f-64ab00db848e service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:55.733694 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c2206-1b63-4c83-b03f-64ab00db848e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:55.743074 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c2206-1b63-4c83-b03f-64ab00db848e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:55.744568 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c2206-1b63-4c83-b03f-64ab00db848e service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:55.754123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 818/1618] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:55.760701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c2206-1b63-4c83-b03f-64ab00db848e service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:55.763039 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c2206-1b63-4c83-b03f-64ab00db848e service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:55.767004 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bac81-5c14-4712-934e-4e7e4afed307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:55.767318 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bac81-5c14-4712-934e-4e7e4afed307 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:55.767602 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bac81-5c14-4712-934e-4e7e4afed307 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:55.767876 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bac81-5c14-4712-934e-4e7e4afed307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:55.778958 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bac81-5c14-4712-934e-4e7e4afed307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:55.779466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bac81-5c14-4712-934e-4e7e4afed307 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:55.790709 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 819/1619] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:55.792805 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289b3f3-56c7-4359-a429-8acf41a03d3b None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:55.793107 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289b3f3-56c7-4359-a429-8acf41a03d3b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:55.793367 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289b3f3-56c7-4359-a429-8acf41a03d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:55.811037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-5289b3f3-56c7-4359-a429-8acf41a03d3b None None] MFA Rules not processed for user `cdf37a42279a466b85906b23751f9c22`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:55.812259 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5289b3f3-56c7-4359-a429-8acf41a03d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:55.825463 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 801/1620] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:00:55 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:55.825949 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:55.826289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afc59a-4329-4ee7-bc06-48f0c1ccba27 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:55.835577 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afc59a-4329-4ee7-bc06-48f0c1ccba27 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:55.839733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8f9d8-1989-4441-a9c9-6e9906828a03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:55.840352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8f9d8-1989-4441-a9c9-6e9906828a03 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:55.840665 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8f9d8-1989-4441-a9c9-6e9906828a03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:55.841108 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8f9d8-1989-4441-a9c9-6e9906828a03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:55.867261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8f9d8-1989-4441-a9c9-6e9906828a03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:55.869866 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8f9d8-1989-4441-a9c9-6e9906828a03 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:55.885220 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 802/1621] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:55.886434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8f9d8-1989-4441-a9c9-6e9906828a03 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:55.897787 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8f9d8-1989-4441-a9c9-6e9906828a03 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:55.905395 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 820/1622] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jul 5 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:55.905587 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12133c3-cebe-478c-adda-01d7776733f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:55.906658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12133c3-cebe-478c-adda-01d7776733f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:55.906938 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12133c3-cebe-478c-adda-01d7776733f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:55.907064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b67dda-42f3-4c0c-9b0e-f2cb95a5b576 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:55.907289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b67dda-42f3-4c0c-9b0e-f2cb95a5b576 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:55.907515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12133c3-cebe-478c-adda-01d7776733f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:55.907645 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b67dda-42f3-4c0c-9b0e-f2cb95a5b576 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:55.908670 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12133c3-cebe-478c-adda-01d7776733f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:55.911502 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12133c3-cebe-478c-adda-01d7776733f4 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:55.913598 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 821/1623] 10.222.0.36 () {54 vars in 961 bytes} [Tue Jul 5 13:00:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 13:00:55.914718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b67dda-42f3-4c0c-9b0e-f2cb95a5b576 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:55.931005 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b67dda-42f3-4c0c-9b0e-f2cb95a5b576 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:55.937653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc16aa-87c3-4993-8b49-06fbccd478f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:55.938487 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc16aa-87c3-4993-8b49-06fbccd478f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:55.938776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc16aa-87c3-4993-8b49-06fbccd478f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:55.939055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc16aa-87c3-4993-8b49-06fbccd478f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:55.939825 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc16aa-87c3-4993-8b49-06fbccd478f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:55.941553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc16aa-87c3-4993-8b49-06fbccd478f6 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:55.955350 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 822/1624] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:55.956206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc16aa-87c3-4993-8b49-06fbccd478f6 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:56.015905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc16aa-87c3-4993-8b49-06fbccd478f6 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:56.019786 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c798f-536f-4511-92a8-e88dd3d77bb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:56.020514 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c798f-536f-4511-92a8-e88dd3d77bb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:56.020928 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c798f-536f-4511-92a8-e88dd3d77bb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:56.021285 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c798f-536f-4511-92a8-e88dd3d77bb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:56.032302 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c798f-536f-4511-92a8-e88dd3d77bb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:56.033972 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c798f-536f-4511-92a8-e88dd3d77bb6 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:56.050366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 823/1625] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:56.050916 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea476d9-beb7-4026-a17b-9720008c89ba None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:56.051265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea476d9-beb7-4026-a17b-9720008c89ba None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:56.051555 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea476d9-beb7-4026-a17b-9720008c89ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:56.059126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 803/1626] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:00:55 2022] POST /identity/v3/projects => generated 403 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:56.059126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12133c3-cebe-478c-adda-01d7776733f4 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:56.080871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-2ea476d9-beb7-4026-a17b-9720008c89ba None None] MFA Rules not processed for user `cdf37a42279a466b85906b23751f9c22`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:56.082123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2ea476d9-beb7-4026-a17b-9720008c89ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:56.115749 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:56.140873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12133c3-cebe-478c-adda-01d7776733f4 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:56.151591 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ba970-2b45-469b-84cb-2e5ef91e349f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:56.151591 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ba970-2b45-469b-84cb-2e5ef91e349f admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:56.151591 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ba970-2b45-469b-84cb-2e5ef91e349f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:56.151591 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ba970-2b45-469b-84cb-2e5ef91e349f admin admin] PATH_INFO: `/v3/projects/502722c7767a44c980d73d5b8592e531/users/522c58c8f432414b869b2d1ecbe3813b/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:56.167628 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ba970-2b45-469b-84cb-2e5ef91e349f admin admin] RBAC: Authorizing `identity:create_grant(project_id=502722c7767a44c980d73d5b8592e531, user_id=522c58c8f432414b869b2d1ecbe3813b, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:56.171620 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ba970-2b45-469b-84cb-2e5ef91e349f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:56.181563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 824/1627] 10.222.0.36 () {58 vars in 1058 bytes} [Tue Jul 5 13:00:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:56.183075 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea476d9-beb7-4026-a17b-9720008c89ba None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:56.194335 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea476d9-beb7-4026-a17b-9720008c89ba None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:56.200046 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df18be-8306-4220-be22-7c8172883c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:56.201708 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df18be-8306-4220-be22-7c8172883c9c admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:56.202079 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df18be-8306-4220-be22-7c8172883c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:56.202434 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df18be-8306-4220-be22-7c8172883c9c admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:56.203823 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df18be-8306-4220-be22-7c8172883c9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:56.206365 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df18be-8306-4220-be22-7c8172883c9c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:56.345035 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 804/1628] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:00:56 2022] PUT /identity/v3/projects/502722c7767a44c980d73d5b8592e531/users/522c58c8f432414b869b2d1ecbe3813b/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:56.346391 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ba970-2b45-469b-84cb-2e5ef91e349f admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:56.360285 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 825/1629] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:00:56 2022] POST /identity/v3/users => generated 308 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:00:56.363390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df18be-8306-4220-be22-7c8172883c9c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:56.381558 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df18be-8306-4220-be22-7c8172883c9c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:56.401885 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:56.439057 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ba970-2b45-469b-84cb-2e5ef91e349f admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:56.446062 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903bda5-56e1-4865-b391-e4156a5dfbc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:56.446875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903bda5-56e1-4865-b391-e4156a5dfbc2 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:56.447663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903bda5-56e1-4865-b391-e4156a5dfbc2 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:56.447906 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903bda5-56e1-4865-b391-e4156a5dfbc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:56.475600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5f861-fe66-40b4-88ae-93ef22170f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:56.477192 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5f861-fe66-40b4-88ae-93ef22170f02 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:56.477550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5f861-fe66-40b4-88ae-93ef22170f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:56.478419 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5f861-fe66-40b4-88ae-93ef22170f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:56.479895 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5f861-fe66-40b4-88ae-93ef22170f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:56.481658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5f861-fe66-40b4-88ae-93ef22170f02 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:56.498429 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 826/1630] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:56.499674 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5f861-fe66-40b4-88ae-93ef22170f02 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:56.510420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5f861-fe66-40b4-88ae-93ef22170f02 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:56.517278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55314ae1-73d2-493d-aa74-c15eee5bb9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:56.518567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55314ae1-73d2-493d-aa74-c15eee5bb9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:56.519214 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55314ae1-73d2-493d-aa74-c15eee5bb9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:56.519788 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55314ae1-73d2-493d-aa74-c15eee5bb9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:56.521091 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55314ae1-73d2-493d-aa74-c15eee5bb9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:56.526117 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55314ae1-73d2-493d-aa74-c15eee5bb9c0 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:56.534418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903bda5-56e1-4865-b391-e4156a5dfbc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:56.536436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903bda5-56e1-4865-b391-e4156a5dfbc2 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:56.536905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 827/1631] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:56.538063 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55314ae1-73d2-493d-aa74-c15eee5bb9c0 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:56.551526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55314ae1-73d2-493d-aa74-c15eee5bb9c0 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:56.556712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639aacc-2228-48e3-98ed-ba425a0fdcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:56.557997 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639aacc-2228-48e3-98ed-ba425a0fdcbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:56.558337 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639aacc-2228-48e3-98ed-ba425a0fdcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:56.558679 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639aacc-2228-48e3-98ed-ba425a0fdcbf admin admin] PATH_INFO: `/v3/projects/502722c7767a44c980d73d5b8592e531/users/522c58c8f432414b869b2d1ecbe3813b/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:56.561082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639aacc-2228-48e3-98ed-ba425a0fdcbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=502722c7767a44c980d73d5b8592e531, user_id=522c58c8f432414b869b2d1ecbe3813b, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:56.562608 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 805/1632] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:56.563583 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903bda5-56e1-4865-b391-e4156a5dfbc2 service nova] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:56.563943 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639aacc-2228-48e3-98ed-ba425a0fdcbf admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:56.583626 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 828/1633] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:00:56 2022] PUT /identity/v3/projects/502722c7767a44c980d73d5b8592e531/users/522c58c8f432414b869b2d1ecbe3813b/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:56.593626 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19d03d-a4d4-49d2-b5c1-558ab01eeaab None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:56.594026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19d03d-a4d4-49d2-b5c1-558ab01eeaab None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:56.594552 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19d03d-a4d4-49d2-b5c1-558ab01eeaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:56.606177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903bda5-56e1-4865-b391-e4156a5dfbc2 service nova] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:56.631934 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-3d19d03d-a4d4-49d2-b5c1-558ab01eeaab None None] MFA Rules not processed for user `522c58c8f432414b869b2d1ecbe3813b`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:56.634253 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3d19d03d-a4d4-49d2-b5c1-558ab01eeaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:56.704391 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:56.728173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7f3a3-adc5-43ee-8611-bb36e3bb8300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:56.731794 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7f3a3-adc5-43ee-8611-bb36e3bb8300 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:56.732427 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7f3a3-adc5-43ee-8611-bb36e3bb8300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:56.734883 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7f3a3-adc5-43ee-8611-bb36e3bb8300 admin admin] PATH_INFO: `/v3/projects/42cf59e7b62540e28a1880aaeab0fcb2/users/e2f1c39da66b44e285ae49a29553e90e/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:56.762592 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7f3a3-adc5-43ee-8611-bb36e3bb8300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42cf59e7b62540e28a1880aaeab0fcb2, user_id=e2f1c39da66b44e285ae49a29553e90e, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:56.765570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7f3a3-adc5-43ee-8611-bb36e3bb8300 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:56.776772 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 829/1634] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:00:56.791673 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19d03d-a4d4-49d2-b5c1-558ab01eeaab None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:56.886977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19d03d-a4d4-49d2-b5c1-558ab01eeaab None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:56.890680 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443271b-4aaa-4435-94d6-27dadaf0483a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:56.891410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443271b-4aaa-4435-94d6-27dadaf0483a service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:56.891759 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443271b-4aaa-4435-94d6-27dadaf0483a service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:56.892106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443271b-4aaa-4435-94d6-27dadaf0483a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:56.912088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443271b-4aaa-4435-94d6-27dadaf0483a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:56.912088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443271b-4aaa-4435-94d6-27dadaf0483a service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:56.928477 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 806/1635] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:00:56 2022] PUT /identity/v3/projects/42cf59e7b62540e28a1880aaeab0fcb2/users/e2f1c39da66b44e285ae49a29553e90e/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:56.929913 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7f3a3-adc5-43ee-8611-bb36e3bb8300 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:56.952804 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 830/1636] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:00:57.023495 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ec09e-da2f-44d1-9e1d-10bddb0b882c None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:57.024139 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ec09e-da2f-44d1-9e1d-10bddb0b882c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:57.024388 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ec09e-da2f-44d1-9e1d-10bddb0b882c None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:57.026863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 831/1637] 10.222.0.36 () {54 vars in 912 bytes} [Tue Jul 5 13:00:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 13:00:57.039727 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658d9f5-1d3c-4e5c-91ed-ee5b7ede9754 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:57.039727 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658d9f5-1d3c-4e5c-91ed-ee5b7ede9754 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:57.039727 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658d9f5-1d3c-4e5c-91ed-ee5b7ede9754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:57.079390 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7f3a3-adc5-43ee-8611-bb36e3bb8300 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:57.085461 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe15614-d688-47b2-b3de-4fdf086bd6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:57.086162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-0658d9f5-1d3c-4e5c-91ed-ee5b7ede9754 None None] MFA Rules not processed for user `cdf37a42279a466b85906b23751f9c22`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:57.086313 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe15614-d688-47b2-b3de-4fdf086bd6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:57.086414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe15614-d688-47b2-b3de-4fdf086bd6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:57.087583 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0658d9f5-1d3c-4e5c-91ed-ee5b7ede9754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:57.096230 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe15614-d688-47b2-b3de-4fdf086bd6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:57.099659 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe15614-d688-47b2-b3de-4fdf086bd6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:57.104087 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe15614-d688-47b2-b3de-4fdf086bd6f5 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:57.115130 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:57.143699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 807/1638] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:00:57.144812 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe15614-d688-47b2-b3de-4fdf086bd6f5 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:57.160802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe15614-d688-47b2-b3de-4fdf086bd6f5 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:57.187350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3f7fa-f657-4add-8578-c5d89073d890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:57.188989 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3f7fa-f657-4add-8578-c5d89073d890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:57.190015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3f7fa-f657-4add-8578-c5d89073d890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:57.190015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3f7fa-f657-4add-8578-c5d89073d890 admin admin] PATH_INFO: `/v3/users/a75457d8fe064a649ff2050a0a8896d5` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:57.191578 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3f7fa-f657-4add-8578-c5d89073d890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a75457d8fe064a649ff2050a0a8896d5)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:57.194354 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3f7fa-f657-4add-8578-c5d89073d890 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:57.264292 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 832/1639] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jul 5 13:00:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:57.270646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658d9f5-1d3c-4e5c-91ed-ee5b7ede9754 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:57.293594 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658d9f5-1d3c-4e5c-91ed-ee5b7ede9754 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:57.309218 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be569645-5409-45c8-90b4-249fcb88cfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:57.310225 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be569645-5409-45c8-90b4-249fcb88cfdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:57.310570 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be569645-5409-45c8-90b4-249fcb88cfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:57.310908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be569645-5409-45c8-90b4-249fcb88cfdc admin admin] PATH_INFO: `/v3/projects/42cf59e7b62540e28a1880aaeab0fcb2/users/e2f1c39da66b44e285ae49a29553e90e/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:57.315790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be569645-5409-45c8-90b4-249fcb88cfdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=42cf59e7b62540e28a1880aaeab0fcb2, user_id=e2f1c39da66b44e285ae49a29553e90e, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:57.324404 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be569645-5409-45c8-90b4-249fcb88cfdc admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:57.364557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 833/1640] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:00:57 2022] PUT /identity/v3/projects/42cf59e7b62540e28a1880aaeab0fcb2/users/e2f1c39da66b44e285ae49a29553e90e/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:57.385941 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be569645-5409-45c8-90b4-249fcb88cfdc admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:57.482425 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-30c3f7fa-f657-4add-8578-c5d89073d890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a75457d8fe064a649ff2050a0a8896d5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:57.492158 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be569645-5409-45c8-90b4-249fcb88cfdc admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:57.508534 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-30c3f7fa-f657-4add-8578-c5d89073d890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a75457d8fe064a649ff2050a0a8896d5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:57.508534 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-30c3f7fa-f657-4add-8578-c5d89073d890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a75457d8fe064a649ff2050a0a8896d5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:57.508534 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-30c3f7fa-f657-4add-8578-c5d89073d890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a75457d8fe064a649ff2050a0a8896d5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:57.511631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c6a9e-e0dd-48bc-b0e4-f43870c2c09d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:57.512301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c6a9e-e0dd-48bc-b0e4-f43870c2c09d service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:57.512604 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c6a9e-e0dd-48bc-b0e4-f43870c2c09d service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:57.512884 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c6a9e-e0dd-48bc-b0e4-f43870c2c09d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:57.519911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7f0c6a9e-e0dd-48bc-b0e4-f43870c2c09d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:57.549895 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-30c3f7fa-f657-4add-8578-c5d89073d890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a75457d8fe064a649ff2050a0a8896d5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:57.653725 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 808/1641] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:00:57 2022] DELETE /identity/v3/users/a75457d8fe064a649ff2050a0a8896d5 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:57.676439 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e13758-02bf-4303-864c-d959e189d113 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:57.679159 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e13758-02bf-4303-864c-d959e189d113 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:57.679950 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e13758-02bf-4303-864c-d959e189d113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:57.703063 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c6a9e-e0dd-48bc-b0e4-f43870c2c09d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:57.704625 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c6a9e-e0dd-48bc-b0e4-f43870c2c09d service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:57.719451 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 834/1642] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:57.720323 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc2134-1a8d-4c52-9fbd-4bae0a0739af None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:57.720702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc2134-1a8d-4c52-9fbd-4bae0a0739af None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:57.721066 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc2134-1a8d-4c52-9fbd-4bae0a0739af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:57.741738 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-08bc2134-1a8d-4c52-9fbd-4bae0a0739af None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:57.743039 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-08bc2134-1a8d-4c52-9fbd-4bae0a0739af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:57.755506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-41e13758-02bf-4303-864c-d959e189d113 None None] MFA Rules not processed for user `e2f1c39da66b44e285ae49a29553e90e`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:57.756780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-41e13758-02bf-4303-864c-d959e189d113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:57.799056 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:57.864273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 835/1643] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:57.871006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 809/1644] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:57 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:57.883018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc2134-1a8d-4c52-9fbd-4bae0a0739af None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:57.885713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e13758-02bf-4303-864c-d959e189d113 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:57.885860 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-08bc2134-1a8d-4c52-9fbd-4bae0a0739af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:57.887890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-41e13758-02bf-4303-864c-d959e189d113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:58.036457 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc2134-1a8d-4c52-9fbd-4bae0a0739af None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:58.036457 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f6da9-78b9-4ded-a3aa-e4ac10621b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:58.036457 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f6da9-78b9-4ded-a3aa-e4ac10621b74 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:58.036457 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f6da9-78b9-4ded-a3aa-e4ac10621b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:58.037861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f6da9-78b9-4ded-a3aa-e4ac10621b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:58.042446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e13758-02bf-4303-864c-d959e189d113 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:58.043056 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f6da9-78b9-4ded-a3aa-e4ac10621b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:58.050648 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad92e61-38db-4e49-8f14-819b174af5e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:58.051163 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad92e61-38db-4e49-8f14-819b174af5e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:58.051454 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad92e61-38db-4e49-8f14-819b174af5e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:58.051744 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad92e61-38db-4e49-8f14-819b174af5e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:58.054423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f6da9-78b9-4ded-a3aa-e4ac10621b74 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:58.071133 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 836/1645] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:58.083086 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad92e61-38db-4e49-8f14-819b174af5e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:58.083086 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad92e61-38db-4e49-8f14-819b174af5e6 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:58.106427 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 810/1646] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:57 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:00:58.266403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f6da9-78b9-4ded-a3aa-e4ac10621b74 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:58.270410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ed1f6da9-78b9-4ded-a3aa-e4ac10621b74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:58.281368 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f6da9-78b9-4ded-a3aa-e4ac10621b74 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:58.286615 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b0140-7452-48f8-acae-3316908cd7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:58.287840 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b0140-7452-48f8-acae-3316908cd7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:58.287840 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b0140-7452-48f8-acae-3316908cd7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:58.288027 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b0140-7452-48f8-acae-3316908cd7fe admin admin] PATH_INFO: `/v3/users/96f044bee015470a9281b62c4041d8cc` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:58.289213 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b0140-7452-48f8-acae-3316908cd7fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f044bee015470a9281b62c4041d8cc)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:58.290403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: WARNING py.warnings [None req-103b0140-7452-48f8-acae-3316908cd7fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 13:00:58.290403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: warnings.warn(msg) Jul 05 13:00:58.290403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: Jul 05 13:00:58.292800 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b0140-7452-48f8-acae-3316908cd7fe admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:58.409622 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:00:58.624436 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-103b0140-7452-48f8-acae-3316908cd7fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f044bee015470a9281b62c4041d8cc'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:58.645278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-103b0140-7452-48f8-acae-3316908cd7fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f044bee015470a9281b62c4041d8cc'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:58.647098 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-103b0140-7452-48f8-acae-3316908cd7fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f044bee015470a9281b62c4041d8cc'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:58.650981 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-103b0140-7452-48f8-acae-3316908cd7fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f044bee015470a9281b62c4041d8cc'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:58.734711 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-103b0140-7452-48f8-acae-3316908cd7fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f044bee015470a9281b62c4041d8cc'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:58.859674 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 837/1647] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:00:58 2022] DELETE /identity/v3/users/96f044bee015470a9281b62c4041d8cc => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:58.865201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe57f2-1b9f-42a5-86fd-ea8eafac05e2 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:58.865766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe57f2-1b9f-42a5-86fd-ea8eafac05e2 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:58.866230 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe57f2-1b9f-42a5-86fd-ea8eafac05e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:58.927454 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-cdbe57f2-1b9f-42a5-86fd-ea8eafac05e2 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:00:58.936968 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-cdbe57f2-1b9f-42a5-86fd-ea8eafac05e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:59.099994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 811/1648] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:00:59.159248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b0140-7452-48f8-acae-3316908cd7fe admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:59.164187 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-103b0140-7452-48f8-acae-3316908cd7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:59.165501 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe57f2-1b9f-42a5-86fd-ea8eafac05e2 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:59.167893 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-cdbe57f2-1b9f-42a5-86fd-ea8eafac05e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:00:59.188947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe57f2-1b9f-42a5-86fd-ea8eafac05e2 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:59.199441 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae269d-5e4b-4f9c-ac01-a29063adda24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:59.200326 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae269d-5e4b-4f9c-ac01-a29063adda24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:59.200830 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae269d-5e4b-4f9c-ac01-a29063adda24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:59.201260 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae269d-5e4b-4f9c-ac01-a29063adda24 admin admin] PATH_INFO: `/v3/projects/7265f843966e4334a5873ae840bc1a2b` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:59.204927 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae269d-5e4b-4f9c-ac01-a29063adda24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7265f843966e4334a5873ae840bc1a2b)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:59.206142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: WARNING py.warnings [None req-d3ae269d-5e4b-4f9c-ac01-a29063adda24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 13:00:59.206142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: warnings.warn(msg) Jul 05 13:00:59.206142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: Jul 05 13:00:59.207732 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae269d-5e4b-4f9c-ac01-a29063adda24 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:59.232289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b0140-7452-48f8-acae-3316908cd7fe admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:00:59.249196 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bebef9-39b6-4f7b-8b60-13692bd1cec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:00:59.251363 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bebef9-39b6-4f7b-8b60-13692bd1cec2 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:00:59.252461 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bebef9-39b6-4f7b-8b60-13692bd1cec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:00:59.744778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bebef9-39b6-4f7b-8b60-13692bd1cec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:00:59.744778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bebef9-39b6-4f7b-8b60-13692bd1cec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:00:59.744778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bebef9-39b6-4f7b-8b60-13692bd1cec2 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:00:59.744778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 838/1649] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:00:59.745450 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d3ae269d-5e4b-4f9c-ac01-a29063adda24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7265f843966e4334a5873ae840bc1a2b', 'request_id': 'req-d3ae269d-5e4b-4f9c-ac01-a29063adda24'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:59.745450 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d3ae269d-5e4b-4f9c-ac01-a29063adda24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7265f843966e4334a5873ae840bc1a2b', 'request_id': 'req-d3ae269d-5e4b-4f9c-ac01-a29063adda24'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:59.824962 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d3ae269d-5e4b-4f9c-ac01-a29063adda24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7265f843966e4334a5873ae840bc1a2b', 'request_id': 'req-d3ae269d-5e4b-4f9c-ac01-a29063adda24'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:59.853829 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d3ae269d-5e4b-4f9c-ac01-a29063adda24 admin admin] The token cache is being invalidate because project 7265f843966e4334a5873ae840bc1a2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:00:59.854123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d3ae269d-5e4b-4f9c-ac01-a29063adda24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:59.855130 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d3ae269d-5e4b-4f9c-ac01-a29063adda24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:00:59.865760 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 812/1650] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:00:59 2022] DELETE /identity/v3/projects/7265f843966e4334a5873ae840bc1a2b => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:00:59.875140 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bebef9-39b6-4f7b-8b60-13692bd1cec2 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:00:59.880123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bebef9-39b6-4f7b-8b60-13692bd1cec2 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:00.022964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24351b8-cc9c-4145-9f8c-804546b34a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:00.027973 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24351b8-cc9c-4145-9f8c-804546b34a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:00.027973 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24351b8-cc9c-4145-9f8c-804546b34a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:00.027973 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24351b8-cc9c-4145-9f8c-804546b34a6d admin admin] PATH_INFO: `/v3/users/522c58c8f432414b869b2d1ecbe3813b` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:00.029704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24351b8-cc9c-4145-9f8c-804546b34a6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=522c58c8f432414b869b2d1ecbe3813b)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:00.031678 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24351b8-cc9c-4145-9f8c-804546b34a6d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:00.423333 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae269d-5e4b-4f9c-ac01-a29063adda24 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:00.425655 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d3ae269d-5e4b-4f9c-ac01-a29063adda24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:00.451957 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f24351b8-cc9c-4145-9f8c-804546b34a6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '522c58c8f432414b869b2d1ecbe3813b'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:00.470546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae269d-5e4b-4f9c-ac01-a29063adda24 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:00.473446 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f24351b8-cc9c-4145-9f8c-804546b34a6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '522c58c8f432414b869b2d1ecbe3813b'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:00.474333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f24351b8-cc9c-4145-9f8c-804546b34a6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '522c58c8f432414b869b2d1ecbe3813b'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:00.481582 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044e115-2363-4abe-a888-b3af7628c283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:00.482779 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044e115-2363-4abe-a888-b3af7628c283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:00.483219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044e115-2363-4abe-a888-b3af7628c283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:00.483648 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044e115-2363-4abe-a888-b3af7628c283 admin admin] PATH_INFO: `/v3/projects/69e545670056478d8df7d69da014d292` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:00.484413 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f24351b8-cc9c-4145-9f8c-804546b34a6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '522c58c8f432414b869b2d1ecbe3813b'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:00.485278 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044e115-2363-4abe-a888-b3af7628c283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69e545670056478d8df7d69da014d292)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:00.487841 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044e115-2363-4abe-a888-b3af7628c283 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:00.529808 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f24351b8-cc9c-4145-9f8c-804546b34a6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '522c58c8f432414b869b2d1ecbe3813b'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:00.671974 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:00.676245 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 839/1651] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:00:59 2022] DELETE /identity/v3/users/522c58c8f432414b869b2d1ecbe3813b => generated 0 bytes in 811 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:00.711598 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4044e115-2363-4abe-a888-b3af7628c283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69e545670056478d8df7d69da014d292', 'request_id': 'req-4044e115-2363-4abe-a888-b3af7628c283'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:01.476264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4044e115-2363-4abe-a888-b3af7628c283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69e545670056478d8df7d69da014d292', 'request_id': 'req-4044e115-2363-4abe-a888-b3af7628c283'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:01.485281 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4044e115-2363-4abe-a888-b3af7628c283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69e545670056478d8df7d69da014d292', 'request_id': 'req-4044e115-2363-4abe-a888-b3af7628c283'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:01.498256 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4044e115-2363-4abe-a888-b3af7628c283 admin admin] The token cache is being invalidate because project 69e545670056478d8df7d69da014d292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:01.498703 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4044e115-2363-4abe-a888-b3af7628c283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:01.499512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4044e115-2363-4abe-a888-b3af7628c283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:01.514453 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:01.519427 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 813/1652] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:00 2022] DELETE /identity/v3/projects/69e545670056478d8df7d69da014d292 => generated 0 bytes in 1097 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:01:01.523503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24351b8-cc9c-4145-9f8c-804546b34a6d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:01.525969 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f24351b8-cc9c-4145-9f8c-804546b34a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:01.717558 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24351b8-cc9c-4145-9f8c-804546b34a6d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:01.937200 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a74ba-ed72-4132-9c1b-4300d884b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:01.938131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a74ba-ed72-4132-9c1b-4300d884b366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:01.938422 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a74ba-ed72-4132-9c1b-4300d884b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:01.938708 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a74ba-ed72-4132-9c1b-4300d884b366 admin admin] PATH_INFO: `/v3/users/e2f1c39da66b44e285ae49a29553e90e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:01.942417 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a74ba-ed72-4132-9c1b-4300d884b366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2f1c39da66b44e285ae49a29553e90e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:01.944547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a74ba-ed72-4132-9c1b-4300d884b366 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:02.278650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-aa9a74ba-ed72-4132-9c1b-4300d884b366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2f1c39da66b44e285ae49a29553e90e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:02.289050 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-aa9a74ba-ed72-4132-9c1b-4300d884b366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2f1c39da66b44e285ae49a29553e90e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:02.289050 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-aa9a74ba-ed72-4132-9c1b-4300d884b366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2f1c39da66b44e285ae49a29553e90e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:02.289405 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-aa9a74ba-ed72-4132-9c1b-4300d884b366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2f1c39da66b44e285ae49a29553e90e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:02.310301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-aa9a74ba-ed72-4132-9c1b-4300d884b366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2f1c39da66b44e285ae49a29553e90e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:02.426728 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 840/1653] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:01 2022] DELETE /identity/v3/users/e2f1c39da66b44e285ae49a29553e90e => generated 0 bytes in 904 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:02.917193 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044e115-2363-4abe-a888-b3af7628c283 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:02.918677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4044e115-2363-4abe-a888-b3af7628c283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:02.950215 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044e115-2363-4abe-a888-b3af7628c283 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:03.139320 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8846d-7183-477e-8ee6-4b7ee3ce8bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:03.140234 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8846d-7183-477e-8ee6-4b7ee3ce8bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:03.140523 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8846d-7183-477e-8ee6-4b7ee3ce8bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:03.140832 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8846d-7183-477e-8ee6-4b7ee3ce8bac admin admin] PATH_INFO: `/v3/projects/502722c7767a44c980d73d5b8592e531` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:03.149272 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8846d-7183-477e-8ee6-4b7ee3ce8bac admin admin] RBAC: Authorizing `identity:delete_project(project_id=502722c7767a44c980d73d5b8592e531)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:03.156384 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8846d-7183-477e-8ee6-4b7ee3ce8bac admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:03.184853 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:03.396101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d6a8846d-7183-477e-8ee6-4b7ee3ce8bac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '502722c7767a44c980d73d5b8592e531', 'request_id': 'req-d6a8846d-7183-477e-8ee6-4b7ee3ce8bac'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:03.498828 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d6a8846d-7183-477e-8ee6-4b7ee3ce8bac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '502722c7767a44c980d73d5b8592e531', 'request_id': 'req-d6a8846d-7183-477e-8ee6-4b7ee3ce8bac'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:03.509087 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d6a8846d-7183-477e-8ee6-4b7ee3ce8bac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '502722c7767a44c980d73d5b8592e531', 'request_id': 'req-d6a8846d-7183-477e-8ee6-4b7ee3ce8bac'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:03.533326 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d6a8846d-7183-477e-8ee6-4b7ee3ce8bac admin admin] The token cache is being invalidate because project 502722c7767a44c980d73d5b8592e531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:03.534003 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d6a8846d-7183-477e-8ee6-4b7ee3ce8bac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:03.535360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d6a8846d-7183-477e-8ee6-4b7ee3ce8bac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:03.541525 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 814/1654] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:02 2022] DELETE /identity/v3/projects/502722c7767a44c980d73d5b8592e531 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:03.545632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e5e14-8b34-4c76-b83f-859579e39fa6 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:03.546083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e5e14-8b34-4c76-b83f-859579e39fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:03.546646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e5e14-8b34-4c76-b83f-859579e39fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:03.596360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-2e8e5e14-8b34-4c76-b83f-859579e39fa6 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:03.598840 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2e8e5e14-8b34-4c76-b83f-859579e39fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:03.776799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 841/1655] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:03.784075 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf67b9-6382-4c94-bd3c-3f60df2bf843 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:03.784439 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf67b9-6382-4c94-bd3c-3f60df2bf843 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:03.784753 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf67b9-6382-4c94-bd3c-3f60df2bf843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:03.828600 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c4bf67b9-6382-4c94-bd3c-3f60df2bf843 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:03.830388 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c4bf67b9-6382-4c94-bd3c-3f60df2bf843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:03.854943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 815/1656] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:03.856839 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e5e14-8b34-4c76-b83f-859579e39fa6 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:03.872012 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e5e14-8b34-4c76-b83f-859579e39fa6 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:03.885135 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8681e-980d-4bd9-bb2d-b566c3369a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:03.885833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8681e-980d-4bd9-bb2d-b566c3369a61 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:03.886151 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8681e-980d-4bd9-bb2d-b566c3369a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:03.886431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8681e-980d-4bd9-bb2d-b566c3369a61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:03.887212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8681e-980d-4bd9-bb2d-b566c3369a61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:01:03.887560 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8681e-980d-4bd9-bb2d-b566c3369a61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:03.889323 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8681e-980d-4bd9-bb2d-b566c3369a61 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:03.934768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf67b9-6382-4c94-bd3c-3f60df2bf843 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:03.943876 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:03.956046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf67b9-6382-4c94-bd3c-3f60df2bf843 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:03.957585 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 842/1657] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:01:03.986059 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364bf22-132e-4215-84bd-ebd6af1e4671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:03.986974 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364bf22-132e-4215-84bd-ebd6af1e4671 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:03.987406 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364bf22-132e-4215-84bd-ebd6af1e4671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:03.988032 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364bf22-132e-4215-84bd-ebd6af1e4671 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:03.989180 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364bf22-132e-4215-84bd-ebd6af1e4671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:03.992030 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364bf22-132e-4215-84bd-ebd6af1e4671 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:04.134112 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8681e-980d-4bd9-bb2d-b566c3369a61 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:04.136426 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ebd8681e-980d-4bd9-bb2d-b566c3369a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:04.141437 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 816/1658] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:03 2022] POST /identity/v3/projects => generated 387 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:04.162977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364bf22-132e-4215-84bd-ebd6af1e4671 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:04.163931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8681e-980d-4bd9-bb2d-b566c3369a61 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:04.302544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364bf22-132e-4215-84bd-ebd6af1e4671 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:04.308665 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec19866-ec83-49dd-b35d-8c7f7202dfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:04.309356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec19866-ec83-49dd-b35d-8c7f7202dfc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:04.310143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec19866-ec83-49dd-b35d-8c7f7202dfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:04.310483 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec19866-ec83-49dd-b35d-8c7f7202dfc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:04.311330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec19866-ec83-49dd-b35d-8c7f7202dfc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:04.313820 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec19866-ec83-49dd-b35d-8c7f7202dfc0 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:04.314737 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51dc37-11dc-4a0c-bd2e-f7c03b29c843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:04.315625 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51dc37-11dc-4a0c-bd2e-f7c03b29c843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:04.315908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51dc37-11dc-4a0c-bd2e-f7c03b29c843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:04.316183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51dc37-11dc-4a0c-bd2e-f7c03b29c843 admin admin] PATH_INFO: `/v3/users/6fb634208b9b4c57b6d0d3c01b1e5906` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:04.317430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51dc37-11dc-4a0c-bd2e-f7c03b29c843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fb634208b9b4c57b6d0d3c01b1e5906)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:04.319681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51dc37-11dc-4a0c-bd2e-f7c03b29c843 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:04.536714 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 817/1659] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:04 2022] POST /identity/v3/users => generated 294 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:04.539081 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec19866-ec83-49dd-b35d-8c7f7202dfc0 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:04.546764 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6ec19866-ec83-49dd-b35d-8c7f7202dfc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:04.601151 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec19866-ec83-49dd-b35d-8c7f7202dfc0 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:04.636102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdba106-f824-4c44-a787-ce9f886c8b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:04.644552 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2b51dc37-11dc-4a0c-bd2e-f7c03b29c843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fb634208b9b4c57b6d0d3c01b1e5906'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:04.645179 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdba106-f824-4c44-a787-ce9f886c8b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:04.645651 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdba106-f824-4c44-a787-ce9f886c8b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:04.646746 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdba106-f824-4c44-a787-ce9f886c8b69 admin admin] PATH_INFO: `/v3/projects/42cf59e7b62540e28a1880aaeab0fcb2` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:04.659545 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2b51dc37-11dc-4a0c-bd2e-f7c03b29c843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fb634208b9b4c57b6d0d3c01b1e5906'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:04.660676 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdba106-f824-4c44-a787-ce9f886c8b69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42cf59e7b62540e28a1880aaeab0fcb2)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:04.662914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2b51dc37-11dc-4a0c-bd2e-f7c03b29c843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fb634208b9b4c57b6d0d3c01b1e5906'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:04.664392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdba106-f824-4c44-a787-ce9f886c8b69 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:04.670057 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2b51dc37-11dc-4a0c-bd2e-f7c03b29c843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fb634208b9b4c57b6d0d3c01b1e5906'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:04.690633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2b51dc37-11dc-4a0c-bd2e-f7c03b29c843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fb634208b9b4c57b6d0d3c01b1e5906'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:04.832600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 843/1660] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:04 2022] DELETE /identity/v3/users/6fb634208b9b4c57b6d0d3c01b1e5906 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:04.833769 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51dc37-11dc-4a0c-bd2e-f7c03b29c843 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:04.835302 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2b51dc37-11dc-4a0c-bd2e-f7c03b29c843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:04.863515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2bdba106-f824-4c44-a787-ce9f886c8b69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42cf59e7b62540e28a1880aaeab0fcb2', 'request_id': 'req-2bdba106-f824-4c44-a787-ce9f886c8b69'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:04.946194 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51dc37-11dc-4a0c-bd2e-f7c03b29c843 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:04.953731 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b3612-ffb9-452a-a1e1-13f4955a4a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:04.955096 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b3612-ffb9-452a-a1e1-13f4955a4a54 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:04.955522 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b3612-ffb9-452a-a1e1-13f4955a4a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:04.955980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b3612-ffb9-452a-a1e1-13f4955a4a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:04.957758 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b3612-ffb9-452a-a1e1-13f4955a4a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:04.960376 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b3612-ffb9-452a-a1e1-13f4955a4a54 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:04.980359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 844/1661] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:04.982245 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2d177-4a00-4067-be54-dfb439aea353 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:04.982749 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2d177-4a00-4067-be54-dfb439aea353 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:04.983175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2d177-4a00-4067-be54-dfb439aea353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:04.990422 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2bdba106-f824-4c44-a787-ce9f886c8b69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42cf59e7b62540e28a1880aaeab0fcb2', 'request_id': 'req-2bdba106-f824-4c44-a787-ce9f886c8b69'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:05.002540 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2bdba106-f824-4c44-a787-ce9f886c8b69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42cf59e7b62540e28a1880aaeab0fcb2', 'request_id': 'req-2bdba106-f824-4c44-a787-ce9f886c8b69'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:05.012985 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-72a2d177-4a00-4067-be54-dfb439aea353 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:05.014248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-72a2d177-4a00-4067-be54-dfb439aea353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:05.026907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:05.031217 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2bdba106-f824-4c44-a787-ce9f886c8b69 admin admin] The token cache is being invalidate because project 42cf59e7b62540e28a1880aaeab0fcb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:05.031523 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2bdba106-f824-4c44-a787-ce9f886c8b69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:05.033026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2bdba106-f824-4c44-a787-ce9f886c8b69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:05.036447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 818/1662] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:04 2022] DELETE /identity/v3/projects/42cf59e7b62540e28a1880aaeab0fcb2 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:05.041039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdba106-f824-4c44-a787-ce9f886c8b69 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:05.044626 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 845/1663] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:05.045691 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2bdba106-f824-4c44-a787-ce9f886c8b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:05.052946 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7a4e7-93cf-4803-bbb4-c3203dfef05d None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:05.053312 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7a4e7-93cf-4803-bbb4-c3203dfef05d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:05.053917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7a4e7-93cf-4803-bbb4-c3203dfef05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:05.101769 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-58a7a4e7-93cf-4803-bbb4-c3203dfef05d None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:05.105768 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-58a7a4e7-93cf-4803-bbb4-c3203dfef05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:05.126282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 846/1664] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:05.127510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7a4e7-93cf-4803-bbb4-c3203dfef05d None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:05.133995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-58a7a4e7-93cf-4803-bbb4-c3203dfef05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:05.233031 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdba106-f824-4c44-a787-ce9f886c8b69 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:05.254866 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c403a-e7de-4479-bc6d-c66a44bbf578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:05.254866 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c403a-e7de-4479-bc6d-c66a44bbf578 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:05.254866 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c403a-e7de-4479-bc6d-c66a44bbf578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:05.254866 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c403a-e7de-4479-bc6d-c66a44bbf578 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:05.255207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c403a-e7de-4479-bc6d-c66a44bbf578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:05.256231 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c403a-e7de-4479-bc6d-c66a44bbf578 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:05.291927 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 819/1665] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:05.293580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79014-5eac-4d19-bb7d-3b825318c714 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:05.293876 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79014-5eac-4d19-bb7d-3b825318c714 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:05.294158 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79014-5eac-4d19-bb7d-3b825318c714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:05.303720 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7a4e7-93cf-4803-bbb4-c3203dfef05d None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:05.316137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec132b2-cd34-40ce-8edf-2579d409c5c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:05.319414 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec132b2-cd34-40ce-8edf-2579d409c5c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:05.319708 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec132b2-cd34-40ce-8edf-2579d409c5c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:05.320022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec132b2-cd34-40ce-8edf-2579d409c5c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:05.326225 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8ec132b2-cd34-40ce-8edf-2579d409c5c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:05.348560 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-bcb79014-5eac-4d19-bb7d-3b825318c714 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:05.359088 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-bcb79014-5eac-4d19-bb7d-3b825318c714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:05.373579 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec132b2-cd34-40ce-8edf-2579d409c5c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:05.382196 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec132b2-cd34-40ce-8edf-2579d409c5c9 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:05.392425 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 820/1666] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:05.392991 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb79014-5eac-4d19-bb7d-3b825318c714 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:05.420439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 847/1667] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:05.429380 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec132b2-cd34-40ce-8edf-2579d409c5c9 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:05.437685 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb79014-5eac-4d19-bb7d-3b825318c714 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:05.455944 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfeda7-d2f7-46d9-a12d-4352b80c36d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:05.459311 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfeda7-d2f7-46d9-a12d-4352b80c36d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:05.459627 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfeda7-d2f7-46d9-a12d-4352b80c36d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:05.462937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfeda7-d2f7-46d9-a12d-4352b80c36d4 admin admin] PATH_INFO: `/v3/projects/c04b9d50c591406fbdb40127f11f40b0/users/4234dfcb37c148728fa750444f892407/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:05.468789 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec132b2-cd34-40ce-8edf-2579d409c5c9 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:05.492287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b083103-36f9-4414-90fd-2079650051aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:05.497511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b083103-36f9-4414-90fd-2079650051aa admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:05.497511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b083103-36f9-4414-90fd-2079650051aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:05.497511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b083103-36f9-4414-90fd-2079650051aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:05.497511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b083103-36f9-4414-90fd-2079650051aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:01:05.497511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b083103-36f9-4414-90fd-2079650051aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:05.497511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b083103-36f9-4414-90fd-2079650051aa admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:05.520318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dfeda7-d2f7-46d9-a12d-4352b80c36d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04b9d50c591406fbdb40127f11f40b0, user_id=4234dfcb37c148728fa750444f892407, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:05.529014 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dfeda7-d2f7-46d9-a12d-4352b80c36d4 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:05.548273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 848/1668] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:01:05.550611 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b083103-36f9-4414-90fd-2079650051aa admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:05.575179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b083103-36f9-4414-90fd-2079650051aa admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:05.594916 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236714d-20f6-42d5-aa2c-c0d722d48d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:05.595631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236714d-20f6-42d5-aa2c-c0d722d48d5d admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:05.595916 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236714d-20f6-42d5-aa2c-c0d722d48d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:05.596196 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236714d-20f6-42d5-aa2c-c0d722d48d5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:05.596941 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236714d-20f6-42d5-aa2c-c0d722d48d5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:05.598930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236714d-20f6-42d5-aa2c-c0d722d48d5d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:05.645029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 821/1669] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:05 2022] PUT /identity/v3/projects/c04b9d50c591406fbdb40127f11f40b0/users/4234dfcb37c148728fa750444f892407/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:05.649143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71668bab-84f3-4c11-bc51-ce2105469c7d None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:05.649443 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71668bab-84f3-4c11-bc51-ce2105469c7d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:05.650281 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71668bab-84f3-4c11-bc51-ce2105469c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:05.732696 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-71668bab-84f3-4c11-bc51-ce2105469c7d None None] MFA Rules not processed for user `4234dfcb37c148728fa750444f892407`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:05.736562 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-71668bab-84f3-4c11-bc51-ce2105469c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:05.881441 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 849/1670] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:05 2022] POST /identity/v3/projects => generated 361 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:05.886113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236714d-20f6-42d5-aa2c-c0d722d48d5d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:06.015671 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 822/1671] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:06.016576 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71668bab-84f3-4c11-bc51-ce2105469c7d None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:06.030565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:06.124993 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236714d-20f6-42d5-aa2c-c0d722d48d5d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:06.130672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad3e19-9182-4b0f-b850-031348181148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:06.131851 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad3e19-9182-4b0f-b850-031348181148 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:06.133810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad3e19-9182-4b0f-b850-031348181148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:06.133810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad3e19-9182-4b0f-b850-031348181148 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:06.133810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad3e19-9182-4b0f-b850-031348181148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:06.137011 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad3e19-9182-4b0f-b850-031348181148 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:06.159163 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71668bab-84f3-4c11-bc51-ce2105469c7d None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:06.163841 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66089b-b39d-41ba-8593-68a20b629779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:06.164521 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66089b-b39d-41ba-8593-68a20b629779 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:06.164879 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66089b-b39d-41ba-8593-68a20b629779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:06.165326 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66089b-b39d-41ba-8593-68a20b629779 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:06.166113 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66089b-b39d-41ba-8593-68a20b629779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:06.168054 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66089b-b39d-41ba-8593-68a20b629779 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:06.366747 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 850/1672] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:05 2022] POST /identity/v3/users => generated 281 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:06.369779 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad3e19-9182-4b0f-b850-031348181148 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:06.399545 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad3e19-9182-4b0f-b850-031348181148 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:06.412232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897324f9-547a-4b6e-8a70-3769d18d5a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:06.419812 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897324f9-547a-4b6e-8a70-3769d18d5a9e admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:06.419812 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897324f9-547a-4b6e-8a70-3769d18d5a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:06.419812 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897324f9-547a-4b6e-8a70-3769d18d5a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:06.419812 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897324f9-547a-4b6e-8a70-3769d18d5a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:06.419812 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897324f9-547a-4b6e-8a70-3769d18d5a9e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:06.441601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 851/1673] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:06.452948 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 823/1674] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:06 2022] POST /identity/v3/projects => generated 383 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:06.454042 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897324f9-547a-4b6e-8a70-3769d18d5a9e admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:06.455357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66089b-b39d-41ba-8593-68a20b629779 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:06.508506 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897324f9-547a-4b6e-8a70-3769d18d5a9e admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:06.624509 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c418e-65f2-44b2-8314-655c7d3013ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:06.625296 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c418e-65f2-44b2-8314-655c7d3013ee admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:06.625559 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c418e-65f2-44b2-8314-655c7d3013ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:06.625845 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c418e-65f2-44b2-8314-655c7d3013ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:06.626599 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c418e-65f2-44b2-8314-655c7d3013ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:06.628245 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c418e-65f2-44b2-8314-655c7d3013ee admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:06.647179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 852/1675] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:06.648160 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c418e-65f2-44b2-8314-655c7d3013ee admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:06.654575 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66089b-b39d-41ba-8593-68a20b629779 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:06.662528 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c418e-65f2-44b2-8314-655c7d3013ee admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:06.669284 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012fb28-fca4-4473-88cd-f2091adb7079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:06.670237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012fb28-fca4-4473-88cd-f2091adb7079 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:06.670539 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012fb28-fca4-4473-88cd-f2091adb7079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:06.670812 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012fb28-fca4-4473-88cd-f2091adb7079 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:06.671521 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012fb28-fca4-4473-88cd-f2091adb7079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:06.671744 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d99288-9844-4316-ac8c-019ddc27fd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:06.672692 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d99288-9844-4316-ac8c-019ddc27fd56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:06.672981 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d99288-9844-4316-ac8c-019ddc27fd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:06.673260 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d99288-9844-4316-ac8c-019ddc27fd56 admin admin] PATH_INFO: `/v3/projects/b9aef9e6c4124815b3da57465543d90f/users/36fee2f13ea64db5b0258aae3fdc5d2d/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:06.676030 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012fb28-fca4-4473-88cd-f2091adb7079 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:06.699548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d99288-9844-4316-ac8c-019ddc27fd56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9aef9e6c4124815b3da57465543d90f, user_id=36fee2f13ea64db5b0258aae3fdc5d2d, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:06.702445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d99288-9844-4316-ac8c-019ddc27fd56 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:06.797619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 824/1676] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:06 2022] POST /identity/v3/users => generated 292 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:06.809791 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012fb28-fca4-4473-88cd-f2091adb7079 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:06.825323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012fb28-fca4-4473-88cd-f2091adb7079 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:06.839776 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853288e-8396-4f4e-8d75-97de602d60ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:06.840538 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853288e-8396-4f4e-8d75-97de602d60ce admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:06.845644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853288e-8396-4f4e-8d75-97de602d60ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:06.845644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853288e-8396-4f4e-8d75-97de602d60ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:06.845644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853288e-8396-4f4e-8d75-97de602d60ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:06.845644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853288e-8396-4f4e-8d75-97de602d60ce admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:06.870254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 825/1677] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:06.875163 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853288e-8396-4f4e-8d75-97de602d60ce admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:06.885759 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 853/1678] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:06 2022] PUT /identity/v3/projects/b9aef9e6c4124815b3da57465543d90f/users/36fee2f13ea64db5b0258aae3fdc5d2d/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:06.888194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853288e-8396-4f4e-8d75-97de602d60ce admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:06.897462 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ffce8-b698-4914-ab0f-af1b10b3a97e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:06.897800 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ffce8-b698-4914-ab0f-af1b10b3a97e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:06.898083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ffce8-b698-4914-ab0f-af1b10b3a97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:06.996821 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-db0ffce8-b698-4914-ab0f-af1b10b3a97e None None] MFA Rules not processed for user `36fee2f13ea64db5b0258aae3fdc5d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:06.998649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-db0ffce8-b698-4914-ab0f-af1b10b3a97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:07.088093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16140d4d-f850-4796-a785-e41deab1cc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:07.089230 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16140d4d-f850-4796-a785-e41deab1cc81 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:07.089230 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16140d4d-f850-4796-a785-e41deab1cc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:07.089404 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16140d4d-f850-4796-a785-e41deab1cc81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:07.093163 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16140d4d-f850-4796-a785-e41deab1cc81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:07.101391 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16140d4d-f850-4796-a785-e41deab1cc81 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:07.132103 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 826/1679] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:07.135185 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16140d4d-f850-4796-a785-e41deab1cc81 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:07.161731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16140d4d-f850-4796-a785-e41deab1cc81 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:07.173209 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5c25b-7220-400a-97f9-e670218545be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:07.174176 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5c25b-7220-400a-97f9-e670218545be admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:07.174470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5c25b-7220-400a-97f9-e670218545be admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:07.174822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5c25b-7220-400a-97f9-e670218545be admin admin] PATH_INFO: `/v3/projects/2c1a788c2082450793df26c2afa5cffc/users/449b5ae3b2ee4982a4e8586bd1d7c568/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:07.178164 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 854/1680] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:07.180049 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ffce8-b698-4914-ab0f-af1b10b3a97e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:07.182292 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-db0ffce8-b698-4914-ab0f-af1b10b3a97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:07.216184 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5c25b-7220-400a-97f9-e670218545be admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c1a788c2082450793df26c2afa5cffc, user_id=449b5ae3b2ee4982a4e8586bd1d7c568, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:07.220522 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ffce8-b698-4914-ab0f-af1b10b3a97e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:07.223339 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5c25b-7220-400a-97f9-e670218545be admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:07.232740 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a1e29-fbcd-4b7d-8c5d-6f152d8d29a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:07.235233 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a1e29-fbcd-4b7d-8c5d-6f152d8d29a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:07.235667 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a1e29-fbcd-4b7d-8c5d-6f152d8d29a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:07.236095 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a1e29-fbcd-4b7d-8c5d-6f152d8d29a9 admin admin] PATH_INFO: `/v3/projects/6e6d3f1f098d4520b1eec489c92e2ebd` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:07.238742 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a1e29-fbcd-4b7d-8c5d-6f152d8d29a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e6d3f1f098d4520b1eec489c92e2ebd)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:07.242001 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a1e29-fbcd-4b7d-8c5d-6f152d8d29a9 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:07.324194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 827/1681] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:07 2022] PUT /identity/v3/projects/2c1a788c2082450793df26c2afa5cffc/users/449b5ae3b2ee4982a4e8586bd1d7c568/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:07.325140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5c25b-7220-400a-97f9-e670218545be admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:07.402793 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:07.508276 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-673a1e29-fbcd-4b7d-8c5d-6f152d8d29a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e6d3f1f098d4520b1eec489c92e2ebd', 'request_id': 'req-673a1e29-fbcd-4b7d-8c5d-6f152d8d29a9'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:07.530115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-673a1e29-fbcd-4b7d-8c5d-6f152d8d29a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e6d3f1f098d4520b1eec489c92e2ebd', 'request_id': 'req-673a1e29-fbcd-4b7d-8c5d-6f152d8d29a9'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:07.539954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-673a1e29-fbcd-4b7d-8c5d-6f152d8d29a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e6d3f1f098d4520b1eec489c92e2ebd', 'request_id': 'req-673a1e29-fbcd-4b7d-8c5d-6f152d8d29a9'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:07.542595 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5c25b-7220-400a-97f9-e670218545be admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:07.633540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-673a1e29-fbcd-4b7d-8c5d-6f152d8d29a9 admin admin] The token cache is being invalidate because project 6e6d3f1f098d4520b1eec489c92e2ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:07.634624 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-673a1e29-fbcd-4b7d-8c5d-6f152d8d29a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:07.634811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-673a1e29-fbcd-4b7d-8c5d-6f152d8d29a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:07.661363 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 855/1682] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:07 2022] DELETE /identity/v3/projects/6e6d3f1f098d4520b1eec489c92e2ebd => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:07.662909 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365b571-aa1c-41c4-915e-dc292e81279f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:07.663302 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365b571-aa1c-41c4-915e-dc292e81279f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:07.663660 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365b571-aa1c-41c4-915e-dc292e81279f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:07.709504 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-e365b571-aa1c-41c4-915e-dc292e81279f None None] MFA Rules not processed for user `449b5ae3b2ee4982a4e8586bd1d7c568`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:07.711257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e365b571-aa1c-41c4-915e-dc292e81279f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:07.740222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26f4af-e79f-4eb7-b974-6e6b7a7d72c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:07.741088 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26f4af-e79f-4eb7-b974-6e6b7a7d72c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:07.741207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26f4af-e79f-4eb7-b974-6e6b7a7d72c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:07.741378 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26f4af-e79f-4eb7-b974-6e6b7a7d72c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:07.742089 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26f4af-e79f-4eb7-b974-6e6b7a7d72c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:07.748887 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26f4af-e79f-4eb7-b974-6e6b7a7d72c3 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:07.838928 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 856/1683] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:07.840778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ba29b-f17f-45e1-ae12-8ea25c38e821 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:07.841081 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ba29b-f17f-45e1-ae12-8ea25c38e821 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:07.841368 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ba29b-f17f-45e1-ae12-8ea25c38e821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:07.872146 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-c94ba29b-f17f-45e1-ae12-8ea25c38e821 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:07.874212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c94ba29b-f17f-45e1-ae12-8ea25c38e821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:07.884805 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 857/1684] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:07.885675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ba29b-f17f-45e1-ae12-8ea25c38e821 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:07.887125 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c94ba29b-f17f-45e1-ae12-8ea25c38e821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:07.902511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 828/1685] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:07 2022] POST /identity/v3/projects => generated 363 bytes in 578 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:07.906281 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1eb11-fbfa-4be8-94f8-b9ae377cd946 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:07.906281 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1eb11-fbfa-4be8-94f8-b9ae377cd946 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:07.906281 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1eb11-fbfa-4be8-94f8-b9ae377cd946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:07.914986 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ba29b-f17f-45e1-ae12-8ea25c38e821 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:07.958654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d9c1eb11-fbfa-4be8-94f8-b9ae377cd946 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:07.966187 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d9c1eb11-fbfa-4be8-94f8-b9ae377cd946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:08.071749 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d2b33-187b-4410-a3ac-04de00c972c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:08.072460 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d2b33-187b-4410-a3ac-04de00c972c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:08.072781 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d2b33-187b-4410-a3ac-04de00c972c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:08.075064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d2b33-187b-4410-a3ac-04de00c972c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:08.075810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d2b33-187b-4410-a3ac-04de00c972c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:08.087631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d2b33-187b-4410-a3ac-04de00c972c4 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:08.214600 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 829/1686] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:08.214600 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1eb11-fbfa-4be8-94f8-b9ae377cd946 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:08.218506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d9c1eb11-fbfa-4be8-94f8-b9ae377cd946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:08.247311 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1eb11-fbfa-4be8-94f8-b9ae377cd946 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:08.259770 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 858/1687] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:07 2022] POST /identity/v3/projects => generated 387 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:08.263558 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a77eb-9e9a-4073-a194-588ab21d4fc7 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:08.263962 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a77eb-9e9a-4073-a194-588ab21d4fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:08.264260 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a77eb-9e9a-4073-a194-588ab21d4fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:08.265156 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb71f2c-f135-4773-8cd1-268d2589f427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:08.265864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb71f2c-f135-4773-8cd1-268d2589f427 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:08.266156 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb71f2c-f135-4773-8cd1-268d2589f427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:08.266439 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb71f2c-f135-4773-8cd1-268d2589f427 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:08.267153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb71f2c-f135-4773-8cd1-268d2589f427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:08.274516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb71f2c-f135-4773-8cd1-268d2589f427 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:08.336455 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-dd5a77eb-9e9a-4073-a194-588ab21d4fc7 None None] MFA Rules not processed for user `475bac060a98475d858e6181eec7ce11`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:08.337890 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-dd5a77eb-9e9a-4073-a194-588ab21d4fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:08.344824 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:08.408349 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 830/1688] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:08 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:08.409321 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb71f2c-f135-4773-8cd1-268d2589f427 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:08.442516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb71f2c-f135-4773-8cd1-268d2589f427 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:08.455818 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 859/1689] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:08.455818 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a77eb-9e9a-4073-a194-588ab21d4fc7 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:08.455818 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-dd5a77eb-9e9a-4073-a194-588ab21d4fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:08.573093 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a77eb-9e9a-4073-a194-588ab21d4fc7 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:08.578374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753b0b9-3491-40a8-9d44-944bcd91e30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:08.579736 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753b0b9-3491-40a8-9d44-944bcd91e30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:08.580331 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753b0b9-3491-40a8-9d44-944bcd91e30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:08.580798 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753b0b9-3491-40a8-9d44-944bcd91e30f admin admin] PATH_INFO: `/v3/users/1f36ee437cac4538b20aa06cabaacc59` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:08.582100 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753b0b9-3491-40a8-9d44-944bcd91e30f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f36ee437cac4538b20aa06cabaacc59)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:08.586512 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753b0b9-3491-40a8-9d44-944bcd91e30f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:08.625857 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b23138-50c8-4f5c-8352-fec45071e013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:08.626546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b23138-50c8-4f5c-8352-fec45071e013 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:08.626834 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b23138-50c8-4f5c-8352-fec45071e013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:08.627114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b23138-50c8-4f5c-8352-fec45071e013 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:08.627921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b23138-50c8-4f5c-8352-fec45071e013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:01:08.628232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b23138-50c8-4f5c-8352-fec45071e013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:08.629905 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b23138-50c8-4f5c-8352-fec45071e013 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:08.660223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 831/1690] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:01:08.661220 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b23138-50c8-4f5c-8352-fec45071e013 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:08.685606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b23138-50c8-4f5c-8352-fec45071e013 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:08.695739 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36e8ad-4d63-44b3-b043-f9d2e4aa846d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:08.697349 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36e8ad-4d63-44b3-b043-f9d2e4aa846d admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:08.699361 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36e8ad-4d63-44b3-b043-f9d2e4aa846d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:08.699361 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36e8ad-4d63-44b3-b043-f9d2e4aa846d admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:08.700026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36e8ad-4d63-44b3-b043-f9d2e4aa846d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:08.704079 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36e8ad-4d63-44b3-b043-f9d2e4aa846d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:08.804256 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:08.805060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3753b0b9-3491-40a8-9d44-944bcd91e30f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f36ee437cac4538b20aa06cabaacc59'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:08.821474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 832/1691] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:08 2022] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:08.821474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36e8ad-4d63-44b3-b043-f9d2e4aa846d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:08.821915 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3753b0b9-3491-40a8-9d44-944bcd91e30f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f36ee437cac4538b20aa06cabaacc59'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:08.821915 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3753b0b9-3491-40a8-9d44-944bcd91e30f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f36ee437cac4538b20aa06cabaacc59'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:08.821915 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3753b0b9-3491-40a8-9d44-944bcd91e30f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f36ee437cac4538b20aa06cabaacc59'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:08.839431 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36e8ad-4d63-44b3-b043-f9d2e4aa846d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:08.854529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3753b0b9-3491-40a8-9d44-944bcd91e30f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f36ee437cac4538b20aa06cabaacc59'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:08.861747 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff5872-ac49-4739-a2f1-ec6dba3438f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:08.861747 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff5872-ac49-4739-a2f1-ec6dba3438f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:08.861747 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff5872-ac49-4739-a2f1-ec6dba3438f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:08.861747 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff5872-ac49-4739-a2f1-ec6dba3438f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:08.862224 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff5872-ac49-4739-a2f1-ec6dba3438f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:08.863063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff5872-ac49-4739-a2f1-ec6dba3438f8 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:08.882893 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 833/1692] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:08.889894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff5872-ac49-4739-a2f1-ec6dba3438f8 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:08.900572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6aff5872-ac49-4739-a2f1-ec6dba3438f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:08.940502 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 860/1693] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:08 2022] DELETE /identity/v3/users/1f36ee437cac4538b20aa06cabaacc59 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:08.946096 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753b0b9-3491-40a8-9d44-944bcd91e30f admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:08.948634 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3753b0b9-3491-40a8-9d44-944bcd91e30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:09.016860 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff5872-ac49-4739-a2f1-ec6dba3438f8 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:09.122298 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895ccfb-feba-4f97-b60a-e4bf9a56b9fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:09.123289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895ccfb-feba-4f97-b60a-e4bf9a56b9fb service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:09.123759 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895ccfb-feba-4f97-b60a-e4bf9a56b9fb service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:09.124359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895ccfb-feba-4f97-b60a-e4bf9a56b9fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:09.126712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8895ccfb-feba-4f97-b60a-e4bf9a56b9fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:09.131474 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753b0b9-3491-40a8-9d44-944bcd91e30f admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:09.145031 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7746ead-2bb3-422d-a8aa-442c1d9485c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:09.145781 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7746ead-2bb3-422d-a8aa-442c1d9485c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:09.146079 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7746ead-2bb3-422d-a8aa-442c1d9485c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:09.146523 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7746ead-2bb3-422d-a8aa-442c1d9485c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:09.148107 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7746ead-2bb3-422d-a8aa-442c1d9485c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:09.156642 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7746ead-2bb3-422d-a8aa-442c1d9485c5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:09.224930 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895ccfb-feba-4f97-b60a-e4bf9a56b9fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:09.228799 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895ccfb-feba-4f97-b60a-e4bf9a56b9fb service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:09.240851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 834/1694] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:09.242017 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895ccfb-feba-4f97-b60a-e4bf9a56b9fb service nova] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:09.244015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8895ccfb-feba-4f97-b60a-e4bf9a56b9fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:09.312603 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 861/1695] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:08 2022] POST /identity/v3/projects => generated 367 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:09.312603 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7746ead-2bb3-422d-a8aa-442c1d9485c5 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:09.315284 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895ccfb-feba-4f97-b60a-e4bf9a56b9fb service nova] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:09.317500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d7746ead-2bb3-422d-a8aa-442c1d9485c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:09.339308 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:09.525366 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b210e-bf97-4de7-a510-83e83a453c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:09.526686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b210e-bf97-4de7-a510-83e83a453c23 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:09.526982 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b210e-bf97-4de7-a510-83e83a453c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:09.527264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b210e-bf97-4de7-a510-83e83a453c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:09.528017 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b210e-bf97-4de7-a510-83e83a453c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:09.530193 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b210e-bf97-4de7-a510-83e83a453c23 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:09.557633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7746ead-2bb3-422d-a8aa-442c1d9485c5 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:09.571245 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 835/1696] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:09.589558 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd3aa3-b1aa-49e2-a44c-f80c1e8d27af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:09.604485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90610a6e-326c-4aa7-87e5-4c8e6f5221e3 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:09.604992 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90610a6e-326c-4aa7-87e5-4c8e6f5221e3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:09.605287 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90610a6e-326c-4aa7-87e5-4c8e6f5221e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:09.607835 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd3aa3-b1aa-49e2-a44c-f80c1e8d27af admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:09.608068 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd3aa3-b1aa-49e2-a44c-f80c1e8d27af admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:09.608291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd3aa3-b1aa-49e2-a44c-f80c1e8d27af admin admin] PATH_INFO: `/v3/projects/5881c13675d24eb68656c2c3b1ca9c12/users/5903ac1b31c44eb8ae1f54a5babc39d4/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:09.666071 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd3aa3-b1aa-49e2-a44c-f80c1e8d27af admin admin] RBAC: Authorizing `identity:create_grant(project_id=5881c13675d24eb68656c2c3b1ca9c12, user_id=5903ac1b31c44eb8ae1f54a5babc39d4, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:09.668867 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd3aa3-b1aa-49e2-a44c-f80c1e8d27af admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:09.672437 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-90610a6e-326c-4aa7-87e5-4c8e6f5221e3 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:09.673775 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-90610a6e-326c-4aa7-87e5-4c8e6f5221e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:09.709373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 836/1697] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:09.709373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90610a6e-326c-4aa7-87e5-4c8e6f5221e3 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:09.753978 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90610a6e-326c-4aa7-87e5-4c8e6f5221e3 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:09.767703 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db85789-76ba-4dcd-b3fc-d55db3457cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:09.768417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db85789-76ba-4dcd-b3fc-d55db3457cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:09.768791 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db85789-76ba-4dcd-b3fc-d55db3457cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:09.769077 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db85789-76ba-4dcd-b3fc-d55db3457cc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:09.769843 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db85789-76ba-4dcd-b3fc-d55db3457cc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:09.772161 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db85789-76ba-4dcd-b3fc-d55db3457cc9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:09.839060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:09.858540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 862/1698] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:09 2022] PUT /identity/v3/projects/5881c13675d24eb68656c2c3b1ca9c12/users/5903ac1b31c44eb8ae1f54a5babc39d4/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:09.858540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd3aa3-b1aa-49e2-a44c-f80c1e8d27af admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:09.935953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 837/1699] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:09 2022] POST /identity/v3/users => generated 284 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:09.937504 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db85789-76ba-4dcd-b3fc-d55db3457cc9 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:09.940257 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9db85789-76ba-4dcd-b3fc-d55db3457cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:10.084764 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db85789-76ba-4dcd-b3fc-d55db3457cc9 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:10.103520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd3aa3-b1aa-49e2-a44c-f80c1e8d27af admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:10.128192 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da608a8a-4eeb-4215-902c-25a20a3ffb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:10.129150 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da608a8a-4eeb-4215-902c-25a20a3ffb92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:10.129437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da608a8a-4eeb-4215-902c-25a20a3ffb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:10.129718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da608a8a-4eeb-4215-902c-25a20a3ffb92 admin admin] PATH_INFO: `/v3/projects/031bef13983a42c59123dde52fbb3f0f/users/28eb5ffc480a40b0b46410fe7a4516a2/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:10.175245 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da608a8a-4eeb-4215-902c-25a20a3ffb92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=031bef13983a42c59123dde52fbb3f0f, user_id=28eb5ffc480a40b0b46410fe7a4516a2, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:10.178045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da608a8a-4eeb-4215-902c-25a20a3ffb92 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:10.181739 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4552c-5578-4889-8084-c3c08976b623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:10.183366 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4552c-5578-4889-8084-c3c08976b623 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:10.183671 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4552c-5578-4889-8084-c3c08976b623 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:10.183957 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4552c-5578-4889-8084-c3c08976b623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:10.209714 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4552c-5578-4889-8084-c3c08976b623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:10.211595 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4552c-5578-4889-8084-c3c08976b623 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:10.226723 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 838/1700] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:10.227583 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4552c-5578-4889-8084-c3c08976b623 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:10.238970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4552c-5578-4889-8084-c3c08976b623 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:10.250056 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a92db-4c7c-4bcf-ab43-cb0e937b0c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:10.250759 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a92db-4c7c-4bcf-ab43-cb0e937b0c45 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:10.251315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a92db-4c7c-4bcf-ab43-cb0e937b0c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:10.251611 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a92db-4c7c-4bcf-ab43-cb0e937b0c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:10.252741 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a92db-4c7c-4bcf-ab43-cb0e937b0c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:10.255441 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a92db-4c7c-4bcf-ab43-cb0e937b0c45 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:10.286936 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 839/1701] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:10.286936 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a92db-4c7c-4bcf-ab43-cb0e937b0c45 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:10.305658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a92db-4c7c-4bcf-ab43-cb0e937b0c45 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:10.314819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2ab79-0154-4a87-8ab3-cd772f906d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:10.315504 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2ab79-0154-4a87-8ab3-cd772f906d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:10.315792 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2ab79-0154-4a87-8ab3-cd772f906d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:10.316071 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2ab79-0154-4a87-8ab3-cd772f906d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:10.317067 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2ab79-0154-4a87-8ab3-cd772f906d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:10.318681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2ab79-0154-4a87-8ab3-cd772f906d99 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:10.328778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 863/1702] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:09 2022] PUT /identity/v3/projects/031bef13983a42c59123dde52fbb3f0f/users/28eb5ffc480a40b0b46410fe7a4516a2/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:10.329788 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ef7ac-6a06-497c-b8bf-8b7fe2e573cb None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:10.330081 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ef7ac-6a06-497c-b8bf-8b7fe2e573cb None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:10.332178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ef7ac-6a06-497c-b8bf-8b7fe2e573cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:10.333557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 840/1703] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:10.338710 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3fa96-45b2-4b69-aa79-1b1e828924c4 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:10.339064 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3fa96-45b2-4b69-aa79-1b1e828924c4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:10.339572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3fa96-45b2-4b69-aa79-1b1e828924c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:10.379635 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-3ee3fa96-45b2-4b69-aa79-1b1e828924c4 None None] MFA Rules not processed for user `aa97e27060b3429bbad061a256db19f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:10.381248 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3ee3fa96-45b2-4b69-aa79-1b1e828924c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:10.436686 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-7a0ef7ac-6a06-497c-b8bf-8b7fe2e573cb None None] MFA Rules not processed for user `ad3f91c024f8415cac4784fec0689757`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:10.438244 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7a0ef7ac-6a06-497c-b8bf-8b7fe2e573cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:10.569063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 841/1704] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:10.569063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3fa96-45b2-4b69-aa79-1b1e828924c4 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:10.572717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:10.630693 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 864/1705] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:10.634747 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ef7ac-6a06-497c-b8bf-8b7fe2e573cb None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:10.738461 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3fa96-45b2-4b69-aa79-1b1e828924c4 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:10.760054 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9b546-0225-4d4f-9ed7-f93cb93786a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:10.760054 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9b546-0225-4d4f-9ed7-f93cb93786a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:10.760054 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9b546-0225-4d4f-9ed7-f93cb93786a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:10.760054 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9b546-0225-4d4f-9ed7-f93cb93786a4 admin admin] PATH_INFO: `/v3/projects/5881c13675d24eb68656c2c3b1ca9c12/users/5903ac1b31c44eb8ae1f54a5babc39d4/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:10.763968 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9b546-0225-4d4f-9ed7-f93cb93786a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5881c13675d24eb68656c2c3b1ca9c12, user_id=5903ac1b31c44eb8ae1f54a5babc39d4, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:10.771830 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9b546-0225-4d4f-9ed7-f93cb93786a4 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:10.820074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 842/1706] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:10 2022] PUT /identity/v3/projects/5881c13675d24eb68656c2c3b1ca9c12/users/5903ac1b31c44eb8ae1f54a5babc39d4/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:10.820074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9b546-0225-4d4f-9ed7-f93cb93786a4 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:10.850938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ef7ac-6a06-497c-b8bf-8b7fe2e573cb None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:10.948132 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38d4ba-2875-4f63-bad6-050341206c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:10.949233 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38d4ba-2875-4f63-bad6-050341206c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:10.949727 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38d4ba-2875-4f63-bad6-050341206c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:10.950342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38d4ba-2875-4f63-bad6-050341206c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:10.952672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38d4ba-2875-4f63-bad6-050341206c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:10.954802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38d4ba-2875-4f63-bad6-050341206c60 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:10.973718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 865/1707] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:10.974947 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38d4ba-2875-4f63-bad6-050341206c60 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:10.978562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5d38d4ba-2875-4f63-bad6-050341206c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:10.983789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9b546-0225-4d4f-9ed7-f93cb93786a4 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:11.005986 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479377c-1a64-47ba-b94a-2368351176da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:11.007014 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479377c-1a64-47ba-b94a-2368351176da admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:11.007466 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479377c-1a64-47ba-b94a-2368351176da admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:11.008346 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479377c-1a64-47ba-b94a-2368351176da admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:11.009625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479377c-1a64-47ba-b94a-2368351176da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:11.012814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479377c-1a64-47ba-b94a-2368351176da admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:11.089069 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 843/1708] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:11.091884 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e174014-d4e3-48ef-8a76-68a745b94260 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:11.091884 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e174014-d4e3-48ef-8a76-68a745b94260 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:11.092331 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e174014-d4e3-48ef-8a76-68a745b94260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:11.167616 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-7e174014-d4e3-48ef-8a76-68a745b94260 None None] MFA Rules not processed for user `ad3f91c024f8415cac4784fec0689757`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:11.170835 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7e174014-d4e3-48ef-8a76-68a745b94260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:11.193376 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38d4ba-2875-4f63-bad6-050341206c60 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:11.210888 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8b7f7-9b42-4dab-aed4-8c8571591949 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:11.212562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8b7f7-9b42-4dab-aed4-8c8571591949 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:11.212885 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8b7f7-9b42-4dab-aed4-8c8571591949 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:11.213166 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8b7f7-9b42-4dab-aed4-8c8571591949 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:11.330007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 844/1709] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:11.330007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6e95d-f9b2-4341-9421-4628d8ad9061 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:11.330007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6e95d-f9b2-4341-9421-4628d8ad9061 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:11.330007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6e95d-f9b2-4341-9421-4628d8ad9061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:11.391273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8b7f7-9b42-4dab-aed4-8c8571591949 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:11.402174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8b7f7-9b42-4dab-aed4-8c8571591949 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:11.413340 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f8b6e95d-f9b2-4341-9421-4628d8ad9061 None None] MFA Rules not processed for user `5903ac1b31c44eb8ae1f54a5babc39d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:11.414600 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f8b6e95d-f9b2-4341-9421-4628d8ad9061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:11.420451 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 866/1710] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:11.421579 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8b7f7-9b42-4dab-aed4-8c8571591949 service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:11.472068 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8b7f7-9b42-4dab-aed4-8c8571591949 service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:11.493658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e102a-b791-44cb-861e-956777866697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:11.494580 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e102a-b791-44cb-861e-956777866697 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:11.494869 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e102a-b791-44cb-861e-956777866697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:11.495149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e102a-b791-44cb-861e-956777866697 admin admin] PATH_INFO: `/v3/projects/031bef13983a42c59123dde52fbb3f0f/users/28eb5ffc480a40b0b46410fe7a4516a2/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:11.502585 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e102a-b791-44cb-861e-956777866697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=031bef13983a42c59123dde52fbb3f0f, user_id=28eb5ffc480a40b0b46410fe7a4516a2, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:11.505783 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e102a-b791-44cb-861e-956777866697 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:11.574713 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 867/1711] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:11 2022] PUT /identity/v3/projects/031bef13983a42c59123dde52fbb3f0f/users/28eb5ffc480a40b0b46410fe7a4516a2/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:11.576012 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e102a-b791-44cb-861e-956777866697 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:11.685208 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 845/1712] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:11.686739 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6e95d-f9b2-4341-9421-4628d8ad9061 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:11.722391 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6e95d-f9b2-4341-9421-4628d8ad9061 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:11.761275 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e102a-b791-44cb-861e-956777866697 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:11.793508 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8af4b-0a5a-47bc-b6a5-8a26737e0548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:11.794576 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8af4b-0a5a-47bc-b6a5-8a26737e0548 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:11.794868 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8af4b-0a5a-47bc-b6a5-8a26737e0548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:11.795152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8af4b-0a5a-47bc-b6a5-8a26737e0548 admin admin] PATH_INFO: `/v3/projects/51409162e5d244b5837ccaa0f92a5763/users/39f8f8c04aa848b59e440e843806590f/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:11.839171 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8af4b-0a5a-47bc-b6a5-8a26737e0548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51409162e5d244b5837ccaa0f92a5763, user_id=39f8f8c04aa848b59e440e843806590f, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:11.842089 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8af4b-0a5a-47bc-b6a5-8a26737e0548 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:11.893996 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074a108-7911-430e-b2f2-214206d22a65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:11.894702 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074a108-7911-430e-b2f2-214206d22a65 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:11.894995 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074a108-7911-430e-b2f2-214206d22a65 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:11.895280 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074a108-7911-430e-b2f2-214206d22a65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:11.951312 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 868/1713] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:11 2022] PUT /identity/v3/projects/51409162e5d244b5837ccaa0f92a5763/users/39f8f8c04aa848b59e440e843806590f/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:11.952432 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8af4b-0a5a-47bc-b6a5-8a26737e0548 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:11.964084 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4db8af4b-0a5a-47bc-b6a5-8a26737e0548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:12.050314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074a108-7911-430e-b2f2-214206d22a65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:12.053576 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074a108-7911-430e-b2f2-214206d22a65 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:12.077744 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 846/1714] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:12.079327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f175b78-531a-4f95-9581-0c78cf8b67b8 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:12.079626 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f175b78-531a-4f95-9581-0c78cf8b67b8 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:12.083235 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f175b78-531a-4f95-9581-0c78cf8b67b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:12.164628 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-3f175b78-531a-4f95-9581-0c78cf8b67b8 None None] MFA Rules not processed for user `28eb5ffc480a40b0b46410fe7a4516a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:12.167333 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3f175b78-531a-4f95-9581-0c78cf8b67b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:12.195670 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8af4b-0a5a-47bc-b6a5-8a26737e0548 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:12.205188 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb285ac4-7c0c-4df8-9f87-bd110e306eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:12.206104 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb285ac4-7c0c-4df8-9f87-bd110e306eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:12.206390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb285ac4-7c0c-4df8-9f87-bd110e306eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:12.206669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb285ac4-7c0c-4df8-9f87-bd110e306eac admin admin] PATH_INFO: `/v3/projects/cb21718b212946f4ae9d68290e43b46e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:12.209213 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb285ac4-7c0c-4df8-9f87-bd110e306eac admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb21718b212946f4ae9d68290e43b46e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:12.211221 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb285ac4-7c0c-4df8-9f87-bd110e306eac admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:12.257288 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:12.339603 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 847/1715] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:12.340686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f175b78-531a-4f95-9581-0c78cf8b67b8 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:12.342072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3f175b78-531a-4f95-9581-0c78cf8b67b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:12.368080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:12.397217 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bb285ac4-7c0c-4df8-9f87-bd110e306eac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb21718b212946f4ae9d68290e43b46e', 'request_id': 'req-bb285ac4-7c0c-4df8-9f87-bd110e306eac'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:12.421325 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bb285ac4-7c0c-4df8-9f87-bd110e306eac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb21718b212946f4ae9d68290e43b46e', 'request_id': 'req-bb285ac4-7c0c-4df8-9f87-bd110e306eac'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:12.432871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bb285ac4-7c0c-4df8-9f87-bd110e306eac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb21718b212946f4ae9d68290e43b46e', 'request_id': 'req-bb285ac4-7c0c-4df8-9f87-bd110e306eac'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:12.562164 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bb285ac4-7c0c-4df8-9f87-bd110e306eac admin admin] The token cache is being invalidate because project cb21718b212946f4ae9d68290e43b46e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:12.562463 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bb285ac4-7c0c-4df8-9f87-bd110e306eac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:12.563442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bb285ac4-7c0c-4df8-9f87-bd110e306eac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:12.591067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 869/1716] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:11 2022] DELETE /identity/v3/projects/cb21718b212946f4ae9d68290e43b46e => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:12.592806 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559dcbb-87fd-497b-a936-d695dc21299f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:12.593221 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559dcbb-87fd-497b-a936-d695dc21299f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:12.593519 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559dcbb-87fd-497b-a936-d695dc21299f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:12.682623 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f175b78-531a-4f95-9581-0c78cf8b67b8 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:12.696902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-c559dcbb-87fd-497b-a936-d695dc21299f None None] MFA Rules not processed for user `39f8f8c04aa848b59e440e843806590f`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:12.703201 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c559dcbb-87fd-497b-a936-d695dc21299f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:12.830969 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8d4f7-da9e-4b0b-8f6f-f4a19ed91e4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:12.832556 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8d4f7-da9e-4b0b-8f6f-f4a19ed91e4d service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:12.833045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8d4f7-da9e-4b0b-8f6f-f4a19ed91e4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:12.833471 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8d4f7-da9e-4b0b-8f6f-f4a19ed91e4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:12.838997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b9c8d4f7-da9e-4b0b-8f6f-f4a19ed91e4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:12.876680 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 870/1717] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:12.878126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7009d6-f49c-4a35-a2ec-8e7ec02dc0d8 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:12.878422 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7009d6-f49c-4a35-a2ec-8e7ec02dc0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:12.878704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7009d6-f49c-4a35-a2ec-8e7ec02dc0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:12.929277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8d4f7-da9e-4b0b-8f6f-f4a19ed91e4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:12.929738 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8d4f7-da9e-4b0b-8f6f-f4a19ed91e4d service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:12.941501 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 848/1718] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:12 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:12.942594 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8d4f7-da9e-4b0b-8f6f-f4a19ed91e4d service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:12.944332 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b9c8d4f7-da9e-4b0b-8f6f-f4a19ed91e4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:12.949294 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-1f7009d6-f49c-4a35-a2ec-8e7ec02dc0d8 None None] MFA Rules not processed for user `ac264b6684ae4c3f9fc8903163693d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:12.954084 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1f7009d6-f49c-4a35-a2ec-8e7ec02dc0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:12.954450 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:12.960961 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8d4f7-da9e-4b0b-8f6f-f4a19ed91e4d service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:12.964874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0a21f-0e55-47c1-aded-bdf94754cabf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:12.965736 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0a21f-0e55-47c1-aded-bdf94754cabf service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:12.966319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0a21f-0e55-47c1-aded-bdf94754cabf service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:12.966609 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0a21f-0e55-47c1-aded-bdf94754cabf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:12.969102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b6a0a21f-0e55-47c1-aded-bdf94754cabf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:13.096418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0a21f-0e55-47c1-aded-bdf94754cabf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:13.100475 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0a21f-0e55-47c1-aded-bdf94754cabf service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:13.139013 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 849/1719] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:13.140753 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d5556-2b51-401f-9c88-6a77bc4d6566 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:13.142975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d5556-2b51-401f-9c88-6a77bc4d6566 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:13.143389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d5556-2b51-401f-9c88-6a77bc4d6566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:13.160405 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 871/1720] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:13.171814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7009d6-f49c-4a35-a2ec-8e7ec02dc0d8 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:13.175852 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1f7009d6-f49c-4a35-a2ec-8e7ec02dc0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:13.187295 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-a66d5556-2b51-401f-9c88-6a77bc4d6566 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:13.198715 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a66d5556-2b51-401f-9c88-6a77bc4d6566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:13.343371 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7009d6-f49c-4a35-a2ec-8e7ec02dc0d8 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:13.357840 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101b000-400f-41a4-a98d-df93bfd3aef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:13.358540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101b000-400f-41a4-a98d-df93bfd3aef4 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:13.364420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101b000-400f-41a4-a98d-df93bfd3aef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:13.364420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101b000-400f-41a4-a98d-df93bfd3aef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:13.364420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101b000-400f-41a4-a98d-df93bfd3aef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:13.364420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101b000-400f-41a4-a98d-df93bfd3aef4 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:13.408861 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 850/1721] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:13.410567 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacc2b3-495f-4bca-9325-3f21954b2b20 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:13.411197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacc2b3-495f-4bca-9325-3f21954b2b20 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:13.412107 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacc2b3-495f-4bca-9325-3f21954b2b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:13.432543 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ebacc2b3-495f-4bca-9325-3f21954b2b20 None None] MFA Rules not processed for user `ac264b6684ae4c3f9fc8903163693d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:13.433904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ebacc2b3-495f-4bca-9325-3f21954b2b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:13.442086 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 851/1722] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:13.443529 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d6546-2988-4e31-8ed9-0469dc027e8c None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:13.443852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d6546-2988-4e31-8ed9-0469dc027e8c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:13.444107 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d6546-2988-4e31-8ed9-0469dc027e8c None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:13.458973 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 852/1723] 10.222.0.36 () {54 vars in 912 bytes} [Tue Jul 5 13:01:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 13:01:13.458973 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d6546-2988-4e31-8ed9-0469dc027e8c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:13.458973 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c48d6546-2988-4e31-8ed9-0469dc027e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:13.475613 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d6546-2988-4e31-8ed9-0469dc027e8c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:13.481248 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a6d42-eb9d-48f3-abe7-c53dd7e19974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:13.482093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a6d42-eb9d-48f3-abe7-c53dd7e19974 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:13.482434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a6d42-eb9d-48f3-abe7-c53dd7e19974 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:13.482535 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a6d42-eb9d-48f3-abe7-c53dd7e19974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:13.486223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-796a6d42-eb9d-48f3-abe7-c53dd7e19974 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:13.572187 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 872/1724] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:13 2022] POST /identity/v3/projects => generated 367 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:13.573661 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7d688-c0fe-4bc6-9ddb-3e4549ec3a87 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:13.573952 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7d688-c0fe-4bc6-9ddb-3e4549ec3a87 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:13.576152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7d688-c0fe-4bc6-9ddb-3e4549ec3a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:13.586439 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a6d42-eb9d-48f3-abe7-c53dd7e19974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:13.589359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a6d42-eb9d-48f3-abe7-c53dd7e19974 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:13.608784 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 853/1725] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:13.611626 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b36775-33e2-4ae5-bb52-1054cdadc60c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:13.612202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b36775-33e2-4ae5-bb52-1054cdadc60c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:13.612745 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b36775-33e2-4ae5-bb52-1054cdadc60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:13.657010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-eae7d688-c0fe-4bc6-9ddb-3e4549ec3a87 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:13.663203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-eae7d688-c0fe-4bc6-9ddb-3e4549ec3a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:13.786963 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-55b36775-33e2-4ae5-bb52-1054cdadc60c None None] MFA Rules not processed for user `07ab8f60c4ff4969a277b33dca05e685`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:13.788208 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-55b36775-33e2-4ae5-bb52-1054cdadc60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:13.919599 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 854/1726] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jul 5 13:01:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:13.923836 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b36775-33e2-4ae5-bb52-1054cdadc60c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:13.925523 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-55b36775-33e2-4ae5-bb52-1054cdadc60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:13.927880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 873/1727] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:13.932672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7d688-c0fe-4bc6-9ddb-3e4549ec3a87 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:13.949845 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7d688-c0fe-4bc6-9ddb-3e4549ec3a87 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:13.972228 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a0eb1-5e68-42c4-ab2d-85237b8d6a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:13.972873 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a0eb1-5e68-42c4-ab2d-85237b8d6a5b admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:13.974053 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a0eb1-5e68-42c4-ab2d-85237b8d6a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:13.974469 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a0eb1-5e68-42c4-ab2d-85237b8d6a5b admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:13.975903 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a0eb1-5e68-42c4-ab2d-85237b8d6a5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:13.980782 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a0eb1-5e68-42c4-ab2d-85237b8d6a5b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:14.012409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:14.118980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b36775-33e2-4ae5-bb52-1054cdadc60c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:14.137517 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53e458-5468-46ca-b3b4-e6a580d7ec0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:14.138299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53e458-5468-46ca-b3b4-e6a580d7ec0d service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:14.138661 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53e458-5468-46ca-b3b4-e6a580d7ec0d service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:14.139013 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53e458-5468-46ca-b3b4-e6a580d7ec0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:14.167379 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 874/1728] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:13 2022] POST /identity/v3/users => generated 290 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:14.168237 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a0eb1-5e68-42c4-ab2d-85237b8d6a5b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:14.191036 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a0eb1-5e68-42c4-ab2d-85237b8d6a5b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:14.206700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd7e59-9e94-4dcb-8790-4b4c35eab38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:14.207393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd7e59-9e94-4dcb-8790-4b4c35eab38c admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:14.207679 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd7e59-9e94-4dcb-8790-4b4c35eab38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:14.207954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd7e59-9e94-4dcb-8790-4b4c35eab38c admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:14.208717 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd7e59-9e94-4dcb-8790-4b4c35eab38c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:01:14.209027 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd7e59-9e94-4dcb-8790-4b4c35eab38c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:14.210660 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd7e59-9e94-4dcb-8790-4b4c35eab38c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:14.239523 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53e458-5468-46ca-b3b4-e6a580d7ec0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:14.241547 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53e458-5468-46ca-b3b4-e6a580d7ec0d service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:14.256861 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 855/1729] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:14.258087 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53e458-5468-46ca-b3b4-e6a580d7ec0d service nova] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:14.259988 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3d53e458-5468-46ca-b3b4-e6a580d7ec0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:14.276228 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53e458-5468-46ca-b3b4-e6a580d7ec0d service nova] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:14.284304 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e040fe3-ef89-4e92-ad7a-c2bae930eff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:14.284779 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e040fe3-ef89-4e92-ad7a-c2bae930eff0 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:14.285190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e040fe3-ef89-4e92-ad7a-c2bae930eff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:14.285598 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e040fe3-ef89-4e92-ad7a-c2bae930eff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:14.293955 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 875/1730] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:01:14.294989 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd7e59-9e94-4dcb-8790-4b4c35eab38c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:14.308515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e040fe3-ef89-4e92-ad7a-c2bae930eff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:14.313473 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e040fe3-ef89-4e92-ad7a-c2bae930eff0 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:14.325659 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd7e59-9e94-4dcb-8790-4b4c35eab38c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:14.334949 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 856/1731] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:14.336046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e040fe3-ef89-4e92-ad7a-c2bae930eff0 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:14.356883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45094ea-c390-45f4-a725-f7da3f41f237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:14.357591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45094ea-c390-45f4-a725-f7da3f41f237 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:14.357885 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45094ea-c390-45f4-a725-f7da3f41f237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:14.358159 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45094ea-c390-45f4-a725-f7da3f41f237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:14.358911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45094ea-c390-45f4-a725-f7da3f41f237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:14.360557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45094ea-c390-45f4-a725-f7da3f41f237 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:14.373010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e040fe3-ef89-4e92-ad7a-c2bae930eff0 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:14.386529 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6e79e-0d82-4738-881b-68d6cffaffee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:14.387227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6e79e-0d82-4738-881b-68d6cffaffee admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:14.387514 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6e79e-0d82-4738-881b-68d6cffaffee admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:14.387790 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6e79e-0d82-4738-881b-68d6cffaffee admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:14.388706 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6e79e-0d82-4738-881b-68d6cffaffee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:14.394976 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6e79e-0d82-4738-881b-68d6cffaffee admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:14.414735 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 876/1732] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:14.417289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45094ea-c390-45f4-a725-f7da3f41f237 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:14.435551 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45094ea-c390-45f4-a725-f7da3f41f237 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:14.440775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493094a-ceb0-4f16-80e4-b8cd3bda4894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:14.441870 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493094a-ceb0-4f16-80e4-b8cd3bda4894 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:14.442164 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493094a-ceb0-4f16-80e4-b8cd3bda4894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:14.442596 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493094a-ceb0-4f16-80e4-b8cd3bda4894 admin admin] PATH_INFO: `/v3/projects/f87fc1c3d54342048455e14a1b5a8dcc/users/d42ac6a41f074cac9650090cf2a06534/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:14.473835 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493094a-ceb0-4f16-80e4-b8cd3bda4894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f87fc1c3d54342048455e14a1b5a8dcc, user_id=d42ac6a41f074cac9650090cf2a06534, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:14.477194 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493094a-ceb0-4f16-80e4-b8cd3bda4894 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:14.573999 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 857/1733] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:14 2022] POST /identity/v3/projects => generated 373 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:14.578390 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6e79e-0d82-4738-881b-68d6cffaffee admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:14.583364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 877/1734] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:14 2022] PUT /identity/v3/projects/f87fc1c3d54342048455e14a1b5a8dcc/users/d42ac6a41f074cac9650090cf2a06534/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:14.587167 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493094a-ceb0-4f16-80e4-b8cd3bda4894 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:14.749643 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6e79e-0d82-4738-881b-68d6cffaffee admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:14.765701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cfeeb-a7d2-477c-93b4-4e9d7a1e6e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:14.766512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cfeeb-a7d2-477c-93b4-4e9d7a1e6e97 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:14.766873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cfeeb-a7d2-477c-93b4-4e9d7a1e6e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:14.767221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cfeeb-a7d2-477c-93b4-4e9d7a1e6e97 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:14.767990 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438cfeeb-a7d2-477c-93b4-4e9d7a1e6e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:14.773178 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438cfeeb-a7d2-477c-93b4-4e9d7a1e6e97 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:14.792851 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493094a-ceb0-4f16-80e4-b8cd3bda4894 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:14.800274 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace1fcd-98a9-4cf7-b28e-a28b55481bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:14.801466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace1fcd-98a9-4cf7-b28e-a28b55481bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:14.801804 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace1fcd-98a9-4cf7-b28e-a28b55481bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:14.802090 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace1fcd-98a9-4cf7-b28e-a28b55481bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:14.803153 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace1fcd-98a9-4cf7-b28e-a28b55481bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:14.805082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace1fcd-98a9-4cf7-b28e-a28b55481bf5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:14.821835 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 878/1735] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:14.823253 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace1fcd-98a9-4cf7-b28e-a28b55481bf5 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:14.837128 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace1fcd-98a9-4cf7-b28e-a28b55481bf5 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:14.844762 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f30f3-40aa-45a1-8a1d-9c576b67bfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:14.846131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f30f3-40aa-45a1-8a1d-9c576b67bfca admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:14.846623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f30f3-40aa-45a1-8a1d-9c576b67bfca admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:14.847111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f30f3-40aa-45a1-8a1d-9c576b67bfca admin admin] PATH_INFO: `/v3/projects/f87fc1c3d54342048455e14a1b5a8dcc/users/d42ac6a41f074cac9650090cf2a06534/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:14.849644 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f30f3-40aa-45a1-8a1d-9c576b67bfca admin admin] RBAC: Authorizing `identity:create_grant(project_id=f87fc1c3d54342048455e14a1b5a8dcc, user_id=d42ac6a41f074cac9650090cf2a06534, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:14.853674 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f30f3-40aa-45a1-8a1d-9c576b67bfca admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:14.883260 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 879/1736] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:14 2022] PUT /identity/v3/projects/f87fc1c3d54342048455e14a1b5a8dcc/users/d42ac6a41f074cac9650090cf2a06534/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:14.884956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc00a6-44aa-41ee-b556-476276197aa6 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:14.885260 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc00a6-44aa-41ee-b556-476276197aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:14.885544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc00a6-44aa-41ee-b556-476276197aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:14.925182 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 858/1737] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:14 2022] POST /identity/v3/users => generated 287 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:01:14.926667 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cfeeb-a7d2-477c-93b4-4e9d7a1e6e97 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:14.930101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-4bcc00a6-44aa-41ee-b556-476276197aa6 None None] MFA Rules not processed for user `d42ac6a41f074cac9650090cf2a06534`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:14.932080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4bcc00a6-44aa-41ee-b556-476276197aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:14.945499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cfeeb-a7d2-477c-93b4-4e9d7a1e6e97 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:14.950704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:15.040230 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c0863-b2c3-441c-8930-e8324e3ffd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:15.044169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c0863-b2c3-441c-8930-e8324e3ffd7b admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:15.044460 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c0863-b2c3-441c-8930-e8324e3ffd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:15.045353 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c0863-b2c3-441c-8930-e8324e3ffd7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:15.046447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c0863-b2c3-441c-8930-e8324e3ffd7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:15.048117 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c0863-b2c3-441c-8930-e8324e3ffd7b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:15.097369 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 859/1738] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:01:15.105587 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c0863-b2c3-441c-8930-e8324e3ffd7b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:15.126065 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c0863-b2c3-441c-8930-e8324e3ffd7b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:15.150065 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d6e09-ac49-4ff3-afd8-2dc04baeaf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:15.150757 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d6e09-ac49-4ff3-afd8-2dc04baeaf3a admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:15.151039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d6e09-ac49-4ff3-afd8-2dc04baeaf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:15.151315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d6e09-ac49-4ff3-afd8-2dc04baeaf3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:15.152046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d6e09-ac49-4ff3-afd8-2dc04baeaf3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:15.153731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d6e09-ac49-4ff3-afd8-2dc04baeaf3a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:15.171150 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 880/1739] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:14 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:15.177199 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 860/1740] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:15.181809 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc00a6-44aa-41ee-b556-476276197aa6 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:15.183220 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d6e09-ac49-4ff3-afd8-2dc04baeaf3a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:15.212065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc00a6-44aa-41ee-b556-476276197aa6 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:15.235718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eed41b-a32d-4797-96ef-455bf23e584d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:15.236716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eed41b-a32d-4797-96ef-455bf23e584d admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:15.237001 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eed41b-a32d-4797-96ef-455bf23e584d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:15.237281 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eed41b-a32d-4797-96ef-455bf23e584d admin admin] PATH_INFO: `/v3/projects/025bb4f9813b49db9a79f3bfa90e1cd5/users/abf7967d1aab4e409248eb9d4fe68fe8/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:15.271331 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eed41b-a32d-4797-96ef-455bf23e584d admin admin] RBAC: Authorizing `identity:create_grant(project_id=025bb4f9813b49db9a79f3bfa90e1cd5, user_id=abf7967d1aab4e409248eb9d4fe68fe8, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:15.274573 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eed41b-a32d-4797-96ef-455bf23e584d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:15.277778 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d6e09-ac49-4ff3-afd8-2dc04baeaf3a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:15.282528 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f3fe4-909e-4508-a6ff-b03aef0fb78c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:15.283580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f3fe4-909e-4508-a6ff-b03aef0fb78c service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:15.283946 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f3fe4-909e-4508-a6ff-b03aef0fb78c service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:15.284460 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f3fe4-909e-4508-a6ff-b03aef0fb78c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:15.319200 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f3fe4-909e-4508-a6ff-b03aef0fb78c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:15.321907 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f3fe4-909e-4508-a6ff-b03aef0fb78c service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:15.353130 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 861/1741] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:15 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:15.360644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afbc36-b6b4-4afd-8e46-d4bd0ff72628 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:15.360644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afbc36-b6b4-4afd-8e46-d4bd0ff72628 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:15.360644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afbc36-b6b4-4afd-8e46-d4bd0ff72628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:15.378936 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-63afbc36-b6b4-4afd-8e46-d4bd0ff72628 None None] MFA Rules not processed for user `475bac060a98475d858e6181eec7ce11`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:15.380547 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-63afbc36-b6b4-4afd-8e46-d4bd0ff72628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:15.426187 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 881/1742] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:15 2022] PUT /identity/v3/projects/025bb4f9813b49db9a79f3bfa90e1cd5/users/abf7967d1aab4e409248eb9d4fe68fe8/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:15.427132 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eed41b-a32d-4797-96ef-455bf23e584d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:15.487213 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 862/1743] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:15.487213 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b46e3a-d4da-4970-ad8d-5585a852e5c5 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:15.487213 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b46e3a-d4da-4970-ad8d-5585a852e5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:15.487213 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b46e3a-d4da-4970-ad8d-5585a852e5c5 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:15.491432 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 863/1744] 10.222.0.36 () {54 vars in 912 bytes} [Tue Jul 5 13:01:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 13:01:15.492784 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910b546-f72e-445d-98c9-0d6ad57d55f4 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:15.493116 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910b546-f72e-445d-98c9-0d6ad57d55f4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:15.493401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910b546-f72e-445d-98c9-0d6ad57d55f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:15.528441 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eed41b-a32d-4797-96ef-455bf23e584d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:15.535092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf684ff2-f003-400d-8d8c-afbcb8148010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:15.537454 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c910b546-f72e-445d-98c9-0d6ad57d55f4 None None] MFA Rules not processed for user `abf7967d1aab4e409248eb9d4fe68fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:15.538252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf684ff2-f003-400d-8d8c-afbcb8148010 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:15.539347 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c910b546-f72e-445d-98c9-0d6ad57d55f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:15.540600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf684ff2-f003-400d-8d8c-afbcb8148010 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:15.541043 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf684ff2-f003-400d-8d8c-afbcb8148010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:15.544578 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-cf684ff2-f003-400d-8d8c-afbcb8148010 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:15.695637 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 864/1745] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:15.697983 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e6d85-ba1e-4a89-b976-af4a2bd872cd None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:15.707477 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e6d85-ba1e-4a89-b976-af4a2bd872cd None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:15.707477 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e6d85-ba1e-4a89-b976-af4a2bd872cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:15.708018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf684ff2-f003-400d-8d8c-afbcb8148010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:15.708018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf684ff2-f003-400d-8d8c-afbcb8148010 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:15.716089 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 882/1746] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:15.719215 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf684ff2-f003-400d-8d8c-afbcb8148010 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:15.725381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-7a7e6d85-ba1e-4a89-b976-af4a2bd872cd None None] MFA Rules not processed for user `07ab8f60c4ff4969a277b33dca05e685`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:15.726722 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7a7e6d85-ba1e-4a89-b976-af4a2bd872cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:15.730417 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf684ff2-f003-400d-8d8c-afbcb8148010 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:15.736292 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297a5d9-9be9-46f2-9a06-6f63473ccaaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:15.737366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297a5d9-9be9-46f2-9a06-6f63473ccaaa service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:15.737884 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297a5d9-9be9-46f2-9a06-6f63473ccaaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:15.738397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297a5d9-9be9-46f2-9a06-6f63473ccaaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:15.815564 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 865/1747] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jul 5 13:01:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:15.816982 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b6a20-e6cd-4d17-9507-f67ea510c279 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:15.817276 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b6a20-e6cd-4d17-9507-f67ea510c279 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:15.817807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b6a20-e6cd-4d17-9507-f67ea510c279 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:15.825898 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 866/1748] 10.222.0.36 () {54 vars in 960 bytes} [Tue Jul 5 13:01:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 13:01:15.825898 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b6a20-e6cd-4d17-9507-f67ea510c279 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:15.856002 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297a5d9-9be9-46f2-9a06-6f63473ccaaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:15.856002 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297a5d9-9be9-46f2-9a06-6f63473ccaaa service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:15.889743 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 883/1749] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:15.900211 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f2646-0d68-41f3-8fde-ed5fef189d33 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:15.901342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f2646-0d68-41f3-8fde-ed5fef189d33 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:15.901896 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f2646-0d68-41f3-8fde-ed5fef189d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:15.945086 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b6a20-e6cd-4d17-9507-f67ea510c279 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:15.946165 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-4b0f2646-0d68-41f3-8fde-ed5fef189d33 None None] MFA Rules not processed for user `43b85b5c7b1e4d73b29fb96f4fa6db71`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:15.949677 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4b0f2646-0d68-41f3-8fde-ed5fef189d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:15.953704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f2fdd-5760-4a10-875f-5e67453a89c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:15.956260 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f2fdd-5760-4a10-875f-5e67453a89c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:15.956720 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f2fdd-5760-4a10-875f-5e67453a89c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:15.957910 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f2fdd-5760-4a10-875f-5e67453a89c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:15.958751 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f2fdd-5760-4a10-875f-5e67453a89c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:15.969657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f2fdd-5760-4a10-875f-5e67453a89c9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:16.097947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 867/1750] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:15 2022] POST /identity/v3/projects => generated 369 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:16.097947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f2fdd-5760-4a10-875f-5e67453a89c9 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:16.165968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 884/1751] 10.222.0.36 () {58 vars in 1057 bytes} [Tue Jul 5 13:01:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:16.168805 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f2646-0d68-41f3-8fde-ed5fef189d33 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:16.195729 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f2646-0d68-41f3-8fde-ed5fef189d33 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:16.259350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f2fdd-5760-4a10-875f-5e67453a89c9 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:16.271575 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fce56-8518-4a54-94cc-4b5f78b5bb3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:16.279957 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fce56-8518-4a54-94cc-4b5f78b5bb3a service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:16.280546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fce56-8518-4a54-94cc-4b5f78b5bb3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:16.280999 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fce56-8518-4a54-94cc-4b5f78b5bb3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:16.298509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fce56-8518-4a54-94cc-4b5f78b5bb3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:16.301227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fce56-8518-4a54-94cc-4b5f78b5bb3a service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:16.313546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 868/1752] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:16.314809 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fce56-8518-4a54-94cc-4b5f78b5bb3a service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:16.390846 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:16.398197 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2361a-d3f0-4bcd-a0f6-6c545ae5be18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:16.400696 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2361a-d3f0-4bcd-a0f6-6c545ae5be18 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:16.401610 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2361a-d3f0-4bcd-a0f6-6c545ae5be18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:16.402177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2361a-d3f0-4bcd-a0f6-6c545ae5be18 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:16.403533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2361a-d3f0-4bcd-a0f6-6c545ae5be18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:16.406218 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2361a-d3f0-4bcd-a0f6-6c545ae5be18 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:16.458637 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:16.481453 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fce56-8518-4a54-94cc-4b5f78b5bb3a service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:16.492234 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568759b-2fc9-4ddf-ad58-72f8547453f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43b85b5c7b1e4d73b29fb96f4fa6db71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:16.493402 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568759b-2fc9-4ddf-ad58-72f8547453f8 service placement] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:16.493402 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568759b-2fc9-4ddf-ad58-72f8547453f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:16.493605 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568759b-2fc9-4ddf-ad58-72f8547453f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:16.501118 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c568759b-2fc9-4ddf-ad58-72f8547453f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:16.514184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 885/1753] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:16 2022] POST /identity/v3/users => generated 291 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:16.516446 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2361a-d3f0-4bcd-a0f6-6c545ae5be18 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:16.554658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2361a-d3f0-4bcd-a0f6-6c545ae5be18 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:16.572385 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568759b-2fc9-4ddf-ad58-72f8547453f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:16.573994 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d5409-2c97-41d7-8e68-052505278d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:16.575204 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d5409-2c97-41d7-8e68-052505278d44 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:16.575617 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d5409-2c97-41d7-8e68-052505278d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:16.576865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d5409-2c97-41d7-8e68-052505278d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:16.577950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d5409-2c97-41d7-8e68-052505278d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:16.578678 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568759b-2fc9-4ddf-ad58-72f8547453f8 service placement] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:16.580372 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d5409-2c97-41d7-8e68-052505278d44 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:16.603755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 886/1754] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:16.608340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d5409-2c97-41d7-8e68-052505278d44 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:16.631100 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d5409-2c97-41d7-8e68-052505278d44 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:16.635462 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 869/1755] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:16.645722 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86eff1-f777-4ec1-a006-dea20e8ab7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:16.646646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86eff1-f777-4ec1-a006-dea20e8ab7e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:16.646920 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86eff1-f777-4ec1-a006-dea20e8ab7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:16.647219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86eff1-f777-4ec1-a006-dea20e8ab7e9 admin admin] PATH_INFO: `/v3/projects/8021d04190df4d6a93cdb015d7fe6d2b/users/7f18671d92144800af0143883a1778d7/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:16.678472 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86eff1-f777-4ec1-a006-dea20e8ab7e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8021d04190df4d6a93cdb015d7fe6d2b, user_id=7f18671d92144800af0143883a1778d7, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:16.681979 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86eff1-f777-4ec1-a006-dea20e8ab7e9 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:16.790003 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 887/1756] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:16 2022] PUT /identity/v3/projects/8021d04190df4d6a93cdb015d7fe6d2b/users/7f18671d92144800af0143883a1778d7/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:16.794588 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568759b-2fc9-4ddf-ad58-72f8547453f8 service placement] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:16.817051 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568759b-2fc9-4ddf-ad58-72f8547453f8 service placement] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:17.001584 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83446257-e5f7-4636-bc22-19bd15d478e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:17.002634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83446257-e5f7-4636-bc22-19bd15d478e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:17.003767 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83446257-e5f7-4636-bc22-19bd15d478e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:17.004302 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83446257-e5f7-4636-bc22-19bd15d478e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:17.005119 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83446257-e5f7-4636-bc22-19bd15d478e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:17.006863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83446257-e5f7-4636-bc22-19bd15d478e1 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:17.035665 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 870/1757] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:17.037043 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86eff1-f777-4ec1-a006-dea20e8ab7e9 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:17.056137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86eff1-f777-4ec1-a006-dea20e8ab7e9 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:17.071564 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687f73e-dd84-4b33-8b6d-88cd5337ff8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:17.072401 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687f73e-dd84-4b33-8b6d-88cd5337ff8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:17.073899 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687f73e-dd84-4b33-8b6d-88cd5337ff8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:17.078583 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687f73e-dd84-4b33-8b6d-88cd5337ff8e admin admin] PATH_INFO: `/v3/projects/8021d04190df4d6a93cdb015d7fe6d2b/users/7f18671d92144800af0143883a1778d7/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:17.107806 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687f73e-dd84-4b33-8b6d-88cd5337ff8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8021d04190df4d6a93cdb015d7fe6d2b, user_id=7f18671d92144800af0143883a1778d7, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:17.107806 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687f73e-dd84-4b33-8b6d-88cd5337ff8e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:17.145696 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 888/1758] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:17 2022] PUT /identity/v3/projects/8021d04190df4d6a93cdb015d7fe6d2b/users/7f18671d92144800af0143883a1778d7/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:17.166011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d556f3a-5075-4e42-9590-79feb7bd75b0 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:17.166311 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d556f3a-5075-4e42-9590-79feb7bd75b0 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:17.166662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d556f3a-5075-4e42-9590-79feb7bd75b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:17.233685 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-1d556f3a-5075-4e42-9590-79feb7bd75b0 None None] MFA Rules not processed for user `7f18671d92144800af0143883a1778d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:17.235020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1d556f3a-5075-4e42-9590-79feb7bd75b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:17.281701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:17.375637 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 871/1759] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:17 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:17.394912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687f73e-dd84-4b33-8b6d-88cd5337ff8e admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:17.481788 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687f73e-dd84-4b33-8b6d-88cd5337ff8e admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:17.491422 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec5551-98df-401c-945e-c5e486911462 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:17.492110 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec5551-98df-401c-945e-c5e486911462 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:17.492384 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec5551-98df-401c-945e-c5e486911462 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:17.492710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec5551-98df-401c-945e-c5e486911462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:17.507116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec5551-98df-401c-945e-c5e486911462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:17.508768 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec5551-98df-401c-945e-c5e486911462 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:17.534963 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 889/1760] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:17 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:18.264619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:18.350504 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7c68c-1996-4471-8611-5a5e6221cbb0 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:18.350828 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7c68c-1996-4471-8611-5a5e6221cbb0 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:18.351143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7c68c-1996-4471-8611-5a5e6221cbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:18.438335 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:18.443440 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-1cb7c68c-1996-4471-8611-5a5e6221cbb0 None None] MFA Rules not processed for user `aa97e27060b3429bbad061a256db19f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:18.449920 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1cb7c68c-1996-4471-8611-5a5e6221cbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:18.474634 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95131c29-ea2c-424a-b1c4-f76f906ef21b None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:18.474958 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95131c29-ea2c-424a-b1c4-f76f906ef21b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:18.475613 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95131c29-ea2c-424a-b1c4-f76f906ef21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:18.591042 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-95131c29-ea2c-424a-b1c4-f76f906ef21b None None] MFA Rules not processed for user `ad3f91c024f8415cac4784fec0689757`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:18.595697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-95131c29-ea2c-424a-b1c4-f76f906ef21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:18.713111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 872/1761] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:18.910374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 890/1762] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:01:19.310314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:19.762908 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7c68c-1996-4471-8611-5a5e6221cbb0 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:19.926804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7c68c-1996-4471-8611-5a5e6221cbb0 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:19.944977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2fa2f-a258-4cf8-822d-e5732be72753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:19.945600 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2fa2f-a258-4cf8-822d-e5732be72753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:19.946420 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2fa2f-a258-4cf8-822d-e5732be72753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:19.947499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2fa2f-a258-4cf8-822d-e5732be72753 admin admin] PATH_INFO: `/v3/users/abf7967d1aab4e409248eb9d4fe68fe8` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:19.949015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2fa2f-a258-4cf8-822d-e5732be72753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abf7967d1aab4e409248eb9d4fe68fe8)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:19.951283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2fa2f-a258-4cf8-822d-e5732be72753 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:20.307983 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-65e2fa2f-a258-4cf8-822d-e5732be72753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abf7967d1aab4e409248eb9d4fe68fe8'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:20.325875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-65e2fa2f-a258-4cf8-822d-e5732be72753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abf7967d1aab4e409248eb9d4fe68fe8'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:20.326830 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-65e2fa2f-a258-4cf8-822d-e5732be72753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abf7967d1aab4e409248eb9d4fe68fe8'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:20.327954 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-65e2fa2f-a258-4cf8-822d-e5732be72753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abf7967d1aab4e409248eb9d4fe68fe8'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:20.374361 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-65e2fa2f-a258-4cf8-822d-e5732be72753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abf7967d1aab4e409248eb9d4fe68fe8'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:20.517947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 873/1763] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:19 2022] DELETE /identity/v3/users/abf7967d1aab4e409248eb9d4fe68fe8 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:20.522362 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad447fa-3090-4d8c-bece-1b8d39a123f2 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:20.523825 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad447fa-3090-4d8c-bece-1b8d39a123f2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:20.524470 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad447fa-3090-4d8c-bece-1b8d39a123f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:20.565859 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-dad447fa-3090-4d8c-bece-1b8d39a123f2 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:20.573228 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-dad447fa-3090-4d8c-bece-1b8d39a123f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:20.637468 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 891/1764] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:20.662047 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2fa2f-a258-4cf8-822d-e5732be72753 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:20.662047 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-65e2fa2f-a258-4cf8-822d-e5732be72753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:20.825809 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2fa2f-a258-4cf8-822d-e5732be72753 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:20.843830 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c0ead-885c-488f-ab3a-7d979306f107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:20.850978 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c0ead-885c-488f-ab3a-7d979306f107 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:20.851428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c0ead-885c-488f-ab3a-7d979306f107 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:20.853060 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c0ead-885c-488f-ab3a-7d979306f107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:20.872166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c0ead-885c-488f-ab3a-7d979306f107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:20.874813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c0ead-885c-488f-ab3a-7d979306f107 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:20.915979 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 874/1765] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:21.264766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:21.566266 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad447fa-3090-4d8c-bece-1b8d39a123f2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:21.567761 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-dad447fa-3090-4d8c-bece-1b8d39a123f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:21.599776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad447fa-3090-4d8c-bece-1b8d39a123f2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:21.606605 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95552be-8195-4b6a-b216-8e9b54ec950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:21.607798 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95552be-8195-4b6a-b216-8e9b54ec950d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:21.608301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95552be-8195-4b6a-b216-8e9b54ec950d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:21.608670 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95552be-8195-4b6a-b216-8e9b54ec950d admin admin] PATH_INFO: `/v3/projects/025bb4f9813b49db9a79f3bfa90e1cd5` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:21.610267 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95552be-8195-4b6a-b216-8e9b54ec950d admin admin] RBAC: Authorizing `identity:delete_project(project_id=025bb4f9813b49db9a79f3bfa90e1cd5)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:21.612886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95552be-8195-4b6a-b216-8e9b54ec950d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:21.806728 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c95552be-8195-4b6a-b216-8e9b54ec950d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '025bb4f9813b49db9a79f3bfa90e1cd5', 'request_id': 'req-c95552be-8195-4b6a-b216-8e9b54ec950d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:21.816787 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c95552be-8195-4b6a-b216-8e9b54ec950d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '025bb4f9813b49db9a79f3bfa90e1cd5', 'request_id': 'req-c95552be-8195-4b6a-b216-8e9b54ec950d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:21.827168 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c95552be-8195-4b6a-b216-8e9b54ec950d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '025bb4f9813b49db9a79f3bfa90e1cd5', 'request_id': 'req-c95552be-8195-4b6a-b216-8e9b54ec950d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:21.937817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c95552be-8195-4b6a-b216-8e9b54ec950d admin admin] The token cache is being invalidate because project 025bb4f9813b49db9a79f3bfa90e1cd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:21.941493 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c95552be-8195-4b6a-b216-8e9b54ec950d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:21.941493 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c95552be-8195-4b6a-b216-8e9b54ec950d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:21.941493 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 892/1766] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:21 2022] DELETE /identity/v3/projects/025bb4f9813b49db9a79f3bfa90e1cd5 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:21.944522 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c0ead-885c-488f-ab3a-7d979306f107 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:21.956820 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c0ead-885c-488f-ab3a-7d979306f107 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:22.024901 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b5ef6-0798-42ea-866f-8c6b1f5e5861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:22.025816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b5ef6-0798-42ea-866f-8c6b1f5e5861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:22.026101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b5ef6-0798-42ea-866f-8c6b1f5e5861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:22.026380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b5ef6-0798-42ea-866f-8c6b1f5e5861 admin admin] PATH_INFO: `/v3/users/7f18671d92144800af0143883a1778d7` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:22.027602 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b5ef6-0798-42ea-866f-8c6b1f5e5861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f18671d92144800af0143883a1778d7)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:22.029987 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b5ef6-0798-42ea-866f-8c6b1f5e5861 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:22.249386 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:22.263166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-193b5ef6-0798-42ea-866f-8c6b1f5e5861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f18671d92144800af0143883a1778d7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:22.275151 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-193b5ef6-0798-42ea-866f-8c6b1f5e5861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f18671d92144800af0143883a1778d7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:22.280574 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-193b5ef6-0798-42ea-866f-8c6b1f5e5861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f18671d92144800af0143883a1778d7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:22.280574 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-193b5ef6-0798-42ea-866f-8c6b1f5e5861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f18671d92144800af0143883a1778d7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:22.288432 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-193b5ef6-0798-42ea-866f-8c6b1f5e5861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f18671d92144800af0143883a1778d7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:22.373057 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 875/1767] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:21 2022] DELETE /identity/v3/users/7f18671d92144800af0143883a1778d7 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:22.842528 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95552be-8195-4b6a-b216-8e9b54ec950d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:22.844039 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c95552be-8195-4b6a-b216-8e9b54ec950d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:22.860117 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95552be-8195-4b6a-b216-8e9b54ec950d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:22.935051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56888f00-927e-46bd-ac0f-b6b4b03bf376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:22.935986 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56888f00-927e-46bd-ac0f-b6b4b03bf376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:22.936333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56888f00-927e-46bd-ac0f-b6b4b03bf376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:22.936708 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56888f00-927e-46bd-ac0f-b6b4b03bf376 admin admin] PATH_INFO: `/v3/projects/8021d04190df4d6a93cdb015d7fe6d2b` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:22.937977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56888f00-927e-46bd-ac0f-b6b4b03bf376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8021d04190df4d6a93cdb015d7fe6d2b)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:22.939968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56888f00-927e-46bd-ac0f-b6b4b03bf376 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:23.210725 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-56888f00-927e-46bd-ac0f-b6b4b03bf376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8021d04190df4d6a93cdb015d7fe6d2b', 'request_id': 'req-56888f00-927e-46bd-ac0f-b6b4b03bf376'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:23.223337 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-56888f00-927e-46bd-ac0f-b6b4b03bf376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8021d04190df4d6a93cdb015d7fe6d2b', 'request_id': 'req-56888f00-927e-46bd-ac0f-b6b4b03bf376'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:23.231400 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-56888f00-927e-46bd-ac0f-b6b4b03bf376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8021d04190df4d6a93cdb015d7fe6d2b', 'request_id': 'req-56888f00-927e-46bd-ac0f-b6b4b03bf376'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:23.315718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-56888f00-927e-46bd-ac0f-b6b4b03bf376 admin admin] The token cache is being invalidate because project 8021d04190df4d6a93cdb015d7fe6d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:23.316016 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-56888f00-927e-46bd-ac0f-b6b4b03bf376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:23.316685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-56888f00-927e-46bd-ac0f-b6b4b03bf376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:23.318406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 893/1768] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:22 2022] DELETE /identity/v3/projects/8021d04190df4d6a93cdb015d7fe6d2b => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:23.323321 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622aaec4-225b-4926-b99d-b25ed7c84d4c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:23.323825 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622aaec4-225b-4926-b99d-b25ed7c84d4c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:23.323949 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622aaec4-225b-4926-b99d-b25ed7c84d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:23.342243 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-622aaec4-225b-4926-b99d-b25ed7c84d4c None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:23.343478 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-622aaec4-225b-4926-b99d-b25ed7c84d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:23.404640 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 876/1769] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:01:23.412425 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ed66d-e0a6-4d73-a78b-06217d5c02c5 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:23.412852 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ed66d-e0a6-4d73-a78b-06217d5c02c5 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:23.413213 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ed66d-e0a6-4d73-a78b-06217d5c02c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:23.437317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-966ed66d-e0a6-4d73-a78b-06217d5c02c5 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:23.438579 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-966ed66d-e0a6-4d73-a78b-06217d5c02c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:23.447407 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 894/1770] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:23.451799 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622aaec4-225b-4926-b99d-b25ed7c84d4c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:23.462518 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622aaec4-225b-4926-b99d-b25ed7c84d4c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:23.467464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a1472-0448-44a4-ab47-7e96c47fbd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:23.468138 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a1472-0448-44a4-ab47-7e96c47fbd45 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:23.468421 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a1472-0448-44a4-ab47-7e96c47fbd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:23.468862 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a1472-0448-44a4-ab47-7e96c47fbd45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:23.469598 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a1472-0448-44a4-ab47-7e96c47fbd45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:01:23.469907 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a1472-0448-44a4-ab47-7e96c47fbd45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:23.471740 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a1472-0448-44a4-ab47-7e96c47fbd45 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:23.488147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 877/1771] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:01:23.492302 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ed66d-e0a6-4d73-a78b-06217d5c02c5 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:23.501973 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ed66d-e0a6-4d73-a78b-06217d5c02c5 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:23.506621 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5e101-f621-41c9-8747-9e582dba9063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:23.507287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5e101-f621-41c9-8747-9e582dba9063 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:23.507613 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5e101-f621-41c9-8747-9e582dba9063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:23.511715 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5e101-f621-41c9-8747-9e582dba9063 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:23.511864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5e101-f621-41c9-8747-9e582dba9063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:23.513780 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5e101-f621-41c9-8747-9e582dba9063 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:23.609832 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a1472-0448-44a4-ab47-7e96c47fbd45 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:23.611629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ac0a1472-0448-44a4-ab47-7e96c47fbd45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:23.624873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a1472-0448-44a4-ab47-7e96c47fbd45 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:23.625943 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 895/1772] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:23 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:23.630284 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5e101-f621-41c9-8747-9e582dba9063 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:23.684002 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c59ec-f8df-404a-afab-73b04f830032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:23.685571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c59ec-f8df-404a-afab-73b04f830032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:23.685853 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c59ec-f8df-404a-afab-73b04f830032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:23.686131 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c59ec-f8df-404a-afab-73b04f830032 admin admin] PATH_INFO: `/v3/users/39f8f8c04aa848b59e440e843806590f` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:23.687584 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c59ec-f8df-404a-afab-73b04f830032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39f8f8c04aa848b59e440e843806590f)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:23.689614 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c59ec-f8df-404a-afab-73b04f830032 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:23.696812 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5e101-f621-41c9-8747-9e582dba9063 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:23.702026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75501cf0-611d-4a24-8934-b7cabe8a5f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:23.706932 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75501cf0-611d-4a24-8934-b7cabe8a5f84 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:23.706932 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75501cf0-611d-4a24-8934-b7cabe8a5f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:23.706932 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75501cf0-611d-4a24-8934-b7cabe8a5f84 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:23.706932 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75501cf0-611d-4a24-8934-b7cabe8a5f84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:23.706932 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75501cf0-611d-4a24-8934-b7cabe8a5f84 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:23.846515 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 896/1773] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:23 2022] POST /identity/v3/users => generated 283 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:23.850530 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75501cf0-611d-4a24-8934-b7cabe8a5f84 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:23.861398 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75501cf0-611d-4a24-8934-b7cabe8a5f84 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:23.866175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64868260-b179-432e-a65b-5927a40910fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:23.866901 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64868260-b179-432e-a65b-5927a40910fe admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:23.867173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64868260-b179-432e-a65b-5927a40910fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:23.867958 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64868260-b179-432e-a65b-5927a40910fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:23.868889 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64868260-b179-432e-a65b-5927a40910fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:23.874946 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64868260-b179-432e-a65b-5927a40910fe admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:23.881128 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 897/1774] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:01:23.885699 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64868260-b179-432e-a65b-5927a40910fe admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:23.895668 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64868260-b179-432e-a65b-5927a40910fe admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:23.900724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ec185-d5ed-4c6a-828b-08ca08c5d79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:23.901419 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ec185-d5ed-4c6a-828b-08ca08c5d79c admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:23.903491 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ec185-d5ed-4c6a-828b-08ca08c5d79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:23.903491 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ec185-d5ed-4c6a-828b-08ca08c5d79c admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:23.903491 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ec185-d5ed-4c6a-828b-08ca08c5d79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:23.904330 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ec185-d5ed-4c6a-828b-08ca08c5d79c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:23.919121 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 898/1775] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:01:23.920174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ec185-d5ed-4c6a-828b-08ca08c5d79c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:23.931166 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ec185-d5ed-4c6a-828b-08ca08c5d79c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:23.935982 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e372da9-8b08-4825-8542-df9c4ef87628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:23.936915 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e372da9-8b08-4825-8542-df9c4ef87628 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:23.937202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e372da9-8b08-4825-8542-df9c4ef87628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:23.937481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e372da9-8b08-4825-8542-df9c4ef87628 admin admin] PATH_INFO: `/v3/projects/bff303fbc0024988af01806f959632f0/users/194beea44fdf43c69cbd3ed092b4204a/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:23.953952 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e372da9-8b08-4825-8542-df9c4ef87628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bff303fbc0024988af01806f959632f0, user_id=194beea44fdf43c69cbd3ed092b4204a, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:23.956722 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e372da9-8b08-4825-8542-df9c4ef87628 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:23.982428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5d9c59ec-f8df-404a-afab-73b04f830032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39f8f8c04aa848b59e440e843806590f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:23.989558 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5d9c59ec-f8df-404a-afab-73b04f830032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39f8f8c04aa848b59e440e843806590f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:23.990206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5d9c59ec-f8df-404a-afab-73b04f830032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39f8f8c04aa848b59e440e843806590f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:23.991144 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5d9c59ec-f8df-404a-afab-73b04f830032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39f8f8c04aa848b59e440e843806590f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:24.004193 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5d9c59ec-f8df-404a-afab-73b04f830032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39f8f8c04aa848b59e440e843806590f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:24.043062 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 899/1776] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:23 2022] PUT /identity/v3/projects/bff303fbc0024988af01806f959632f0/users/194beea44fdf43c69cbd3ed092b4204a/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:01:24.056692 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a772d-46db-41ca-b475-79ab42d1b3b6 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:24.057317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a772d-46db-41ca-b475-79ab42d1b3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:24.057802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a772d-46db-41ca-b475-79ab42d1b3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:24.176564 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-099a772d-46db-41ca-b475-79ab42d1b3b6 None None] MFA Rules not processed for user `194beea44fdf43c69cbd3ed092b4204a`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:24.176564 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-099a772d-46db-41ca-b475-79ab42d1b3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:24.178397 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 878/1777] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:23 2022] DELETE /identity/v3/users/39f8f8c04aa848b59e440e843806590f => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:01:24.178397 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23e949-59c2-426b-aa59-e86d95177f47 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:24.178397 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23e949-59c2-426b-aa59-e86d95177f47 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:24.178397 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23e949-59c2-426b-aa59-e86d95177f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:24.178397 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-7a23e949-59c2-426b-aa59-e86d95177f47 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:24.178397 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7a23e949-59c2-426b-aa59-e86d95177f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:24.197267 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 900/1778] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:24.201543 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a772d-46db-41ca-b475-79ab42d1b3b6 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:24.202875 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-099a772d-46db-41ca-b475-79ab42d1b3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:24.248914 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 879/1779] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:24.260894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23e949-59c2-426b-aa59-e86d95177f47 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:24.263189 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7a23e949-59c2-426b-aa59-e86d95177f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:24.282515 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a772d-46db-41ca-b475-79ab42d1b3b6 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:24.287397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3a6dd-b8ac-47c5-a97e-9a9e8f0d859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:24.289980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3a6dd-b8ac-47c5-a97e-9a9e8f0d859a admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:24.289980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3a6dd-b8ac-47c5-a97e-9a9e8f0d859a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:24.289980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3a6dd-b8ac-47c5-a97e-9a9e8f0d859a admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:24.289980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3a6dd-b8ac-47c5-a97e-9a9e8f0d859a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:24.291410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3a6dd-b8ac-47c5-a97e-9a9e8f0d859a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:24.317341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:24.347398 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23e949-59c2-426b-aa59-e86d95177f47 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:24.353360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cce78-80d0-4a29-b9d5-3f3f92685d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:24.354374 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cce78-80d0-4a29-b9d5-3f3f92685d27 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:24.354845 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cce78-80d0-4a29-b9d5-3f3f92685d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:24.355378 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cce78-80d0-4a29-b9d5-3f3f92685d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:24.366557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cce78-80d0-4a29-b9d5-3f3f92685d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:24.368064 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cce78-80d0-4a29-b9d5-3f3f92685d27 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:24.378859 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 880/1780] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:24.468115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 901/1781] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:24 2022] POST /identity/v3/projects => generated 367 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:01:24.474713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cce78-80d0-4a29-b9d5-3f3f92685d27 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:24.491347 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cce78-80d0-4a29-b9d5-3f3f92685d27 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:24.561675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:24.583476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06c53b-89ff-4352-a13c-fdb7e8ef2924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:24.584154 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06c53b-89ff-4352-a13c-fdb7e8ef2924 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:24.584439 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06c53b-89ff-4352-a13c-fdb7e8ef2924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:24.584759 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06c53b-89ff-4352-a13c-fdb7e8ef2924 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:24.585457 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06c53b-89ff-4352-a13c-fdb7e8ef2924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:24.588048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06c53b-89ff-4352-a13c-fdb7e8ef2924 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:24.733904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 881/1782] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:24 2022] POST /identity/v3/users => generated 290 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:24.738492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3a6dd-b8ac-47c5-a97e-9a9e8f0d859a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:24.751426 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3a6dd-b8ac-47c5-a97e-9a9e8f0d859a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:24.758547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87fe81-61a3-4b1b-b8b3-22f449e1378d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:24.759288 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87fe81-61a3-4b1b-b8b3-22f449e1378d admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:24.760513 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87fe81-61a3-4b1b-b8b3-22f449e1378d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:24.760996 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87fe81-61a3-4b1b-b8b3-22f449e1378d admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:24.761900 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87fe81-61a3-4b1b-b8b3-22f449e1378d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:24.763719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87fe81-61a3-4b1b-b8b3-22f449e1378d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:24.785869 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 902/1783] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:24.787654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06c53b-89ff-4352-a13c-fdb7e8ef2924 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:24.797315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06c53b-89ff-4352-a13c-fdb7e8ef2924 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:24.801966 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12aa88d-3143-4bc2-9dcf-ace19c1a839e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:24.802852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aa88d-3143-4bc2-9dcf-ace19c1a839e admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:24.803150 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aa88d-3143-4bc2-9dcf-ace19c1a839e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:24.803428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aa88d-3143-4bc2-9dcf-ace19c1a839e admin admin] PATH_INFO: `/v3/projects/3eb0debb0e5146c284c99e5fa45efd80/users/08dcbc2c7c414d20b77d3690782f163b/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:24.825482 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12aa88d-3143-4bc2-9dcf-ace19c1a839e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb0debb0e5146c284c99e5fa45efd80, user_id=08dcbc2c7c414d20b77d3690782f163b, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:24.831050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12aa88d-3143-4bc2-9dcf-ace19c1a839e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:24.911963 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 882/1784] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:24 2022] PUT /identity/v3/projects/3eb0debb0e5146c284c99e5fa45efd80/users/08dcbc2c7c414d20b77d3690782f163b/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:24.916068 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87fe81-61a3-4b1b-b8b3-22f449e1378d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:24.928489 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87fe81-61a3-4b1b-b8b3-22f449e1378d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:24.950830 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12aa88d-3143-4bc2-9dcf-ace19c1a839e admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:24.952555 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a12aa88d-3143-4bc2-9dcf-ace19c1a839e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:25.036447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e05395-6745-405a-afd2-2b17a098e75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:25.037529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e05395-6745-405a-afd2-2b17a098e75e admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:25.037995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e05395-6745-405a-afd2-2b17a098e75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:25.038476 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e05395-6745-405a-afd2-2b17a098e75e admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:25.040863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e05395-6745-405a-afd2-2b17a098e75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:25.043187 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e05395-6745-405a-afd2-2b17a098e75e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:25.060256 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12aa88d-3143-4bc2-9dcf-ace19c1a839e admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:25.067792 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54febf-0ba5-4442-b831-c7e84f490eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:25.071917 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54febf-0ba5-4442-b831-c7e84f490eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:25.071917 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54febf-0ba5-4442-b831-c7e84f490eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:25.071917 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54febf-0ba5-4442-b831-c7e84f490eb5 admin admin] PATH_INFO: `/v3/projects/51409162e5d244b5837ccaa0f92a5763` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:25.071917 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54febf-0ba5-4442-b831-c7e84f490eb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51409162e5d244b5837ccaa0f92a5763)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:25.073050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54febf-0ba5-4442-b831-c7e84f490eb5 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:25.074574 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 903/1785] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:25.078792 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e05395-6745-405a-afd2-2b17a098e75e admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:25.103531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e05395-6745-405a-afd2-2b17a098e75e admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:25.111102 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13e25e-e156-4d7e-a142-ff7b2b184fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:25.112071 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13e25e-e156-4d7e-a142-ff7b2b184fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:25.112434 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13e25e-e156-4d7e-a142-ff7b2b184fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:25.113032 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13e25e-e156-4d7e-a142-ff7b2b184fe2 admin admin] PATH_INFO: `/v3/projects/3eb0debb0e5146c284c99e5fa45efd80/users/08dcbc2c7c414d20b77d3690782f163b/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:25.116290 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13e25e-e156-4d7e-a142-ff7b2b184fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb0debb0e5146c284c99e5fa45efd80, user_id=08dcbc2c7c414d20b77d3690782f163b, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:25.120318 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13e25e-e156-4d7e-a142-ff7b2b184fe2 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:25.150045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 904/1786] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:25 2022] PUT /identity/v3/projects/3eb0debb0e5146c284c99e5fa45efd80/users/08dcbc2c7c414d20b77d3690782f163b/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:25.162928 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8bc40-4127-4c95-a074-7a3fe8d25d98 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:25.163032 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8bc40-4127-4c95-a074-7a3fe8d25d98 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:25.163269 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8bc40-4127-4c95-a074-7a3fe8d25d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:25.213084 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4a54febf-0ba5-4442-b831-c7e84f490eb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51409162e5d244b5837ccaa0f92a5763', 'request_id': 'req-4a54febf-0ba5-4442-b831-c7e84f490eb5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:25.219041 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-7aa8bc40-4127-4c95-a074-7a3fe8d25d98 None None] MFA Rules not processed for user `08dcbc2c7c414d20b77d3690782f163b`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:25.222108 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7aa8bc40-4127-4c95-a074-7a3fe8d25d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:25.332446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4a54febf-0ba5-4442-b831-c7e84f490eb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51409162e5d244b5837ccaa0f92a5763', 'request_id': 'req-4a54febf-0ba5-4442-b831-c7e84f490eb5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:25.356377 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4a54febf-0ba5-4442-b831-c7e84f490eb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51409162e5d244b5837ccaa0f92a5763', 'request_id': 'req-4a54febf-0ba5-4442-b831-c7e84f490eb5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:25.381930 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4a54febf-0ba5-4442-b831-c7e84f490eb5 admin admin] The token cache is being invalidate because project 51409162e5d244b5837ccaa0f92a5763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:25.382544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4a54febf-0ba5-4442-b831-c7e84f490eb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:25.383547 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4a54febf-0ba5-4442-b831-c7e84f490eb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:25.386023 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 883/1787] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:24 2022] DELETE /identity/v3/projects/51409162e5d244b5837ccaa0f92a5763 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:01:25.390242 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54febf-0ba5-4442-b831-c7e84f490eb5 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:25.393693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4a54febf-0ba5-4442-b831-c7e84f490eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:25.513550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 905/1788] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:25 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:01:25.514985 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404a3f1-7d05-4824-b597-b3ef0b957bb0 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:25.517829 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404a3f1-7d05-4824-b597-b3ef0b957bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:25.517829 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404a3f1-7d05-4824-b597-b3ef0b957bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:25.540155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-1404a3f1-7d05-4824-b597-b3ef0b957bb0 None None] MFA Rules not processed for user `ab47c91ba7854bc09f656607dbb41cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:25.541717 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1404a3f1-7d05-4824-b597-b3ef0b957bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:25.681924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54febf-0ba5-4442-b831-c7e84f490eb5 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:25.691971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 906/1789] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jul 5 13:01:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:25.698819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6741a38-92e4-42b3-893a-171daa05441f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:25.700036 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404a3f1-7d05-4824-b597-b3ef0b957bb0 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:25.700224 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6741a38-92e4-42b3-893a-171daa05441f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:25.700224 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6741a38-92e4-42b3-893a-171daa05441f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:25.700224 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6741a38-92e4-42b3-893a-171daa05441f admin admin] PATH_INFO: `/v3/users/d42ac6a41f074cac9650090cf2a06534` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:25.700224 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6741a38-92e4-42b3-893a-171daa05441f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d42ac6a41f074cac9650090cf2a06534)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:25.700662 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1404a3f1-7d05-4824-b597-b3ef0b957bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:25.700750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6741a38-92e4-42b3-893a-171daa05441f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:25.780642 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404a3f1-7d05-4824-b597-b3ef0b957bb0 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:25.784938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d596f6-554e-47f9-8cfe-18e1254af4cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:25.787370 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d596f6-554e-47f9-8cfe-18e1254af4cb service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:25.787370 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d596f6-554e-47f9-8cfe-18e1254af4cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:25.787370 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d596f6-554e-47f9-8cfe-18e1254af4cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:25.799869 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d596f6-554e-47f9-8cfe-18e1254af4cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:25.801506 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d596f6-554e-47f9-8cfe-18e1254af4cb service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:25.827734 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 907/1790] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:25 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:25.829304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d596f6-554e-47f9-8cfe-18e1254af4cb service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:25.831297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-45d596f6-554e-47f9-8cfe-18e1254af4cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:25.901172 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d596f6-554e-47f9-8cfe-18e1254af4cb service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:25.917736 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eecc449-b932-4354-9102-828f546ecae1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:25.918426 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecc449-b932-4354-9102-828f546ecae1 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:25.920491 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecc449-b932-4354-9102-828f546ecae1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:25.920974 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecc449-b932-4354-9102-828f546ecae1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:25.924482 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0eecc449-b932-4354-9102-828f546ecae1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:26.027450 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b6741a38-92e4-42b3-893a-171daa05441f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd42ac6a41f074cac9650090cf2a06534'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:26.038448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b6741a38-92e4-42b3-893a-171daa05441f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd42ac6a41f074cac9650090cf2a06534'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:26.040184 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b6741a38-92e4-42b3-893a-171daa05441f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd42ac6a41f074cac9650090cf2a06534'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:26.041365 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b6741a38-92e4-42b3-893a-171daa05441f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd42ac6a41f074cac9650090cf2a06534'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:26.067449 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eecc449-b932-4354-9102-828f546ecae1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:26.069039 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eecc449-b932-4354-9102-828f546ecae1 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:26.079466 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b6741a38-92e4-42b3-893a-171daa05441f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd42ac6a41f074cac9650090cf2a06534'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:26.092701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 908/1791] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:26.167657 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eecc449-b932-4354-9102-828f546ecae1 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:26.169487 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0eecc449-b932-4354-9102-828f546ecae1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:26.187872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 884/1792] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:25 2022] DELETE /identity/v3/users/d42ac6a41f074cac9650090cf2a06534 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:26.278494 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eecc449-b932-4354-9102-828f546ecae1 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:26.401506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:26.556237 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce18ab-6a86-4982-a8ce-2b5c6738162f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fb7db02f8e945a7af39cb30c3d606f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:26.556974 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce18ab-6a86-4982-a8ce-2b5c6738162f service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:26.557262 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce18ab-6a86-4982-a8ce-2b5c6738162f service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:26.557550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce18ab-6a86-4982-a8ce-2b5c6738162f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:26.566837 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-95ce18ab-6a86-4982-a8ce-2b5c6738162f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:26.591856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:26.703093 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce18ab-6a86-4982-a8ce-2b5c6738162f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:26.704732 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce18ab-6a86-4982-a8ce-2b5c6738162f service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:26.738669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 909/1793] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jul 5 13:01:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 13:01:26.754842 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edef864-ffae-44ad-b43c-6d447ccf8557 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:26.755151 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edef864-ffae-44ad-b43c-6d447ccf8557 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:26.755691 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edef864-ffae-44ad-b43c-6d447ccf8557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:26.852301 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-4edef864-ffae-44ad-b43c-6d447ccf8557 None None] MFA Rules not processed for user `07ab8f60c4ff4969a277b33dca05e685`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:26.854064 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4edef864-ffae-44ad-b43c-6d447ccf8557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:27.057966 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 885/1794] 10.222.0.16 () {58 vars in 1015 bytes} [Tue Jul 5 13:01:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:27.607065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce18ab-6a86-4982-a8ce-2b5c6738162f service swift] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:27.607065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-95ce18ab-6a86-4982-a8ce-2b5c6738162f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:27.621518 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce18ab-6a86-4982-a8ce-2b5c6738162f service swift] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:27.651932 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:27.652903 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf14e4-ad12-4440-831e-bdbbf6cc2b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:27.652903 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf14e4-ad12-4440-831e-bdbbf6cc2b31 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:27.652903 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf14e4-ad12-4440-831e-bdbbf6cc2b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:27.652903 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf14e4-ad12-4440-831e-bdbbf6cc2b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:27.674203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf14e4-ad12-4440-831e-bdbbf6cc2b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:27.675703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf14e4-ad12-4440-831e-bdbbf6cc2b31 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:27.715144 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 910/1795] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:29.175906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:30.818030 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edef864-ffae-44ad-b43c-6d447ccf8557 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:30.820925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4edef864-ffae-44ad-b43c-6d447ccf8557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:30.982410 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edef864-ffae-44ad-b43c-6d447ccf8557 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:30.996091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45ff73-dffe-4281-abbf-bcfc24ded6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:30.997411 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45ff73-dffe-4281-abbf-bcfc24ded6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:30.998025 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45ff73-dffe-4281-abbf-bcfc24ded6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:30.998498 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45ff73-dffe-4281-abbf-bcfc24ded6ba admin admin] PATH_INFO: `/v3/projects/f87fc1c3d54342048455e14a1b5a8dcc` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:31.017450 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45ff73-dffe-4281-abbf-bcfc24ded6ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=f87fc1c3d54342048455e14a1b5a8dcc)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:31.028195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45ff73-dffe-4281-abbf-bcfc24ded6ba admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:31.280386 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-cf45ff73-dffe-4281-abbf-bcfc24ded6ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f87fc1c3d54342048455e14a1b5a8dcc', 'request_id': 'req-cf45ff73-dffe-4281-abbf-bcfc24ded6ba'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:31.290283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:31.395656 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-cf45ff73-dffe-4281-abbf-bcfc24ded6ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f87fc1c3d54342048455e14a1b5a8dcc', 'request_id': 'req-cf45ff73-dffe-4281-abbf-bcfc24ded6ba'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:31.417036 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-cf45ff73-dffe-4281-abbf-bcfc24ded6ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f87fc1c3d54342048455e14a1b5a8dcc', 'request_id': 'req-cf45ff73-dffe-4281-abbf-bcfc24ded6ba'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:31.437440 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-cf45ff73-dffe-4281-abbf-bcfc24ded6ba admin admin] The token cache is being invalidate because project f87fc1c3d54342048455e14a1b5a8dcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:31.446434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-cf45ff73-dffe-4281-abbf-bcfc24ded6ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:31.446434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-cf45ff73-dffe-4281-abbf-bcfc24ded6ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:31.446434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 886/1796] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:30 2022] DELETE /identity/v3/projects/f87fc1c3d54342048455e14a1b5a8dcc => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:31.463749 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec660ed6-9db2-483f-9a39-d063ae999352 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:31.465682 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec660ed6-9db2-483f-9a39-d063ae999352 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:31.466465 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec660ed6-9db2-483f-9a39-d063ae999352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:31.517933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-ec660ed6-9db2-483f-9a39-d063ae999352 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:31.521264 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ec660ed6-9db2-483f-9a39-d063ae999352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:31.599059 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681d33e-814d-4836-973d-a4267af75613 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:31.599354 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681d33e-814d-4836-973d-a4267af75613 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:31.599838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681d33e-814d-4836-973d-a4267af75613 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:31.603467 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 887/1797] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jul 5 13:01:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 13:01:31.716550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 911/1798] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:31.725493 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0c4fd-b0bb-4a25-9416-028fe96048fe None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:31.728888 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0c4fd-b0bb-4a25-9416-028fe96048fe None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:31.729320 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0c4fd-b0bb-4a25-9416-028fe96048fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:31.746220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:31.813895 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-09b0c4fd-b0bb-4a25-9416-028fe96048fe None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:31.815809 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-09b0c4fd-b0bb-4a25-9416-028fe96048fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:31.854283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 888/1799] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:31.855862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec660ed6-9db2-483f-9a39-d063ae999352 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:31.871345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec660ed6-9db2-483f-9a39-d063ae999352 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:31.883653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b90f94-0eb0-4e88-bc0a-e3be2b762212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:31.884766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b90f94-0eb0-4e88-bc0a-e3be2b762212 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:31.885301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b90f94-0eb0-4e88-bc0a-e3be2b762212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:31.885772 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b90f94-0eb0-4e88-bc0a-e3be2b762212 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:31.886826 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b90f94-0eb0-4e88-bc0a-e3be2b762212 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:01:31.887339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b90f94-0eb0-4e88-bc0a-e3be2b762212 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:31.892312 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b90f94-0eb0-4e88-bc0a-e3be2b762212 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:31.927051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 912/1800] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:01:31.933123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0c4fd-b0bb-4a25-9416-028fe96048fe None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:31.956331 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0c4fd-b0bb-4a25-9416-028fe96048fe None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:31.962623 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e511e-69c6-4c7b-8186-e39d0fc30015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:31.963521 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e511e-69c6-4c7b-8186-e39d0fc30015 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:31.964090 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e511e-69c6-4c7b-8186-e39d0fc30015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:31.964720 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e511e-69c6-4c7b-8186-e39d0fc30015 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:31.965756 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e511e-69c6-4c7b-8186-e39d0fc30015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:31.968398 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e511e-69c6-4c7b-8186-e39d0fc30015 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:32.103103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09130d9e-e039-47f4-b949-8505f8671893 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:32.103746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09130d9e-e039-47f4-b949-8505f8671893 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:32.104791 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09130d9e-e039-47f4-b949-8505f8671893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:32.126019 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 889/1801] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:31 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:32.133525 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e511e-69c6-4c7b-8186-e39d0fc30015 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:32.159975 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-09130d9e-e039-47f4-b949-8505f8671893 None None] MFA Rules not processed for user `cdf37a42279a466b85906b23751f9c22`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:32.161687 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-09130d9e-e039-47f4-b949-8505f8671893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:32.300390 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e511e-69c6-4c7b-8186-e39d0fc30015 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:32.307473 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99febb1-d371-445d-b6a5-e554286e4f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:32.308894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99febb1-d371-445d-b6a5-e554286e4f03 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:32.309345 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99febb1-d371-445d-b6a5-e554286e4f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:32.318455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99febb1-d371-445d-b6a5-e554286e4f03 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:32.318455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99febb1-d371-445d-b6a5-e554286e4f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:32.318455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99febb1-d371-445d-b6a5-e554286e4f03 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:32.424292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 890/1802] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:32 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:32.427420 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99febb1-d371-445d-b6a5-e554286e4f03 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:32.430086 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d99febb1-d371-445d-b6a5-e554286e4f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:32.464542 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99febb1-d371-445d-b6a5-e554286e4f03 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:32.467646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 913/1803] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jul 5 13:01:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:32.471288 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09130d9e-e039-47f4-b949-8505f8671893 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:32.486575 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb112dbb-c785-4ca2-8490-d1f3e1ad6d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:32.487769 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb112dbb-c785-4ca2-8490-d1f3e1ad6d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:32.488224 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb112dbb-c785-4ca2-8490-d1f3e1ad6d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:32.488680 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb112dbb-c785-4ca2-8490-d1f3e1ad6d20 admin admin] PATH_INFO: `/v3/users/36fee2f13ea64db5b0258aae3fdc5d2d` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:32.490567 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb112dbb-c785-4ca2-8490-d1f3e1ad6d20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36fee2f13ea64db5b0258aae3fdc5d2d)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:32.492186 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09130d9e-e039-47f4-b949-8505f8671893 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:32.498815 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb112dbb-c785-4ca2-8490-d1f3e1ad6d20 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:32.537627 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e73bd-1f5a-4a05-a2a3-de872df4c4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:32.539708 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e73bd-1f5a-4a05-a2a3-de872df4c4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:32.544021 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e73bd-1f5a-4a05-a2a3-de872df4c4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:32.544490 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e73bd-1f5a-4a05-a2a3-de872df4c4e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:32.545512 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e73bd-1f5a-4a05-a2a3-de872df4c4e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:32.548361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e73bd-1f5a-4a05-a2a3-de872df4c4e5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:32.580427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 914/1804] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:32.585495 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e73bd-1f5a-4a05-a2a3-de872df4c4e5 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:32.625886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e73bd-1f5a-4a05-a2a3-de872df4c4e5 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:32.641411 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e84d3c-c309-48af-b085-030d7ad89dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:32.642823 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e84d3c-c309-48af-b085-030d7ad89dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:32.644032 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e84d3c-c309-48af-b085-030d7ad89dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:32.644720 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e84d3c-c309-48af-b085-030d7ad89dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:32.646808 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e84d3c-c309-48af-b085-030d7ad89dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:32.649658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e84d3c-c309-48af-b085-030d7ad89dc8 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:32.666004 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 915/1805] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:32.669953 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e84d3c-c309-48af-b085-030d7ad89dc8 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:32.682927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e84d3c-c309-48af-b085-030d7ad89dc8 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:32.704291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111df99a-aa79-4b95-b70d-892162fc6a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:32.706315 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111df99a-aa79-4b95-b70d-892162fc6a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:32.706833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111df99a-aa79-4b95-b70d-892162fc6a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:32.707564 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111df99a-aa79-4b95-b70d-892162fc6a33 admin admin] PATH_INFO: `/v3/projects/95fc811ea1d242e4ab42d5013ca94c60/users/120f33d804ee4c8baece1db91715e917/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:32.743020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111df99a-aa79-4b95-b70d-892162fc6a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95fc811ea1d242e4ab42d5013ca94c60, user_id=120f33d804ee4c8baece1db91715e917, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:32.746397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111df99a-aa79-4b95-b70d-892162fc6a33 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:32.753522 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fb112dbb-c785-4ca2-8490-d1f3e1ad6d20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36fee2f13ea64db5b0258aae3fdc5d2d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:32.769745 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fb112dbb-c785-4ca2-8490-d1f3e1ad6d20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36fee2f13ea64db5b0258aae3fdc5d2d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:32.771243 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fb112dbb-c785-4ca2-8490-d1f3e1ad6d20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36fee2f13ea64db5b0258aae3fdc5d2d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:32.772256 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fb112dbb-c785-4ca2-8490-d1f3e1ad6d20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36fee2f13ea64db5b0258aae3fdc5d2d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:32.828640 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fb112dbb-c785-4ca2-8490-d1f3e1ad6d20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36fee2f13ea64db5b0258aae3fdc5d2d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:32.843644 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 916/1806] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:32 2022] PUT /identity/v3/projects/95fc811ea1d242e4ab42d5013ca94c60/users/120f33d804ee4c8baece1db91715e917/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:32.844736 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111df99a-aa79-4b95-b70d-892162fc6a33 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:32.864370 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-111df99a-aa79-4b95-b70d-892162fc6a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:32.985348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 891/1807] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:32 2022] DELETE /identity/v3/users/36fee2f13ea64db5b0258aae3fdc5d2d => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:32.985348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a3b18-f23a-41be-b41a-9cd1efd696d1 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:32.985348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a3b18-f23a-41be-b41a-9cd1efd696d1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:32.985348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a3b18-f23a-41be-b41a-9cd1efd696d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:33.038543 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111df99a-aa79-4b95-b70d-892162fc6a33 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:33.057024 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-bb9a3b18-f23a-41be-b41a-9cd1efd696d1 None None] MFA Rules not processed for user `120f33d804ee4c8baece1db91715e917`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:33.063869 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-bb9a3b18-f23a-41be-b41a-9cd1efd696d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:33.320642 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a55e2-8c0f-4f5a-80cb-4c073c7a6b45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:33.323113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a55e2-8c0f-4f5a-80cb-4c073c7a6b45 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:33.323406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a55e2-8c0f-4f5a-80cb-4c073c7a6b45 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:33.325149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a55e2-8c0f-4f5a-80cb-4c073c7a6b45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:33.330678 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ef1a55e2-8c0f-4f5a-80cb-4c073c7a6b45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:33.341089 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 892/1808] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:33.346361 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0ab54-a158-42f5-9788-988eab4a0a9d None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:33.353964 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0ab54-a158-42f5-9788-988eab4a0a9d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:33.353964 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0ab54-a158-42f5-9788-988eab4a0a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:33.378464 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a55e2-8c0f-4f5a-80cb-4c073c7a6b45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:33.384983 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a55e2-8c0f-4f5a-80cb-4c073c7a6b45 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:33.401304 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-80b0ab54-a158-42f5-9788-988eab4a0a9d None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:33.407705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-80b0ab54-a158-42f5-9788-988eab4a0a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:33.414745 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 917/1809] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:33.435861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa0871-6b1d-4583-8773-10195d79bce1 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:33.441087 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa0871-6b1d-4583-8773-10195d79bce1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:33.443460 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa0871-6b1d-4583-8773-10195d79bce1 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:33.449927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 918/1810] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jul 5 13:01:33 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 13:01:33.453989 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa0871-6b1d-4583-8773-10195d79bce1 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:33.463112 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-22fa0871-6b1d-4583-8773-10195d79bce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:33.586691 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa0871-6b1d-4583-8773-10195d79bce1 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:33.592575 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5c263-f7dc-4806-adbc-0d3764aaee45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:33.594671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5c263-f7dc-4806-adbc-0d3764aaee45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:33.594671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5c263-f7dc-4806-adbc-0d3764aaee45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:33.594671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5c263-f7dc-4806-adbc-0d3764aaee45 admin admin] PATH_INFO: `/v3/users/194beea44fdf43c69cbd3ed092b4204a` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:33.595925 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5c263-f7dc-4806-adbc-0d3764aaee45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=194beea44fdf43c69cbd3ed092b4204a)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:33.598863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5c263-f7dc-4806-adbc-0d3764aaee45 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:33.685538 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 893/1811] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:33.690646 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0ab54-a158-42f5-9788-988eab4a0a9d None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:33.692937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-80b0ab54-a158-42f5-9788-988eab4a0a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:33.714084 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0ab54-a158-42f5-9788-988eab4a0a9d None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:33.723451 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27001dd-89ee-4e12-b482-12819c60f15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:33.724152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27001dd-89ee-4e12-b482-12819c60f15f admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:33.724494 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27001dd-89ee-4e12-b482-12819c60f15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:33.724884 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27001dd-89ee-4e12-b482-12819c60f15f admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:33.735476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27001dd-89ee-4e12-b482-12819c60f15f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:33.735476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27001dd-89ee-4e12-b482-12819c60f15f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:33.870855 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:33.888375 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 894/1812] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:33 2022] POST /identity/v3/projects => generated 387 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:33.889705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27001dd-89ee-4e12-b482-12819c60f15f admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:33.895829 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f27001dd-89ee-4e12-b482-12819c60f15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:33.908920 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-23d5c263-f7dc-4806-adbc-0d3764aaee45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '194beea44fdf43c69cbd3ed092b4204a'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:33.939971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-23d5c263-f7dc-4806-adbc-0d3764aaee45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '194beea44fdf43c69cbd3ed092b4204a'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:33.942962 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-23d5c263-f7dc-4806-adbc-0d3764aaee45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '194beea44fdf43c69cbd3ed092b4204a'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:33.947948 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-23d5c263-f7dc-4806-adbc-0d3764aaee45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '194beea44fdf43c69cbd3ed092b4204a'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:33.988498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-23d5c263-f7dc-4806-adbc-0d3764aaee45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '194beea44fdf43c69cbd3ed092b4204a'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:34.073073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27001dd-89ee-4e12-b482-12819c60f15f admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:34.078132 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fd61d-ece4-4549-81e4-e2afab96cf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:34.079722 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fd61d-ece4-4549-81e4-e2afab96cf27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:34.080093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fd61d-ece4-4549-81e4-e2afab96cf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:34.080378 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fd61d-ece4-4549-81e4-e2afab96cf27 admin admin] PATH_INFO: `/v3/users/4234dfcb37c148728fa750444f892407` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:34.082017 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fd61d-ece4-4549-81e4-e2afab96cf27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4234dfcb37c148728fa750444f892407)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:34.084249 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fd61d-ece4-4549-81e4-e2afab96cf27 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:34.099846 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 919/1813] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:33 2022] DELETE /identity/v3/users/194beea44fdf43c69cbd3ed092b4204a => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:34.101424 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a53671-e1c4-45f5-aa63-82460b6a9733 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:34.101718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a53671-e1c4-45f5-aa63-82460b6a9733 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:34.108958 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a53671-e1c4-45f5-aa63-82460b6a9733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:34.147986 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a2a53671-e1c4-45f5-aa63-82460b6a9733 None None] MFA Rules not processed for user `cdf37a42279a466b85906b23751f9c22`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:34.151667 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a2a53671-e1c4-45f5-aa63-82460b6a9733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:34.326776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 920/1814] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jul 5 13:01:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:34.327681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a53671-e1c4-45f5-aa63-82460b6a9733 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:34.335301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a2a53671-e1c4-45f5-aa63-82460b6a9733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:34.355753 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-032fd61d-ece4-4549-81e4-e2afab96cf27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4234dfcb37c148728fa750444f892407'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:34.421333 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-032fd61d-ece4-4549-81e4-e2afab96cf27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4234dfcb37c148728fa750444f892407'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:34.422460 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-032fd61d-ece4-4549-81e4-e2afab96cf27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4234dfcb37c148728fa750444f892407'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:34.423173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-032fd61d-ece4-4549-81e4-e2afab96cf27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4234dfcb37c148728fa750444f892407'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:34.450988 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-032fd61d-ece4-4549-81e4-e2afab96cf27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4234dfcb37c148728fa750444f892407'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:34.483467 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a53671-e1c4-45f5-aa63-82460b6a9733 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:34.526060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac522388-1f02-4312-a0bc-9feb8197d710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:34.526791 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac522388-1f02-4312-a0bc-9feb8197d710 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:34.527091 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac522388-1f02-4312-a0bc-9feb8197d710 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:34.527374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac522388-1f02-4312-a0bc-9feb8197d710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:34.535421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ac522388-1f02-4312-a0bc-9feb8197d710 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:34.587880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 895/1815] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:33 2022] DELETE /identity/v3/users/4234dfcb37c148728fa750444f892407 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:34.589577 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fd61d-ece4-4549-81e4-e2afab96cf27 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:34.593412 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-032fd61d-ece4-4549-81e4-e2afab96cf27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:34.682953 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac522388-1f02-4312-a0bc-9feb8197d710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:34.685261 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac522388-1f02-4312-a0bc-9feb8197d710 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:34.699498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 921/1816] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:34.702112 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7d114-feb0-4471-b84c-e358aa47331b None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:34.702406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7d114-feb0-4471-b84c-e358aa47331b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:34.702689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7d114-feb0-4471-b84c-e358aa47331b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:34.723566 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-abf7d114-feb0-4471-b84c-e358aa47331b None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:34.727141 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-abf7d114-feb0-4471-b84c-e358aa47331b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:34.760814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fd61d-ece4-4549-81e4-e2afab96cf27 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:34.766819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76762ba-9eb8-4a09-bbca-20927c7c452e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:34.767605 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76762ba-9eb8-4a09-bbca-20927c7c452e admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:34.768085 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76762ba-9eb8-4a09-bbca-20927c7c452e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:34.768571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76762ba-9eb8-4a09-bbca-20927c7c452e admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:34.769529 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76762ba-9eb8-4a09-bbca-20927c7c452e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:34.781621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:34.781621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76762ba-9eb8-4a09-bbca-20927c7c452e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:34.870310 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 922/1817] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:34.873782 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b930dc5-f3fe-430b-bd32-bcb672ffdb74 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:34.874257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b930dc5-f3fe-430b-bd32-bcb672ffdb74 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:34.874682 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b930dc5-f3fe-430b-bd32-bcb672ffdb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:34.899668 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-5b930dc5-f3fe-430b-bd32-bcb672ffdb74 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:34.901449 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5b930dc5-f3fe-430b-bd32-bcb672ffdb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:34.912132 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 923/1818] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:34.919516 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b930dc5-f3fe-430b-bd32-bcb672ffdb74 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:34.919516 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5b930dc5-f3fe-430b-bd32-bcb672ffdb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:34.985814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 896/1819] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:34 2022] POST /identity/v3/users => generated 300 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:34.986983 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76762ba-9eb8-4a09-bbca-20927c7c452e admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:34.991239 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f76762ba-9eb8-4a09-bbca-20927c7c452e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:35.029727 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b930dc5-f3fe-430b-bd32-bcb672ffdb74 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:35.040377 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd9199-3a03-4dad-ae51-21af9ad2ff2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:35.041155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd9199-3a03-4dad-ae51-21af9ad2ff2e service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:35.041442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd9199-3a03-4dad-ae51-21af9ad2ff2e service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:35.041867 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd9199-3a03-4dad-ae51-21af9ad2ff2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:35.046504 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-04fd9199-3a03-4dad-ae51-21af9ad2ff2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:35.071288 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd9199-3a03-4dad-ae51-21af9ad2ff2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:35.073935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd9199-3a03-4dad-ae51-21af9ad2ff2e service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:35.092496 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76762ba-9eb8-4a09-bbca-20927c7c452e admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:35.099337 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce85e90-cbb4-45e7-b9f7-3a484cd1b56f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:35.100859 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce85e90-cbb4-45e7-b9f7-3a484cd1b56f service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:35.101419 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce85e90-cbb4-45e7-b9f7-3a484cd1b56f service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:35.101708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce85e90-cbb4-45e7-b9f7-3a484cd1b56f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:35.102831 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 924/1820] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:35.104376 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd9199-3a03-4dad-ae51-21af9ad2ff2e service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:35.116568 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce85e90-cbb4-45e7-b9f7-3a484cd1b56f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:35.120174 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce85e90-cbb4-45e7-b9f7-3a484cd1b56f service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:35.129265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd9199-3a03-4dad-ae51-21af9ad2ff2e service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:35.140403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd859c9-de28-4bf8-8101-93decfa062a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:35.144012 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd859c9-de28-4bf8-8101-93decfa062a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:35.145834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd859c9-de28-4bf8-8101-93decfa062a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:35.147205 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd859c9-de28-4bf8-8101-93decfa062a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:35.154473 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 897/1821] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:35.155489 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce85e90-cbb4-45e7-b9f7-3a484cd1b56f service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:35.172730 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce85e90-cbb4-45e7-b9f7-3a484cd1b56f service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:35.173458 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd859c9-de28-4bf8-8101-93decfa062a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:35.176050 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd859c9-de28-4bf8-8101-93decfa062a1 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:35.183130 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2775a2c-e13a-41ac-86ae-b498eb6a947c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:35.186382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2775a2c-e13a-41ac-86ae-b498eb6a947c admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:35.186382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2775a2c-e13a-41ac-86ae-b498eb6a947c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:35.186382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2775a2c-e13a-41ac-86ae-b498eb6a947c admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:35.186382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2775a2c-e13a-41ac-86ae-b498eb6a947c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:35.188964 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2775a2c-e13a-41ac-86ae-b498eb6a947c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:35.199833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 925/1822] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:35.209659 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd859c9-de28-4bf8-8101-93decfa062a1 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:35.209801 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 898/1823] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:35.223809 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd859c9-de28-4bf8-8101-93decfa062a1 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:35.235522 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0d65c-4acd-4810-b66c-f630b5fb1d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:35.237051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0d65c-4acd-4810-b66c-f630b5fb1d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:35.237443 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0d65c-4acd-4810-b66c-f630b5fb1d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:35.237824 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0d65c-4acd-4810-b66c-f630b5fb1d76 admin admin] PATH_INFO: `/v3/projects/e6fd96e46dff446abd9abff7df1ee92f/users/cd2a30a7753943239ab600ad275c527d/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:35.267912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0d65c-4acd-4810-b66c-f630b5fb1d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6fd96e46dff446abd9abff7df1ee92f, user_id=cd2a30a7753943239ab600ad275c527d, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:35.275184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0d65c-4acd-4810-b66c-f630b5fb1d76 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:35.381504 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2775a2c-e13a-41ac-86ae-b498eb6a947c admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:35.383463 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 926/1824] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:35 2022] PUT /identity/v3/projects/e6fd96e46dff446abd9abff7df1ee92f/users/cd2a30a7753943239ab600ad275c527d/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:01:35.400519 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2775a2c-e13a-41ac-86ae-b498eb6a947c admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:35.509567 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e5cda-273d-43d1-adbf-f506fc40c37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:35.510392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e5cda-273d-43d1-adbf-f506fc40c37c admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:35.510789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e5cda-273d-43d1-adbf-f506fc40c37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:35.511194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e5cda-273d-43d1-adbf-f506fc40c37c admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:35.512046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e5cda-273d-43d1-adbf-f506fc40c37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:35.513811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e5cda-273d-43d1-adbf-f506fc40c37c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:35.541360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 899/1825] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:35.541534 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0d65c-4acd-4810-b66c-f630b5fb1d76 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:35.563251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0d65c-4acd-4810-b66c-f630b5fb1d76 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:35.586043 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a7556-9b21-41d7-a9f2-dcdf9133523d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:35.587186 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a7556-9b21-41d7-a9f2-dcdf9133523d admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:35.590397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a7556-9b21-41d7-a9f2-dcdf9133523d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:35.590953 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a7556-9b21-41d7-a9f2-dcdf9133523d admin admin] PATH_INFO: `/v3/projects/e6fd96e46dff446abd9abff7df1ee92f/users/cd2a30a7753943239ab600ad275c527d/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:35.598838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a7556-9b21-41d7-a9f2-dcdf9133523d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6fd96e46dff446abd9abff7df1ee92f, user_id=cd2a30a7753943239ab600ad275c527d, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:35.606191 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a7556-9b21-41d7-a9f2-dcdf9133523d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:35.650507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 927/1826] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:35 2022] PUT /identity/v3/projects/e6fd96e46dff446abd9abff7df1ee92f/users/cd2a30a7753943239ab600ad275c527d/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:35.655575 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dd2f3-1523-4103-a8f4-bea59128b341 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:35.655875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dd2f3-1523-4103-a8f4-bea59128b341 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:35.656168 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dd2f3-1523-4103-a8f4-bea59128b341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:35.710941 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2b1dd2f3-1523-4103-a8f4-bea59128b341 None None] MFA Rules not processed for user `cd2a30a7753943239ab600ad275c527d`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:35.715177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2b1dd2f3-1523-4103-a8f4-bea59128b341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:35.877842 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 900/1827] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:35.896134 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a7556-9b21-41d7-a9f2-dcdf9133523d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:35.905432 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-449a7556-9b21-41d7-a9f2-dcdf9133523d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:36.034869 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a7556-9b21-41d7-a9f2-dcdf9133523d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:36.040367 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb175369-8c24-41f9-b939-69c98e2cd4a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:36.041382 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb175369-8c24-41f9-b939-69c98e2cd4a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:36.041760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb175369-8c24-41f9-b939-69c98e2cd4a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:36.042283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb175369-8c24-41f9-b939-69c98e2cd4a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:36.071822 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb175369-8c24-41f9-b939-69c98e2cd4a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:36.073719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb175369-8c24-41f9-b939-69c98e2cd4a1 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:36.086260 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 928/1828] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:36.698285 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:37.505207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dd2f3-1523-4103-a8f4-bea59128b341 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:37.506816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2b1dd2f3-1523-4103-a8f4-bea59128b341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:37.626474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dd2f3-1523-4103-a8f4-bea59128b341 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:37.627980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa642da2-1a32-4266-b45f-cf06c1950602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:37.629052 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa642da2-1a32-4266-b45f-cf06c1950602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:37.629399 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa642da2-1a32-4266-b45f-cf06c1950602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:37.630134 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa642da2-1a32-4266-b45f-cf06c1950602 admin admin] PATH_INFO: `/v3/projects/bff303fbc0024988af01806f959632f0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:37.631059 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa642da2-1a32-4266-b45f-cf06c1950602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bff303fbc0024988af01806f959632f0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:37.633922 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa642da2-1a32-4266-b45f-cf06c1950602 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:37.937159 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fa642da2-1a32-4266-b45f-cf06c1950602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bff303fbc0024988af01806f959632f0', 'request_id': 'req-fa642da2-1a32-4266-b45f-cf06c1950602'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:37.949545 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb175369-8c24-41f9-b939-69c98e2cd4a1 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:37.951681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-eb175369-8c24-41f9-b939-69c98e2cd4a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:37.982649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb175369-8c24-41f9-b939-69c98e2cd4a1 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:38.092855 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:38.096140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fa642da2-1a32-4266-b45f-cf06c1950602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bff303fbc0024988af01806f959632f0', 'request_id': 'req-fa642da2-1a32-4266-b45f-cf06c1950602'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:38.108753 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fa642da2-1a32-4266-b45f-cf06c1950602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bff303fbc0024988af01806f959632f0', 'request_id': 'req-fa642da2-1a32-4266-b45f-cf06c1950602'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:38.125235 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fa642da2-1a32-4266-b45f-cf06c1950602 admin admin] The token cache is being invalidate because project bff303fbc0024988af01806f959632f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:38.125762 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fa642da2-1a32-4266-b45f-cf06c1950602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:38.127290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fa642da2-1a32-4266-b45f-cf06c1950602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:38.130901 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 901/1829] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:37 2022] DELETE /identity/v3/projects/bff303fbc0024988af01806f959632f0 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:38.134933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa642da2-1a32-4266-b45f-cf06c1950602 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:38.140771 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-fa642da2-1a32-4266-b45f-cf06c1950602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:38.172643 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83d985-110c-4b79-a0f6-7ddc7281b5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:38.174100 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83d985-110c-4b79-a0f6-7ddc7281b5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:38.175243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83d985-110c-4b79-a0f6-7ddc7281b5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:38.175601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83d985-110c-4b79-a0f6-7ddc7281b5d5 admin admin] PATH_INFO: `/v3/projects/c04b9d50c591406fbdb40127f11f40b0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:38.179652 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83d985-110c-4b79-a0f6-7ddc7281b5d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c04b9d50c591406fbdb40127f11f40b0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:38.184271 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83d985-110c-4b79-a0f6-7ddc7281b5d5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:38.254070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa642da2-1a32-4266-b45f-cf06c1950602 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:38.259681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3badf4-5497-4aff-a35f-3dcbf855cc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:38.260621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3badf4-5497-4aff-a35f-3dcbf855cc43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:38.261183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3badf4-5497-4aff-a35f-3dcbf855cc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:38.261183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3badf4-5497-4aff-a35f-3dcbf855cc43 admin admin] PATH_INFO: `/v3/users/08dcbc2c7c414d20b77d3690782f163b` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:38.262520 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3badf4-5497-4aff-a35f-3dcbf855cc43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08dcbc2c7c414d20b77d3690782f163b)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:38.265157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3badf4-5497-4aff-a35f-3dcbf855cc43 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:38.333889 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ee83d985-110c-4b79-a0f6-7ddc7281b5d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c04b9d50c591406fbdb40127f11f40b0', 'request_id': 'req-ee83d985-110c-4b79-a0f6-7ddc7281b5d5'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:38.365458 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ee83d985-110c-4b79-a0f6-7ddc7281b5d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c04b9d50c591406fbdb40127f11f40b0', 'request_id': 'req-ee83d985-110c-4b79-a0f6-7ddc7281b5d5'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:38.399938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ee83d985-110c-4b79-a0f6-7ddc7281b5d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c04b9d50c591406fbdb40127f11f40b0', 'request_id': 'req-ee83d985-110c-4b79-a0f6-7ddc7281b5d5'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:38.533115 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1d3badf4-5497-4aff-a35f-3dcbf855cc43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08dcbc2c7c414d20b77d3690782f163b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:38.557461 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1d3badf4-5497-4aff-a35f-3dcbf855cc43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08dcbc2c7c414d20b77d3690782f163b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:38.558337 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1d3badf4-5497-4aff-a35f-3dcbf855cc43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08dcbc2c7c414d20b77d3690782f163b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:38.572813 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ee83d985-110c-4b79-a0f6-7ddc7281b5d5 admin admin] The token cache is being invalidate because project c04b9d50c591406fbdb40127f11f40b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:38.573313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ee83d985-110c-4b79-a0f6-7ddc7281b5d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:38.575073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ee83d985-110c-4b79-a0f6-7ddc7281b5d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:38.575923 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1d3badf4-5497-4aff-a35f-3dcbf855cc43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08dcbc2c7c414d20b77d3690782f163b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:38.596333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 929/1830] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:37 2022] DELETE /identity/v3/projects/c04b9d50c591406fbdb40127f11f40b0 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:01:38.600217 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83d985-110c-4b79-a0f6-7ddc7281b5d5 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:38.600217 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ee83d985-110c-4b79-a0f6-7ddc7281b5d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:38.612737 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1d3badf4-5497-4aff-a35f-3dcbf855cc43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08dcbc2c7c414d20b77d3690782f163b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:38.723677 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83d985-110c-4b79-a0f6-7ddc7281b5d5 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:38.730896 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc593ae5-e2b9-4356-a4a5-d47c47a59a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:38.733350 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc593ae5-e2b9-4356-a4a5-d47c47a59a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:38.736410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc593ae5-e2b9-4356-a4a5-d47c47a59a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:38.737925 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc593ae5-e2b9-4356-a4a5-d47c47a59a8e admin admin] PATH_INFO: `/v3/projects/b9aef9e6c4124815b3da57465543d90f` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:38.742129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc593ae5-e2b9-4356-a4a5-d47c47a59a8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9aef9e6c4124815b3da57465543d90f)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:38.744408 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc593ae5-e2b9-4356-a4a5-d47c47a59a8e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:39.139318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 902/1831] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:38 2022] DELETE /identity/v3/users/08dcbc2c7c414d20b77d3690782f163b => generated 0 bytes in 1001 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:39.139318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3badf4-5497-4aff-a35f-3dcbf855cc43 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:39.139318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1d3badf4-5497-4aff-a35f-3dcbf855cc43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:39.317216 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3badf4-5497-4aff-a35f-3dcbf855cc43 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:39.331337 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926ac0a-2f94-44d1-933e-3bcd4d0a7e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:39.332808 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926ac0a-2f94-44d1-933e-3bcd4d0a7e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:39.337051 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926ac0a-2f94-44d1-933e-3bcd4d0a7e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:39.337373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926ac0a-2f94-44d1-933e-3bcd4d0a7e35 admin admin] PATH_INFO: `/v3/users/120f33d804ee4c8baece1db91715e917` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:39.338821 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926ac0a-2f94-44d1-933e-3bcd4d0a7e35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=120f33d804ee4c8baece1db91715e917)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:39.341041 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926ac0a-2f94-44d1-933e-3bcd4d0a7e35 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:39.668009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dc593ae5-e2b9-4356-a4a5-d47c47a59a8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9aef9e6c4124815b3da57465543d90f', 'request_id': 'req-dc593ae5-e2b9-4356-a4a5-d47c47a59a8e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:39.673789 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dc593ae5-e2b9-4356-a4a5-d47c47a59a8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9aef9e6c4124815b3da57465543d90f', 'request_id': 'req-dc593ae5-e2b9-4356-a4a5-d47c47a59a8e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:39.680544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dc593ae5-e2b9-4356-a4a5-d47c47a59a8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9aef9e6c4124815b3da57465543d90f', 'request_id': 'req-dc593ae5-e2b9-4356-a4a5-d47c47a59a8e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:39.978993 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dc593ae5-e2b9-4356-a4a5-d47c47a59a8e admin admin] The token cache is being invalidate because project b9aef9e6c4124815b3da57465543d90f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:39.979247 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dc593ae5-e2b9-4356-a4a5-d47c47a59a8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:39.983477 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dc593ae5-e2b9-4356-a4a5-d47c47a59a8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:39.988266 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 930/1832] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:38 2022] DELETE /identity/v3/projects/b9aef9e6c4124815b3da57465543d90f => generated 0 bytes in 1388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:39.988266 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc593ae5-e2b9-4356-a4a5-d47c47a59a8e admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:39.988499 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-dc593ae5-e2b9-4356-a4a5-d47c47a59a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:40.055607 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-9926ac0a-2f94-44d1-933e-3bcd4d0a7e35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '120f33d804ee4c8baece1db91715e917'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:40.071414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-9926ac0a-2f94-44d1-933e-3bcd4d0a7e35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '120f33d804ee4c8baece1db91715e917'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:40.072302 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-9926ac0a-2f94-44d1-933e-3bcd4d0a7e35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '120f33d804ee4c8baece1db91715e917'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:40.073215 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-9926ac0a-2f94-44d1-933e-3bcd4d0a7e35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '120f33d804ee4c8baece1db91715e917'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:40.098053 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc593ae5-e2b9-4356-a4a5-d47c47a59a8e admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:40.099608 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-9926ac0a-2f94-44d1-933e-3bcd4d0a7e35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '120f33d804ee4c8baece1db91715e917'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:40.108497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a701c0-3763-4e48-a1f7-a999c913ceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:40.113272 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a701c0-3763-4e48-a1f7-a999c913ceba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:40.113272 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a701c0-3763-4e48-a1f7-a999c913ceba admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:40.113272 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a701c0-3763-4e48-a1f7-a999c913ceba admin admin] PATH_INFO: `/v3/users/449b5ae3b2ee4982a4e8586bd1d7c568` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:40.113272 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a701c0-3763-4e48-a1f7-a999c913ceba admin admin] RBAC: Authorizing `identity:delete_user(user_id=449b5ae3b2ee4982a4e8586bd1d7c568)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:40.113793 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a701c0-3763-4e48-a1f7-a999c913ceba admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:40.195721 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 903/1833] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:39 2022] DELETE /identity/v3/users/120f33d804ee4c8baece1db91715e917 => generated 0 bytes in 1060 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:40.196976 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926ac0a-2f94-44d1-933e-3bcd4d0a7e35 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:40.198451 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9926ac0a-2f94-44d1-933e-3bcd4d0a7e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:40.266503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926ac0a-2f94-44d1-933e-3bcd4d0a7e35 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:40.271722 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b93be4-7d33-4a49-ba03-8766d83abe78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:40.272678 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b93be4-7d33-4a49-ba03-8766d83abe78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:40.273562 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b93be4-7d33-4a49-ba03-8766d83abe78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:40.273844 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b93be4-7d33-4a49-ba03-8766d83abe78 admin admin] PATH_INFO: `/v3/users/5903ac1b31c44eb8ae1f54a5babc39d4` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:40.275059 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b93be4-7d33-4a49-ba03-8766d83abe78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5903ac1b31c44eb8ae1f54a5babc39d4)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:40.277043 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b93be4-7d33-4a49-ba03-8766d83abe78 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:40.349765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b7a701c0-3763-4e48-a1f7-a999c913ceba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '449b5ae3b2ee4982a4e8586bd1d7c568'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:40.364095 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b7a701c0-3763-4e48-a1f7-a999c913ceba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '449b5ae3b2ee4982a4e8586bd1d7c568'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:40.364095 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b7a701c0-3763-4e48-a1f7-a999c913ceba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '449b5ae3b2ee4982a4e8586bd1d7c568'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:40.364095 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b7a701c0-3763-4e48-a1f7-a999c913ceba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '449b5ae3b2ee4982a4e8586bd1d7c568'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:40.372467 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b7a701c0-3763-4e48-a1f7-a999c913ceba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '449b5ae3b2ee4982a4e8586bd1d7c568'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:40.456301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 931/1834] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:39 2022] DELETE /identity/v3/users/449b5ae3b2ee4982a4e8586bd1d7c568 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:40.459838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c666b-e759-4605-85fc-20319d42fad6 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:40.460637 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c666b-e759-4605-85fc-20319d42fad6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:40.461024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c666b-e759-4605-85fc-20319d42fad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:40.483343 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-c30c666b-e759-4605-85fc-20319d42fad6 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:40.485152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c30c666b-e759-4605-85fc-20319d42fad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:40.487884 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-00b93be4-7d33-4a49-ba03-8766d83abe78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5903ac1b31c44eb8ae1f54a5babc39d4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:40.505571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-00b93be4-7d33-4a49-ba03-8766d83abe78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5903ac1b31c44eb8ae1f54a5babc39d4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:40.506352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-00b93be4-7d33-4a49-ba03-8766d83abe78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5903ac1b31c44eb8ae1f54a5babc39d4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:40.507113 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-00b93be4-7d33-4a49-ba03-8766d83abe78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5903ac1b31c44eb8ae1f54a5babc39d4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:40.545015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-00b93be4-7d33-4a49-ba03-8766d83abe78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5903ac1b31c44eb8ae1f54a5babc39d4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:40.575073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 932/1835] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:40.575073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c666b-e759-4605-85fc-20319d42fad6 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:40.575073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c30c666b-e759-4605-85fc-20319d42fad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:40.589661 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c666b-e759-4605-85fc-20319d42fad6 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:40.601778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b93775-2e3b-4723-a32b-4b5b951ed7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:40.604186 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b93775-2e3b-4723-a32b-4b5b951ed7ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:40.604186 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b93775-2e3b-4723-a32b-4b5b951ed7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:40.604186 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b93775-2e3b-4723-a32b-4b5b951ed7ac admin admin] PATH_INFO: `/v3/projects/3eb0debb0e5146c284c99e5fa45efd80` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:40.605397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b93775-2e3b-4723-a32b-4b5b951ed7ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eb0debb0e5146c284c99e5fa45efd80)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:40.609125 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b93775-2e3b-4723-a32b-4b5b951ed7ac admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:40.681232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 904/1836] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:40 2022] DELETE /identity/v3/users/5903ac1b31c44eb8ae1f54a5babc39d4 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:40.685041 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b93be4-7d33-4a49-ba03-8766d83abe78 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:40.689857 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-00b93be4-7d33-4a49-ba03-8766d83abe78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:40.752790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-98b93775-2e3b-4723-a32b-4b5b951ed7ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eb0debb0e5146c284c99e5fa45efd80', 'request_id': 'req-98b93775-2e3b-4723-a32b-4b5b951ed7ac'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:40.762773 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-98b93775-2e3b-4723-a32b-4b5b951ed7ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eb0debb0e5146c284c99e5fa45efd80', 'request_id': 'req-98b93775-2e3b-4723-a32b-4b5b951ed7ac'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:40.763825 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b93be4-7d33-4a49-ba03-8766d83abe78 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:40.773700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-98b93775-2e3b-4723-a32b-4b5b951ed7ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eb0debb0e5146c284c99e5fa45efd80', 'request_id': 'req-98b93775-2e3b-4723-a32b-4b5b951ed7ac'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:40.822022 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d3c40-28ac-4f6d-a898-33a543a7ec58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:40.822773 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d3c40-28ac-4f6d-a898-33a543a7ec58 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:40.823193 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d3c40-28ac-4f6d-a898-33a543a7ec58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:40.823532 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d3c40-28ac-4f6d-a898-33a543a7ec58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:40.846185 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-98b93775-2e3b-4723-a32b-4b5b951ed7ac admin admin] The token cache is being invalidate because project 3eb0debb0e5146c284c99e5fa45efd80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:40.847056 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-98b93775-2e3b-4723-a32b-4b5b951ed7ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:40.848251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-98b93775-2e3b-4723-a32b-4b5b951ed7ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:40.849396 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 933/1837] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:40 2022] DELETE /identity/v3/projects/3eb0debb0e5146c284c99e5fa45efd80 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:40.854626 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a6474-3a69-4221-82b7-e615b9ea1c5d None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:40.855033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a6474-3a69-4221-82b7-e615b9ea1c5d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:40.855393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a6474-3a69-4221-82b7-e615b9ea1c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:40.877524 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b81a6474-3a69-4221-82b7-e615b9ea1c5d None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:40.879098 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b81a6474-3a69-4221-82b7-e615b9ea1c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:40.924749 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d3c40-28ac-4f6d-a898-33a543a7ec58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:40.924749 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d3c40-28ac-4f6d-a898-33a543a7ec58 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:40.934414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 905/1838] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:40.982354 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 934/1839] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:40.984672 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5514c9d-1259-4e15-a8c6-041f76437303 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:40.985391 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5514c9d-1259-4e15-a8c6-041f76437303 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:40.986553 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5514c9d-1259-4e15-a8c6-041f76437303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:41.006647 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:41.011026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b5514c9d-1259-4e15-a8c6-041f76437303 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:41.011026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b5514c9d-1259-4e15-a8c6-041f76437303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:41.020832 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 906/1840] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:01:41.024081 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a6474-3a69-4221-82b7-e615b9ea1c5d None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:41.034808 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a6474-3a69-4221-82b7-e615b9ea1c5d None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:41.040560 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f09c54-d90a-4b78-a65a-ef53f836bcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:41.041320 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f09c54-d90a-4b78-a65a-ef53f836bcde admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:41.041605 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f09c54-d90a-4b78-a65a-ef53f836bcde admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:41.041882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f09c54-d90a-4b78-a65a-ef53f836bcde admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:41.042630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f09c54-d90a-4b78-a65a-ef53f836bcde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:01:41.042944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f09c54-d90a-4b78-a65a-ef53f836bcde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:41.044608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f09c54-d90a-4b78-a65a-ef53f836bcde admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:41.061028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 935/1841] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:01:41.066847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5514c9d-1259-4e15-a8c6-041f76437303 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:41.077210 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5514c9d-1259-4e15-a8c6-041f76437303 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:41.082146 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e778efc-9e25-4862-8fc5-a2ca0a3a0ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:41.082833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e778efc-9e25-4862-8fc5-a2ca0a3a0ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:41.083119 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e778efc-9e25-4862-8fc5-a2ca0a3a0ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:41.083448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e778efc-9e25-4862-8fc5-a2ca0a3a0ef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:41.084263 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e778efc-9e25-4862-8fc5-a2ca0a3a0ef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:41.086327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e778efc-9e25-4862-8fc5-a2ca0a3a0ef7 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:41.109163 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:41.188188 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f09c54-d90a-4b78-a65a-ef53f836bcde admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:41.188188 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-92f09c54-d90a-4b78-a65a-ef53f836bcde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:41.215708 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f09c54-d90a-4b78-a65a-ef53f836bcde admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:41.219200 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 907/1842] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:41 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:41.220572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e778efc-9e25-4862-8fc5-a2ca0a3a0ef7 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:41.284790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc040bab-bbc0-47c6-88b9-10dccae6e30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:41.287800 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc040bab-bbc0-47c6-88b9-10dccae6e30b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:41.288092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc040bab-bbc0-47c6-88b9-10dccae6e30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:41.288398 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc040bab-bbc0-47c6-88b9-10dccae6e30b admin admin] PATH_INFO: `/v3/projects/2c1a788c2082450793df26c2afa5cffc` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:41.289685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc040bab-bbc0-47c6-88b9-10dccae6e30b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c1a788c2082450793df26c2afa5cffc)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:41.292981 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc040bab-bbc0-47c6-88b9-10dccae6e30b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:41.307065 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e778efc-9e25-4862-8fc5-a2ca0a3a0ef7 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:41.311688 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e714b6-e23d-4788-a8d2-748f33213f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:41.312346 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e714b6-e23d-4788-a8d2-748f33213f77 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:41.312705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e714b6-e23d-4788-a8d2-748f33213f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:41.312959 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e714b6-e23d-4788-a8d2-748f33213f77 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:41.313789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e714b6-e23d-4788-a8d2-748f33213f77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:41.315716 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e714b6-e23d-4788-a8d2-748f33213f77 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:41.413014 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 908/1843] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:41 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:41.414052 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e714b6-e23d-4788-a8d2-748f33213f77 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:41.416434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-62e714b6-e23d-4788-a8d2-748f33213f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:41.436515 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dc040bab-bbc0-47c6-88b9-10dccae6e30b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c1a788c2082450793df26c2afa5cffc', 'request_id': 'req-dc040bab-bbc0-47c6-88b9-10dccae6e30b'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:41.443600 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e714b6-e23d-4788-a8d2-748f33213f77 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:41.444476 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dc040bab-bbc0-47c6-88b9-10dccae6e30b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c1a788c2082450793df26c2afa5cffc', 'request_id': 'req-dc040bab-bbc0-47c6-88b9-10dccae6e30b'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:41.452544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dc040bab-bbc0-47c6-88b9-10dccae6e30b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c1a788c2082450793df26c2afa5cffc', 'request_id': 'req-dc040bab-bbc0-47c6-88b9-10dccae6e30b'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:41.506531 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aab74-aea1-4f68-9e9b-54dd19436478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:41.507444 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aab74-aea1-4f68-9e9b-54dd19436478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:41.507732 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aab74-aea1-4f68-9e9b-54dd19436478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:41.508018 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aab74-aea1-4f68-9e9b-54dd19436478 admin admin] PATH_INFO: `/v3/projects/5881c13675d24eb68656c2c3b1ca9c12` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:41.509274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058aab74-aea1-4f68-9e9b-54dd19436478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5881c13675d24eb68656c2c3b1ca9c12)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:41.511323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058aab74-aea1-4f68-9e9b-54dd19436478 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:41.577024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dc040bab-bbc0-47c6-88b9-10dccae6e30b admin admin] The token cache is being invalidate because project 2c1a788c2082450793df26c2afa5cffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:41.577332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dc040bab-bbc0-47c6-88b9-10dccae6e30b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:41.579296 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dc040bab-bbc0-47c6-88b9-10dccae6e30b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:41.579629 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 936/1844] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:41 2022] DELETE /identity/v3/projects/2c1a788c2082450793df26c2afa5cffc => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:01:41.583171 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc040bab-bbc0-47c6-88b9-10dccae6e30b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:41.584504 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-dc040bab-bbc0-47c6-88b9-10dccae6e30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:41.597305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc040bab-bbc0-47c6-88b9-10dccae6e30b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:41.603199 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffbdfd-e1a8-4bc8-90db-7e34465e6ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:41.604010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffbdfd-e1a8-4bc8-90db-7e34465e6ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:41.604295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffbdfd-e1a8-4bc8-90db-7e34465e6ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:41.604578 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffbdfd-e1a8-4bc8-90db-7e34465e6ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:41.605341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffbdfd-e1a8-4bc8-90db-7e34465e6ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:41.606962 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffbdfd-e1a8-4bc8-90db-7e34465e6ff0 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:41.621620 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 937/1845] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:41.621620 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffbdfd-e1a8-4bc8-90db-7e34465e6ff0 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:41.623268 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a2ffbdfd-e1a8-4bc8-90db-7e34465e6ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:41.635974 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffbdfd-e1a8-4bc8-90db-7e34465e6ff0 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:41.641774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5e961-8284-458d-b52c-25d02d4a90fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:41.642668 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5e961-8284-458d-b52c-25d02d4a90fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:41.642950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5e961-8284-458d-b52c-25d02d4a90fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:41.643223 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5e961-8284-458d-b52c-25d02d4a90fc admin admin] PATH_INFO: `/v3/users/28eb5ffc480a40b0b46410fe7a4516a2` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:41.644432 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5e961-8284-458d-b52c-25d02d4a90fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=28eb5ffc480a40b0b46410fe7a4516a2)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:41.646492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5e961-8284-458d-b52c-25d02d4a90fc admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:41.667475 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-058aab74-aea1-4f68-9e9b-54dd19436478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5881c13675d24eb68656c2c3b1ca9c12', 'request_id': 'req-058aab74-aea1-4f68-9e9b-54dd19436478'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:41.732167 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-058aab74-aea1-4f68-9e9b-54dd19436478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5881c13675d24eb68656c2c3b1ca9c12', 'request_id': 'req-058aab74-aea1-4f68-9e9b-54dd19436478'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:41.740510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-058aab74-aea1-4f68-9e9b-54dd19436478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5881c13675d24eb68656c2c3b1ca9c12', 'request_id': 'req-058aab74-aea1-4f68-9e9b-54dd19436478'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:41.753005 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-058aab74-aea1-4f68-9e9b-54dd19436478 admin admin] The token cache is being invalidate because project 5881c13675d24eb68656c2c3b1ca9c12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:41.753379 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-058aab74-aea1-4f68-9e9b-54dd19436478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:41.754134 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-058aab74-aea1-4f68-9e9b-54dd19436478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:41.755778 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 909/1846] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:41 2022] DELETE /identity/v3/projects/5881c13675d24eb68656c2c3b1ca9c12 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:41.756669 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aab74-aea1-4f68-9e9b-54dd19436478 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:41.760277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-058aab74-aea1-4f68-9e9b-54dd19436478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:41.830428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aab74-aea1-4f68-9e9b-54dd19436478 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:41.835942 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dccf9-10c9-40c9-a82a-bafc32cc4aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:41.836654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dccf9-10c9-40c9-a82a-bafc32cc4aee admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:41.836948 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dccf9-10c9-40c9-a82a-bafc32cc4aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:41.837232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dccf9-10c9-40c9-a82a-bafc32cc4aee admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:41.837968 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0dccf9-10c9-40c9-a82a-bafc32cc4aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:41.839774 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0dccf9-10c9-40c9-a82a-bafc32cc4aee admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:41.850499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 910/1847] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:41.851927 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ffbea-88a5-439a-86d3-296d15637147 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:41.852212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ffbea-88a5-439a-86d3-296d15637147 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:41.852775 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ffbea-88a5-439a-86d3-296d15637147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:41.873236 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-144ffbea-88a5-439a-86d3-296d15637147 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:41.874441 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-144ffbea-88a5-439a-86d3-296d15637147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:41.882683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 911/1848] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:41.883464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ffbea-88a5-439a-86d3-296d15637147 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:41.894446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ffbea-88a5-439a-86d3-296d15637147 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:41.899911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72bb06-d0b5-4758-8003-ac2c9d5aafc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:41.900894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72bb06-d0b5-4758-8003-ac2c9d5aafc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:41.901299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72bb06-d0b5-4758-8003-ac2c9d5aafc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:41.901599 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72bb06-d0b5-4758-8003-ac2c9d5aafc7 admin admin] PATH_INFO: `/v3/projects/6d007a67e4794fa09719c18cafcec51c/users/b017de8a373842a385c0fb9dca571893/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:41.919443 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72bb06-d0b5-4758-8003-ac2c9d5aafc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d007a67e4794fa09719c18cafcec51c, user_id=b017de8a373842a385c0fb9dca571893, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:41.922244 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72bb06-d0b5-4758-8003-ac2c9d5aafc7 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:41.944550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6df5e961-8284-458d-b52c-25d02d4a90fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28eb5ffc480a40b0b46410fe7a4516a2'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:41.953016 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6df5e961-8284-458d-b52c-25d02d4a90fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28eb5ffc480a40b0b46410fe7a4516a2'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:41.954446 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6df5e961-8284-458d-b52c-25d02d4a90fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28eb5ffc480a40b0b46410fe7a4516a2'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:41.955023 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6df5e961-8284-458d-b52c-25d02d4a90fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28eb5ffc480a40b0b46410fe7a4516a2'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:41.969893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6df5e961-8284-458d-b52c-25d02d4a90fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28eb5ffc480a40b0b46410fe7a4516a2'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:42.029275 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 912/1849] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:41 2022] PUT /identity/v3/projects/6d007a67e4794fa09719c18cafcec51c/users/b017de8a373842a385c0fb9dca571893/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:42.030142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72bb06-d0b5-4758-8003-ac2c9d5aafc7 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:42.031726 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6d72bb06-d0b5-4758-8003-ac2c9d5aafc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:42.059227 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 938/1850] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:41 2022] DELETE /identity/v3/users/28eb5ffc480a40b0b46410fe7a4516a2 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:42.060899 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ff791-744d-42c6-bf36-89f6ac2d66e6 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:42.061623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ff791-744d-42c6-bf36-89f6ac2d66e6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:42.061994 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ff791-744d-42c6-bf36-89f6ac2d66e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:42.086343 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-dc9ff791-744d-42c6-bf36-89f6ac2d66e6 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:42.087658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-dc9ff791-744d-42c6-bf36-89f6ac2d66e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:42.104720 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72bb06-d0b5-4758-8003-ac2c9d5aafc7 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:42.150911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 939/1851] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:42.152617 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf695aa-48b6-4976-84fb-7841060cb80a None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:42.153084 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf695aa-48b6-4976-84fb-7841060cb80a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:42.153568 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf695aa-48b6-4976-84fb-7841060cb80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:42.165811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df4650-000c-45c5-bd0d-a006bf09e795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:42.166843 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df4650-000c-45c5-bd0d-a006bf09e795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:42.167137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df4650-000c-45c5-bd0d-a006bf09e795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:42.167419 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df4650-000c-45c5-bd0d-a006bf09e795 admin admin] PATH_INFO: `/v3/projects/95fc811ea1d242e4ab42d5013ca94c60` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:42.168683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df4650-000c-45c5-bd0d-a006bf09e795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95fc811ea1d242e4ab42d5013ca94c60)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:42.171026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df4650-000c-45c5-bd0d-a006bf09e795 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:42.181505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-3cf695aa-48b6-4976-84fb-7841060cb80a None None] MFA Rules not processed for user `b017de8a373842a385c0fb9dca571893`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:42.183027 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3cf695aa-48b6-4976-84fb-7841060cb80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:42.246497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 940/1852] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:42.247399 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf695aa-48b6-4976-84fb-7841060cb80a None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:42.258029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf695aa-48b6-4976-84fb-7841060cb80a None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:42.262752 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584fc71-17b3-4554-aee6-c37f241ee939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:42.263424 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584fc71-17b3-4554-aee6-c37f241ee939 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:42.263708 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584fc71-17b3-4554-aee6-c37f241ee939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:42.263980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584fc71-17b3-4554-aee6-c37f241ee939 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:42.264865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584fc71-17b3-4554-aee6-c37f241ee939 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:01:42.265171 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584fc71-17b3-4554-aee6-c37f241ee939 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:42.266987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584fc71-17b3-4554-aee6-c37f241ee939 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:42.271215 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:42.281629 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 941/1853] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:01:42.282540 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584fc71-17b3-4554-aee6-c37f241ee939 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:42.285519 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6584fc71-17b3-4554-aee6-c37f241ee939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:42.289608 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-65df4650-000c-45c5-bd0d-a006bf09e795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95fc811ea1d242e4ab42d5013ca94c60', 'request_id': 'req-65df4650-000c-45c5-bd0d-a006bf09e795'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:42.297562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584fc71-17b3-4554-aee6-c37f241ee939 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:42.354493 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-65df4650-000c-45c5-bd0d-a006bf09e795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95fc811ea1d242e4ab42d5013ca94c60', 'request_id': 'req-65df4650-000c-45c5-bd0d-a006bf09e795'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:42.356757 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac3241-f25d-46d3-aee8-226549fc0c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:42.357439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac3241-f25d-46d3-aee8-226549fc0c76 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:42.357721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac3241-f25d-46d3-aee8-226549fc0c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:42.358000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac3241-f25d-46d3-aee8-226549fc0c76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:42.358725 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac3241-f25d-46d3-aee8-226549fc0c76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:42.360738 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac3241-f25d-46d3-aee8-226549fc0c76 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:42.362735 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-65df4650-000c-45c5-bd0d-a006bf09e795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95fc811ea1d242e4ab42d5013ca94c60', 'request_id': 'req-65df4650-000c-45c5-bd0d-a006bf09e795'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:42.372383 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-65df4650-000c-45c5-bd0d-a006bf09e795 admin admin] The token cache is being invalidate because project 95fc811ea1d242e4ab42d5013ca94c60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:42.372706 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-65df4650-000c-45c5-bd0d-a006bf09e795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:42.373419 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-65df4650-000c-45c5-bd0d-a006bf09e795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:42.375249 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 913/1854] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:42 2022] DELETE /identity/v3/projects/95fc811ea1d242e4ab42d5013ca94c60 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:42.376086 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df4650-000c-45c5-bd0d-a006bf09e795 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:42.378177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-65df4650-000c-45c5-bd0d-a006bf09e795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:42.391075 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df4650-000c-45c5-bd0d-a006bf09e795 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:42.395733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb614b3-75de-4d8a-9834-a7d75455fb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:42.396426 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb614b3-75de-4d8a-9834-a7d75455fb32 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:42.396755 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb614b3-75de-4d8a-9834-a7d75455fb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:42.397031 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb614b3-75de-4d8a-9834-a7d75455fb32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:42.398344 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb614b3-75de-4d8a-9834-a7d75455fb32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:42.400252 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb614b3-75de-4d8a-9834-a7d75455fb32 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:42.510547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 942/1855] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:42 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:42.511493 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac3241-f25d-46d3-aee8-226549fc0c76 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:42.513071 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-96ac3241-f25d-46d3-aee8-226549fc0c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:42.527593 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 914/1856] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:42 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:42.527593 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb614b3-75de-4d8a-9834-a7d75455fb32 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:42.527970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-edb614b3-75de-4d8a-9834-a7d75455fb32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:42.582888 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac3241-f25d-46d3-aee8-226549fc0c76 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:42.599003 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb614b3-75de-4d8a-9834-a7d75455fb32 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:42.601502 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:42.606040 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1327cd-77c3-4173-b4e2-0b9bd3f846ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:42.609370 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1327cd-77c3-4173-b4e2-0b9bd3f846ef admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:42.609370 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1327cd-77c3-4173-b4e2-0b9bd3f846ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:42.609370 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1327cd-77c3-4173-b4e2-0b9bd3f846ef admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:42.609370 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1327cd-77c3-4173-b4e2-0b9bd3f846ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:42.610029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1327cd-77c3-4173-b4e2-0b9bd3f846ef admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:42.643621 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cc15f-0ee9-4c4a-8e7c-64667d391cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:42.644493 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cc15f-0ee9-4c4a-8e7c-64667d391cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:42.644832 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cc15f-0ee9-4c4a-8e7c-64667d391cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:42.645189 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cc15f-0ee9-4c4a-8e7c-64667d391cf1 admin admin] PATH_INFO: `/v3/users/cd2a30a7753943239ab600ad275c527d` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:42.646406 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795cc15f-0ee9-4c4a-8e7c-64667d391cf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd2a30a7753943239ab600ad275c527d)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:42.648380 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795cc15f-0ee9-4c4a-8e7c-64667d391cf1 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:42.711699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 915/1857] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:42 2022] POST /identity/v3/users => generated 295 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:42.711699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1327cd-77c3-4173-b4e2-0b9bd3f846ef admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:42.712327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2b1327cd-77c3-4173-b4e2-0b9bd3f846ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:42.725153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1327cd-77c3-4173-b4e2-0b9bd3f846ef admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:42.730560 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18132ae8-d5ff-4e4b-8354-134a56d877de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:42.731431 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18132ae8-d5ff-4e4b-8354-134a56d877de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:42.731716 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18132ae8-d5ff-4e4b-8354-134a56d877de admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:42.731994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18132ae8-d5ff-4e4b-8354-134a56d877de admin admin] PATH_INFO: `/v3/projects/031bef13983a42c59123dde52fbb3f0f` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:42.733687 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18132ae8-d5ff-4e4b-8354-134a56d877de admin admin] RBAC: Authorizing `identity:delete_project(project_id=031bef13983a42c59123dde52fbb3f0f)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:42.736022 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18132ae8-d5ff-4e4b-8354-134a56d877de admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:42.982017 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-795cc15f-0ee9-4c4a-8e7c-64667d391cf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd2a30a7753943239ab600ad275c527d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:42.982800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-18132ae8-d5ff-4e4b-8354-134a56d877de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '031bef13983a42c59123dde52fbb3f0f', 'request_id': 'req-18132ae8-d5ff-4e4b-8354-134a56d877de'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:42.989216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-795cc15f-0ee9-4c4a-8e7c-64667d391cf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd2a30a7753943239ab600ad275c527d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:42.989936 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-795cc15f-0ee9-4c4a-8e7c-64667d391cf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd2a30a7753943239ab600ad275c527d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:42.990755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-795cc15f-0ee9-4c4a-8e7c-64667d391cf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd2a30a7753943239ab600ad275c527d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:43.004224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-795cc15f-0ee9-4c4a-8e7c-64667d391cf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd2a30a7753943239ab600ad275c527d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:43.104126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-18132ae8-d5ff-4e4b-8354-134a56d877de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '031bef13983a42c59123dde52fbb3f0f', 'request_id': 'req-18132ae8-d5ff-4e4b-8354-134a56d877de'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:43.113173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-18132ae8-d5ff-4e4b-8354-134a56d877de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '031bef13983a42c59123dde52fbb3f0f', 'request_id': 'req-18132ae8-d5ff-4e4b-8354-134a56d877de'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:43.126327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-18132ae8-d5ff-4e4b-8354-134a56d877de admin admin] The token cache is being invalidate because project 031bef13983a42c59123dde52fbb3f0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:43.126726 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-18132ae8-d5ff-4e4b-8354-134a56d877de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:43.127852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-18132ae8-d5ff-4e4b-8354-134a56d877de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:43.136454 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 916/1858] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:42 2022] DELETE /identity/v3/projects/031bef13983a42c59123dde52fbb3f0f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:43.136454 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18132ae8-d5ff-4e4b-8354-134a56d877de admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:43.136454 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-18132ae8-d5ff-4e4b-8354-134a56d877de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:43.173347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 943/1859] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:42 2022] DELETE /identity/v3/users/cd2a30a7753943239ab600ad275c527d => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:43.174035 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cc15f-0ee9-4c4a-8e7c-64667d391cf1 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:43.176254 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-795cc15f-0ee9-4c4a-8e7c-64667d391cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:43.219832 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18132ae8-d5ff-4e4b-8354-134a56d877de admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:43.273794 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cc15f-0ee9-4c4a-8e7c-64667d391cf1 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:43.278810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32042cc9-0287-4ea6-aa4b-cdf9e0cd7973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:43.279596 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32042cc9-0287-4ea6-aa4b-cdf9e0cd7973 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:43.279956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32042cc9-0287-4ea6-aa4b-cdf9e0cd7973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:43.280346 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32042cc9-0287-4ea6-aa4b-cdf9e0cd7973 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:43.281299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32042cc9-0287-4ea6-aa4b-cdf9e0cd7973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:43.283007 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32042cc9-0287-4ea6-aa4b-cdf9e0cd7973 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:43.294451 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 944/1860] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:43.296257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517adbfb-cf84-4677-9dd9-267804a44017 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:43.296639 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517adbfb-cf84-4677-9dd9-267804a44017 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:43.296992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517adbfb-cf84-4677-9dd9-267804a44017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:43.312774 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04251612-0884-4d61-a06b-44ac68177257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:43.313701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04251612-0884-4d61-a06b-44ac68177257 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:43.314009 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04251612-0884-4d61-a06b-44ac68177257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:43.314280 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04251612-0884-4d61-a06b-44ac68177257 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:43.315179 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04251612-0884-4d61-a06b-44ac68177257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:43.317163 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04251612-0884-4d61-a06b-44ac68177257 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:43.317785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-517adbfb-cf84-4677-9dd9-267804a44017 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:43.319161 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-517adbfb-cf84-4677-9dd9-267804a44017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:43.328220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:43.330131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 945/1861] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:43.330936 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517adbfb-cf84-4677-9dd9-267804a44017 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:43.332222 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-517adbfb-cf84-4677-9dd9-267804a44017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:43.344312 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517adbfb-cf84-4677-9dd9-267804a44017 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:43.349719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15da50-6fd3-4312-8c34-3301aa1a56f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:43.350783 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15da50-6fd3-4312-8c34-3301aa1a56f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:43.351069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15da50-6fd3-4312-8c34-3301aa1a56f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:43.351350 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15da50-6fd3-4312-8c34-3301aa1a56f9 admin admin] PATH_INFO: `/v3/projects/ca02b8f08e874bb685db0a389352ae8d/users/6fa8e09c6bbf45f2ae542af4c73c6538/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:43.366877 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15da50-6fd3-4312-8c34-3301aa1a56f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca02b8f08e874bb685db0a389352ae8d, user_id=6fa8e09c6bbf45f2ae542af4c73c6538, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:43.369597 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15da50-6fd3-4312-8c34-3301aa1a56f9 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:43.440759 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 917/1862] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:43 2022] POST /identity/v3/users => generated 283 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:43.442256 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d524728-5a90-475b-8718-05797e1132b1 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:43.442646 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d524728-5a90-475b-8718-05797e1132b1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:43.442929 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d524728-5a90-475b-8718-05797e1132b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:43.461725 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-7d524728-5a90-475b-8718-05797e1132b1 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:43.465270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7d524728-5a90-475b-8718-05797e1132b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:43.471015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 918/1863] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:43.472187 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d524728-5a90-475b-8718-05797e1132b1 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:43.481716 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d524728-5a90-475b-8718-05797e1132b1 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:43.492672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 946/1864] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:43 2022] PUT /identity/v3/projects/ca02b8f08e874bb685db0a389352ae8d/users/6fa8e09c6bbf45f2ae542af4c73c6538/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:43.493231 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15da50-6fd3-4312-8c34-3301aa1a56f9 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:43.496612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f6fc9-1e63-44d9-9595-d11ee8bcb530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:43.497998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f6fc9-1e63-44d9-9595-d11ee8bcb530 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:43.498361 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f6fc9-1e63-44d9-9595-d11ee8bcb530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:43.498557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f6fc9-1e63-44d9-9595-d11ee8bcb530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:43.499292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f6fc9-1e63-44d9-9595-d11ee8bcb530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:43.500982 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f6fc9-1e63-44d9-9595-d11ee8bcb530 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:43.512577 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 919/1865] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:43.516525 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f6fc9-1e63-44d9-9595-d11ee8bcb530 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:43.526892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f6fc9-1e63-44d9-9595-d11ee8bcb530 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:43.566092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15da50-6fd3-4312-8c34-3301aa1a56f9 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:43.571507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18c30d-054c-4faa-93e8-acf63cf1dde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:43.572194 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18c30d-054c-4faa-93e8-acf63cf1dde5 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:43.572541 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18c30d-054c-4faa-93e8-acf63cf1dde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:43.572915 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18c30d-054c-4faa-93e8-acf63cf1dde5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:43.573741 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c18c30d-054c-4faa-93e8-acf63cf1dde5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:01:43.574124 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c18c30d-054c-4faa-93e8-acf63cf1dde5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:43.575784 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c18c30d-054c-4faa-93e8-acf63cf1dde5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:43.588470 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 947/1866] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:01:43.589627 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18c30d-054c-4faa-93e8-acf63cf1dde5 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:43.590467 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7277e28-f424-47d3-83e2-831717d638e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:43.591311 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7277e28-f424-47d3-83e2-831717d638e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:43.591780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7277e28-f424-47d3-83e2-831717d638e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:43.592255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7277e28-f424-47d3-83e2-831717d638e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:43.593045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7277e28-f424-47d3-83e2-831717d638e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:43.594654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7277e28-f424-47d3-83e2-831717d638e0 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:43.599581 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18c30d-054c-4faa-93e8-acf63cf1dde5 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:43.604967 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b787c-602e-4428-ba4a-5710317a1e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:43.608274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 920/1867] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:43.608409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b787c-602e-4428-ba4a-5710317a1e03 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:43.608486 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7277e28-f424-47d3-83e2-831717d638e0 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:43.608568 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b787c-602e-4428-ba4a-5710317a1e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:43.608568 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b787c-602e-4428-ba4a-5710317a1e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:43.608568 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b787c-602e-4428-ba4a-5710317a1e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:43.609546 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b787c-602e-4428-ba4a-5710317a1e03 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:43.618952 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7277e28-f424-47d3-83e2-831717d638e0 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:43.629690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22921b9-e2a2-4dc2-adff-de393aec0734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:43.630372 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22921b9-e2a2-4dc2-adff-de393aec0734 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:43.630657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22921b9-e2a2-4dc2-adff-de393aec0734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:43.630933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22921b9-e2a2-4dc2-adff-de393aec0734 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:43.631635 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22921b9-e2a2-4dc2-adff-de393aec0734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:43.634582 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22921b9-e2a2-4dc2-adff-de393aec0734 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:43.637629 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 948/1868] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:43.639830 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b787c-602e-4428-ba4a-5710317a1e03 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:43.653501 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b787c-602e-4428-ba4a-5710317a1e03 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:43.659009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b49cf-0aca-472c-9e80-393ff708c711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:43.660051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b49cf-0aca-472c-9e80-393ff708c711 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:43.660401 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b49cf-0aca-472c-9e80-393ff708c711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:43.660628 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b49cf-0aca-472c-9e80-393ff708c711 admin admin] PATH_INFO: `/v3/projects/ca02b8f08e874bb685db0a389352ae8d/users/6fa8e09c6bbf45f2ae542af4c73c6538/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:43.663984 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b49cf-0aca-472c-9e80-393ff708c711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca02b8f08e874bb685db0a389352ae8d, user_id=6fa8e09c6bbf45f2ae542af4c73c6538, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:43.667276 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b49cf-0aca-472c-9e80-393ff708c711 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:43.680366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 949/1869] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:43 2022] PUT /identity/v3/projects/ca02b8f08e874bb685db0a389352ae8d/users/6fa8e09c6bbf45f2ae542af4c73c6538/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:43.681508 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b49cf-0aca-472c-9e80-393ff708c711 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:43.685180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ea7b49cf-0aca-472c-9e80-393ff708c711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:43.747933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b49cf-0aca-472c-9e80-393ff708c711 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:43.752674 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a25cd-29ed-4770-9621-de3a055feff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:43.753535 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a25cd-29ed-4770-9621-de3a055feff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:43.753814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a25cd-29ed-4770-9621-de3a055feff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:43.754084 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a25cd-29ed-4770-9621-de3a055feff5 admin admin] PATH_INFO: `/v3/projects/e6fd96e46dff446abd9abff7df1ee92f` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:43.755262 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a25cd-29ed-4770-9621-de3a055feff5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6fd96e46dff446abd9abff7df1ee92f)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:43.757389 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a25cd-29ed-4770-9621-de3a055feff5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:43.772985 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 921/1870] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:43 2022] POST /identity/v3/projects => generated 401 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:43.773880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22921b9-e2a2-4dc2-adff-de393aec0734 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:43.853987 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22921b9-e2a2-4dc2-adff-de393aec0734 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:43.868102 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a52a25cd-29ed-4770-9621-de3a055feff5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6fd96e46dff446abd9abff7df1ee92f', 'request_id': 'req-a52a25cd-29ed-4770-9621-de3a055feff5'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:43.874159 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a52a25cd-29ed-4770-9621-de3a055feff5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6fd96e46dff446abd9abff7df1ee92f', 'request_id': 'req-a52a25cd-29ed-4770-9621-de3a055feff5'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:43.881675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a52a25cd-29ed-4770-9621-de3a055feff5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6fd96e46dff446abd9abff7df1ee92f', 'request_id': 'req-a52a25cd-29ed-4770-9621-de3a055feff5'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:43.918896 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b6354-2306-4bc1-922c-4aecc79821b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:43.919812 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b6354-2306-4bc1-922c-4aecc79821b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:43.920100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b6354-2306-4bc1-922c-4aecc79821b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:43.920380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b6354-2306-4bc1-922c-4aecc79821b1 admin admin] PATH_INFO: `/v3/projects/849d06d037af4145b9dcd8f17f95a88d/users/d7a84f4bd0474d47b501ecfff3d5e950/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:43.945597 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b6354-2306-4bc1-922c-4aecc79821b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=849d06d037af4145b9dcd8f17f95a88d, user_id=d7a84f4bd0474d47b501ecfff3d5e950, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:43.948815 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b6354-2306-4bc1-922c-4aecc79821b1 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:43.960511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a52a25cd-29ed-4770-9621-de3a055feff5 admin admin] The token cache is being invalidate because project e6fd96e46dff446abd9abff7df1ee92f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:43.962001 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a52a25cd-29ed-4770-9621-de3a055feff5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:43.962001 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a52a25cd-29ed-4770-9621-de3a055feff5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:43.964079 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 950/1871] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:43 2022] DELETE /identity/v3/projects/e6fd96e46dff446abd9abff7df1ee92f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:43.965478 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d04fea-64c6-4880-8055-d17c517a91a9 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:43.965772 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d04fea-64c6-4880-8055-d17c517a91a9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:43.966098 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d04fea-64c6-4880-8055-d17c517a91a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:43.982613 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:44.006524 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-31d04fea-64c6-4880-8055-d17c517a91a9 None None] MFA Rules not processed for user `6fa8e09c6bbf45f2ae542af4c73c6538`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:44.007845 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-31d04fea-64c6-4880-8055-d17c517a91a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:44.012841 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 922/1872] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:43 2022] PUT /identity/v3/projects/849d06d037af4145b9dcd8f17f95a88d/users/d7a84f4bd0474d47b501ecfff3d5e950/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:44.014023 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b6354-2306-4bc1-922c-4aecc79821b1 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:44.016409 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a28b6354-2306-4bc1-922c-4aecc79821b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:44.100009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 951/1873] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:44.106962 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7a8b3-ff40-4a3d-a715-604db0e011b1 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:44.106962 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7a8b3-ff40-4a3d-a715-604db0e011b1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:44.107103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7a8b3-ff40-4a3d-a715-604db0e011b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:44.107184 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b6354-2306-4bc1-922c-4aecc79821b1 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:44.114315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8f337-1241-4a85-bb1f-2464fa029f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:44.115260 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8f337-1241-4a85-bb1f-2464fa029f89 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:44.115367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8f337-1241-4a85-bb1f-2464fa029f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:44.115624 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8f337-1241-4a85-bb1f-2464fa029f89 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:44.116393 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8f337-1241-4a85-bb1f-2464fa029f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:44.118450 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8f337-1241-4a85-bb1f-2464fa029f89 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:44.127850 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-eef7a8b3-ff40-4a3d-a715-604db0e011b1 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:44.129120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-eef7a8b3-ff40-4a3d-a715-604db0e011b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:44.138410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 952/1874] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:44.139556 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b373c-6fbd-4b0c-866a-1de0e8eda6fe None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:44.139847 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b373c-6fbd-4b0c-866a-1de0e8eda6fe None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:44.140128 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b373c-6fbd-4b0c-866a-1de0e8eda6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:44.171051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-e35b373c-6fbd-4b0c-866a-1de0e8eda6fe None None] MFA Rules not processed for user `d7a84f4bd0474d47b501ecfff3d5e950`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:44.171051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e35b373c-6fbd-4b0c-866a-1de0e8eda6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:44.197674 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 923/1875] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:44 2022] POST /identity/v3/users => generated 301 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:44.208471 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8f337-1241-4a85-bb1f-2464fa029f89 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:44.208471 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:44.208471 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7aa8f337-1241-4a85-bb1f-2464fa029f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:44.235967 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 953/1876] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:44.239179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797315ca-2aed-44dd-849c-53e1871e476a None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:44.239665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797315ca-2aed-44dd-849c-53e1871e476a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:44.239948 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797315ca-2aed-44dd-849c-53e1871e476a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:44.258965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-797315ca-2aed-44dd-849c-53e1871e476a None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:44.260374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-797315ca-2aed-44dd-849c-53e1871e476a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:44.269710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 954/1877] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:44.271179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:44.274695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797315ca-2aed-44dd-849c-53e1871e476a None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:44.279943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8f337-1241-4a85-bb1f-2464fa029f89 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:44.286503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1b85c-81b0-4982-ac6f-89bd731ac835 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:44.287025 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797315ca-2aed-44dd-849c-53e1871e476a None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:44.287906 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1b85c-81b0-4982-ac6f-89bd731ac835 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:44.289002 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1b85c-81b0-4982-ac6f-89bd731ac835 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:44.289485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1b85c-81b0-4982-ac6f-89bd731ac835 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:44.292526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-14d1b85c-81b0-4982-ac6f-89bd731ac835 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:44.293864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a37c6-1d8b-4aa3-9dcb-a61662a8164a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:44.296982 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a37c6-1d8b-4aa3-9dcb-a61662a8164a admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:44.297296 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a37c6-1d8b-4aa3-9dcb-a61662a8164a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:44.297589 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a37c6-1d8b-4aa3-9dcb-a61662a8164a admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:44.298730 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a37c6-1d8b-4aa3-9dcb-a61662a8164a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:44.300769 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a37c6-1d8b-4aa3-9dcb-a61662a8164a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:44.318845 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 955/1878] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:44.318845 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a37c6-1d8b-4aa3-9dcb-a61662a8164a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:44.320621 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c26a37c6-1d8b-4aa3-9dcb-a61662a8164a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:44.335813 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a37c6-1d8b-4aa3-9dcb-a61662a8164a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:44.341808 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a32d9-cf97-4163-af55-da83ada23834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:44.343921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a32d9-cf97-4163-af55-da83ada23834 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:44.343921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a32d9-cf97-4163-af55-da83ada23834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:44.344134 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a32d9-cf97-4163-af55-da83ada23834 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:44.344727 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a32d9-cf97-4163-af55-da83ada23834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:44.346829 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a32d9-cf97-4163-af55-da83ada23834 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:44.379895 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1b85c-81b0-4982-ac6f-89bd731ac835 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:44.381322 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1b85c-81b0-4982-ac6f-89bd731ac835 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:44.390851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 924/1879] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:44.391771 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1b85c-81b0-4982-ac6f-89bd731ac835 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:44.403936 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1b85c-81b0-4982-ac6f-89bd731ac835 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:44.410049 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ba756-3dd0-4080-a1b8-763d12d515cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:44.410991 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ba756-3dd0-4080-a1b8-763d12d515cb admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:44.411343 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ba756-3dd0-4080-a1b8-763d12d515cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:44.411695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ba756-3dd0-4080-a1b8-763d12d515cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:44.412500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ba756-3dd0-4080-a1b8-763d12d515cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:01:44.412961 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ba756-3dd0-4080-a1b8-763d12d515cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:44.415227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ba756-3dd0-4080-a1b8-763d12d515cb admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:44.431453 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 925/1880] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:01:44.431453 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ba756-3dd0-4080-a1b8-763d12d515cb admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:44.440246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ba756-3dd0-4080-a1b8-763d12d515cb admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:44.446251 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0be07-8122-4638-a9bb-bf58a561a9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:44.446927 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0be07-8122-4638-a9bb-bf58a561a9fd admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:44.454785 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0be07-8122-4638-a9bb-bf58a561a9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:44.454785 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0be07-8122-4638-a9bb-bf58a561a9fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:44.454785 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0be07-8122-4638-a9bb-bf58a561a9fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:44.454785 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0be07-8122-4638-a9bb-bf58a561a9fd admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:44.462750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 926/1881] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:44.464008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0be07-8122-4638-a9bb-bf58a561a9fd admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:44.480257 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0be07-8122-4638-a9bb-bf58a561a9fd admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:44.499090 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adf574-74b4-41f8-a34f-6b3362164b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:44.499777 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adf574-74b4-41f8-a34f-6b3362164b8a admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:44.500062 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adf574-74b4-41f8-a34f-6b3362164b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:44.500339 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adf574-74b4-41f8-a34f-6b3362164b8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:44.501088 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adf574-74b4-41f8-a34f-6b3362164b8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:44.503031 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adf574-74b4-41f8-a34f-6b3362164b8a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:44.529431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 956/1882] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:44 2022] POST /identity/v3/projects => generated 361 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:44.529431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a32d9-cf97-4163-af55-da83ada23834 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:44.601036 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a32d9-cf97-4163-af55-da83ada23834 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:44.606052 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06f1e0-aeea-4219-9ab0-8bc363c776ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:44.606939 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06f1e0-aeea-4219-9ab0-8bc363c776ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:44.607227 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06f1e0-aeea-4219-9ab0-8bc363c776ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:44.607505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06f1e0-aeea-4219-9ab0-8bc363c776ea admin admin] PATH_INFO: `/v3/projects/16ad64c7a8f04eb09faca69ed4470cd7/users/57b1cd298c40470bb3fb850b65501f66/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:44.622621 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06f1e0-aeea-4219-9ab0-8bc363c776ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ad64c7a8f04eb09faca69ed4470cd7, user_id=57b1cd298c40470bb3fb850b65501f66, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:44.625354 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06f1e0-aeea-4219-9ab0-8bc363c776ea admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:44.655813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 927/1883] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:44 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:44.655813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adf574-74b4-41f8-a34f-6b3362164b8a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:44.713020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adf574-74b4-41f8-a34f-6b3362164b8a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:44.718062 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e378a9-0a96-418d-99c1-ff69b1d9f276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:44.719403 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e378a9-0a96-418d-99c1-ff69b1d9f276 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:44.719403 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e378a9-0a96-418d-99c1-ff69b1d9f276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:44.719638 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e378a9-0a96-418d-99c1-ff69b1d9f276 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:44.720303 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e378a9-0a96-418d-99c1-ff69b1d9f276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:44.722585 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e378a9-0a96-418d-99c1-ff69b1d9f276 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:44.739450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 957/1884] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:44 2022] PUT /identity/v3/projects/16ad64c7a8f04eb09faca69ed4470cd7/users/57b1cd298c40470bb3fb850b65501f66/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:44.740980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06f1e0-aeea-4219-9ab0-8bc363c776ea admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:44.812716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06f1e0-aeea-4219-9ab0-8bc363c776ea admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:44.817681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d9a78-2bdc-4f35-a774-fcb5ea2058df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:44.818369 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d9a78-2bdc-4f35-a774-fcb5ea2058df admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:44.818658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d9a78-2bdc-4f35-a774-fcb5ea2058df admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:44.818947 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d9a78-2bdc-4f35-a774-fcb5ea2058df admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:44.820225 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d9a78-2bdc-4f35-a774-fcb5ea2058df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:44.822258 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d9a78-2bdc-4f35-a774-fcb5ea2058df admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:44.838801 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 928/1885] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:44 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:44.838801 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0324c-0b3a-440f-a80b-f3d5404e5d58 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:44.838801 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0324c-0b3a-440f-a80b-f3d5404e5d58 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:44.838801 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0324c-0b3a-440f-a80b-f3d5404e5d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:44.865771 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d3b0324c-0b3a-440f-a80b-f3d5404e5d58 None None] MFA Rules not processed for user `57b1cd298c40470bb3fb850b65501f66`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:44.867596 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d3b0324c-0b3a-440f-a80b-f3d5404e5d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:44.922859 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 958/1886] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:44 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:44.924608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d9a78-2bdc-4f35-a774-fcb5ea2058df admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:44.939771 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d9a78-2bdc-4f35-a774-fcb5ea2058df admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:44.941081 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 929/1887] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:44.946021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0324c-0b3a-440f-a80b-f3d5404e5d58 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:44.946863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6c3d1-c26d-4696-a84d-dce76cfb6f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:44.948010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6c3d1-c26d-4696-a84d-dce76cfb6f3d admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:44.948504 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6c3d1-c26d-4696-a84d-dce76cfb6f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:44.949004 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6c3d1-c26d-4696-a84d-dce76cfb6f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:44.949915 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6c3d1-c26d-4696-a84d-dce76cfb6f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:44.952151 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6c3d1-c26d-4696-a84d-dce76cfb6f3d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:44.956815 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0324c-0b3a-440f-a80b-f3d5404e5d58 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:44.965527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb20459-8332-49b3-93e4-49ac7df7345a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:44.965527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb20459-8332-49b3-93e4-49ac7df7345a admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:44.965527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb20459-8332-49b3-93e4-49ac7df7345a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:44.965527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb20459-8332-49b3-93e4-49ac7df7345a admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:44.966076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb20459-8332-49b3-93e4-49ac7df7345a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:44.966076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb20459-8332-49b3-93e4-49ac7df7345a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:44.969146 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 959/1888] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:44.970815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6c3d1-c26d-4696-a84d-dce76cfb6f3d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:44.983288 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6c3d1-c26d-4696-a84d-dce76cfb6f3d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:44.984324 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 930/1889] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:44.985241 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb20459-8332-49b3-93e4-49ac7df7345a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:45.002306 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c46c1-f015-4191-9722-42116d7a7efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:45.002306 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c46c1-f015-4191-9722-42116d7a7efd admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:45.002564 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb20459-8332-49b3-93e4-49ac7df7345a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:45.002656 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c46c1-f015-4191-9722-42116d7a7efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:45.002656 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c46c1-f015-4191-9722-42116d7a7efd admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:45.003351 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c46c1-f015-4191-9722-42116d7a7efd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:45.006000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c46c1-f015-4191-9722-42116d7a7efd admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:45.009449 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7bfa5-d14a-4eb9-853a-04cf2cf8897f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:45.011670 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7bfa5-d14a-4eb9-853a-04cf2cf8897f admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:45.011958 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7bfa5-d14a-4eb9-853a-04cf2cf8897f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:45.012245 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7bfa5-d14a-4eb9-853a-04cf2cf8897f admin admin] PATH_INFO: `/v3/projects/d2f7406fa0da47afbc57d5b113cc30d1/users/740279a81ba74553a7639a7659c6ec37/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:45.029833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7bfa5-d14a-4eb9-853a-04cf2cf8897f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f7406fa0da47afbc57d5b113cc30d1, user_id=740279a81ba74553a7639a7659c6ec37, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:45.033420 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7bfa5-d14a-4eb9-853a-04cf2cf8897f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:45.129515 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 960/1890] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:44 2022] POST /identity/v3/projects => generated 401 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:45.130719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c46c1-f015-4191-9722-42116d7a7efd admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:45.138324 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 931/1891] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:44 2022] PUT /identity/v3/projects/d2f7406fa0da47afbc57d5b113cc30d1/users/740279a81ba74553a7639a7659c6ec37/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:45.144659 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7bfa5-d14a-4eb9-853a-04cf2cf8897f admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:45.229609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c46c1-f015-4191-9722-42116d7a7efd admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:45.234655 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e9f32-4a81-46b4-9a0d-5031c562082d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:45.235357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e9f32-4a81-46b4-9a0d-5031c562082d admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:45.235647 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e9f32-4a81-46b4-9a0d-5031c562082d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:45.235995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e9f32-4a81-46b4-9a0d-5031c562082d admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:45.237429 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e9f32-4a81-46b4-9a0d-5031c562082d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:45.239091 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e9f32-4a81-46b4-9a0d-5031c562082d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:45.256558 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 961/1892] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:45.258098 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e9f32-4a81-46b4-9a0d-5031c562082d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:45.269600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e9f32-4a81-46b4-9a0d-5031c562082d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:45.276119 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf19f3-84da-4f35-885c-7eaa5629c212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:45.276857 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf19f3-84da-4f35-885c-7eaa5629c212 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:45.277147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf19f3-84da-4f35-885c-7eaa5629c212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:45.277429 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf19f3-84da-4f35-885c-7eaa5629c212 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:45.278176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf19f3-84da-4f35-885c-7eaa5629c212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:45.279816 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf19f3-84da-4f35-885c-7eaa5629c212 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:45.292398 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 962/1893] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:45.293396 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf19f3-84da-4f35-885c-7eaa5629c212 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:45.299029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7bfa5-d14a-4eb9-853a-04cf2cf8897f admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:45.314996 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efe2ae-f99a-466a-864e-077a64ee547e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:45.316866 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efe2ae-f99a-466a-864e-077a64ee547e admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:45.317466 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efe2ae-f99a-466a-864e-077a64ee547e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:45.317875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efe2ae-f99a-466a-864e-077a64ee547e admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:45.321954 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efe2ae-f99a-466a-864e-077a64ee547e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:45.321954 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efe2ae-f99a-466a-864e-077a64ee547e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:45.322153 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf19f3-84da-4f35-885c-7eaa5629c212 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:45.328925 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad49a0a-4cf2-4879-92c6-ced4a4b45246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:45.330413 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad49a0a-4cf2-4879-92c6-ced4a4b45246 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:45.331192 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad49a0a-4cf2-4879-92c6-ced4a4b45246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:45.333607 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad49a0a-4cf2-4879-92c6-ced4a4b45246 admin admin] PATH_INFO: `/v3/projects/073ebac5ad2d48989bd5f60f3e77f07d/users/1512808a4cfa45c892f4a861aa6951a4/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:45.364442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad49a0a-4cf2-4879-92c6-ced4a4b45246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=073ebac5ad2d48989bd5f60f3e77f07d, user_id=1512808a4cfa45c892f4a861aa6951a4, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:45.368731 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad49a0a-4cf2-4879-92c6-ced4a4b45246 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:45.458826 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 932/1894] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:45 2022] POST /identity/v3/users => generated 307 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:45.460844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 963/1895] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:45 2022] PUT /identity/v3/projects/073ebac5ad2d48989bd5f60f3e77f07d/users/1512808a4cfa45c892f4a861aa6951a4/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:45.461657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efe2ae-f99a-466a-864e-077a64ee547e admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:45.462019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad49a0a-4cf2-4879-92c6-ced4a4b45246 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:45.478089 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efe2ae-f99a-466a-864e-077a64ee547e admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:45.510053 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:45.576830 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf7edc-5da1-45bb-b5ff-c3404cc0e3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:45.577844 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf7edc-5da1-45bb-b5ff-c3404cc0e3be admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:45.578206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf7edc-5da1-45bb-b5ff-c3404cc0e3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:45.578977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf7edc-5da1-45bb-b5ff-c3404cc0e3be admin admin] PATH_INFO: `/v3/projects/d2f7406fa0da47afbc57d5b113cc30d1/users/740279a81ba74553a7639a7659c6ec37/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:45.582164 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf7edc-5da1-45bb-b5ff-c3404cc0e3be admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f7406fa0da47afbc57d5b113cc30d1, user_id=740279a81ba74553a7639a7659c6ec37, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:45.586200 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf7edc-5da1-45bb-b5ff-c3404cc0e3be admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:45.587045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad49a0a-4cf2-4879-92c6-ced4a4b45246 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:45.592497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa1e91-d050-4b86-9ad0-a1870d902f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:45.593207 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa1e91-d050-4b86-9ad0-a1870d902f3b admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:45.593495 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa1e91-d050-4b86-9ad0-a1870d902f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:45.593790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa1e91-d050-4b86-9ad0-a1870d902f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:45.594626 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa1e91-d050-4b86-9ad0-a1870d902f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:45.596450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa1e91-d050-4b86-9ad0-a1870d902f3b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:45.606468 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 933/1896] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:45 2022] PUT /identity/v3/projects/d2f7406fa0da47afbc57d5b113cc30d1/users/740279a81ba74553a7639a7659c6ec37/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:45.608697 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdd8d1-2d5a-4966-a4f5-51b10e75d554 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:45.609303 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdd8d1-2d5a-4966-a4f5-51b10e75d554 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:45.609920 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdd8d1-2d5a-4966-a4f5-51b10e75d554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:45.620132 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 964/1897] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:45.621581 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725596a-b4b9-4efd-add9-dd5b03fb7ea5 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:45.622525 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725596a-b4b9-4efd-add9-dd5b03fb7ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:45.623150 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725596a-b4b9-4efd-add9-dd5b03fb7ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:45.653479 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-42fdd8d1-2d5a-4966-a4f5-51b10e75d554 None None] MFA Rules not processed for user `1512808a4cfa45c892f4a861aa6951a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:45.656303 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-42fdd8d1-2d5a-4966-a4f5-51b10e75d554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:45.664949 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-9725596a-b4b9-4efd-add9-dd5b03fb7ea5 None None] MFA Rules not processed for user `740279a81ba74553a7639a7659c6ec37`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:45.666289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9725596a-b4b9-4efd-add9-dd5b03fb7ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:45.762723 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 934/1898] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:45.763734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdd8d1-2d5a-4966-a4f5-51b10e75d554 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:45.796651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 965/1899] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:45 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:45.796651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b224cda-38f8-449c-b726-43199265bea8 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:45.796651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b224cda-38f8-449c-b726-43199265bea8 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:45.796651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b224cda-38f8-449c-b726-43199265bea8 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:45.798906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 966/1900] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jul 5 13:01:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 13:01:45.800495 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b224cda-38f8-449c-b726-43199265bea8 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:45.861107 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:45.876745 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdd8d1-2d5a-4966-a4f5-51b10e75d554 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:45.881658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabee6a2-6d40-4475-b8c0-6b6a4f160799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:45.883373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabee6a2-6d40-4475-b8c0-6b6a4f160799 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:45.883731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabee6a2-6d40-4475-b8c0-6b6a4f160799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:45.884026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabee6a2-6d40-4475-b8c0-6b6a4f160799 admin admin] PATH_INFO: `/v3/projects/a88ca5e3fe294f68a146cf059943ba32/users/c517be9e04ed4205b226575973f5f274/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:45.897805 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b224cda-38f8-449c-b726-43199265bea8 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:45.902664 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabee6a2-6d40-4475-b8c0-6b6a4f160799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a88ca5e3fe294f68a146cf059943ba32, user_id=c517be9e04ed4205b226575973f5f274, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:45.903227 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfea30f-0d25-42bb-b7a2-a326d1d9c785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:45.904334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfea30f-0d25-42bb-b7a2-a326d1d9c785 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:45.904714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfea30f-0d25-42bb-b7a2-a326d1d9c785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:45.905056 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfea30f-0d25-42bb-b7a2-a326d1d9c785 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:45.905888 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfea30f-0d25-42bb-b7a2-a326d1d9c785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:45.906101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabee6a2-6d40-4475-b8c0-6b6a4f160799 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:45.907987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfea30f-0d25-42bb-b7a2-a326d1d9c785 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:46.000192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 935/1901] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:45 2022] PUT /identity/v3/projects/a88ca5e3fe294f68a146cf059943ba32/users/c517be9e04ed4205b226575973f5f274/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:46.009916 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabee6a2-6d40-4475-b8c0-6b6a4f160799 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:46.048860 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 967/1902] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:45 2022] POST /identity/v3/projects => generated 379 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:46.050974 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fec98-1036-42bd-b6a8-fe1da76f120b None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:46.057634 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fec98-1036-42bd-b6a8-fe1da76f120b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:46.057634 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fec98-1036-42bd-b6a8-fe1da76f120b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:46.066790 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabee6a2-6d40-4475-b8c0-6b6a4f160799 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:46.076878 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a30fec98-1036-42bd-b6a8-fe1da76f120b None None] MFA Rules not processed for user `cdf37a42279a466b85906b23751f9c22`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:46.078198 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a30fec98-1036-42bd-b6a8-fe1da76f120b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:46.128215 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad6aa4-32f7-450d-addd-6c529f435499 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:46.129126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad6aa4-32f7-450d-addd-6c529f435499 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:46.129245 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad6aa4-32f7-450d-addd-6c529f435499 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:46.129456 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad6aa4-32f7-450d-addd-6c529f435499 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:46.151771 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 968/1903] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jul 5 13:01:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:46.152733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fec98-1036-42bd-b6a8-fe1da76f120b None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:46.223886 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad6aa4-32f7-450d-addd-6c529f435499 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:46.225686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad6aa4-32f7-450d-addd-6c529f435499 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:46.228301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fec98-1036-42bd-b6a8-fe1da76f120b None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:46.237509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 936/1904] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:46 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:46.238407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad6aa4-32f7-450d-addd-6c529f435499 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:46.250973 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a7f2f-877c-437a-9534-fe961302bc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:46.250973 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a7f2f-877c-437a-9534-fe961302bc8f admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:46.250973 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a7f2f-877c-437a-9534-fe961302bc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:46.250973 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a7f2f-877c-437a-9534-fe961302bc8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:46.251306 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a7f2f-877c-437a-9534-fe961302bc8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:46.258739 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a7f2f-877c-437a-9534-fe961302bc8f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:46.259017 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad6aa4-32f7-450d-addd-6c529f435499 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:46.264569 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030d209-cd61-4293-a13c-539b74ca3520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:46.265357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030d209-cd61-4293-a13c-539b74ca3520 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:46.265711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030d209-cd61-4293-a13c-539b74ca3520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:46.266068 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030d209-cd61-4293-a13c-539b74ca3520 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:46.266844 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030d209-cd61-4293-a13c-539b74ca3520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:46.268924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030d209-cd61-4293-a13c-539b74ca3520 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:46.282393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 969/1905] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:46.283446 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a7f2f-877c-437a-9534-fe961302bc8f admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:46.285502 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-859a7f2f-877c-437a-9534-fe961302bc8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:46.303989 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a7f2f-877c-437a-9534-fe961302bc8f admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:46.313785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa5c35-7dde-4208-851f-1598dbd71290 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:46.315110 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa5c35-7dde-4208-851f-1598dbd71290 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:46.315469 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa5c35-7dde-4208-851f-1598dbd71290 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:46.315818 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa5c35-7dde-4208-851f-1598dbd71290 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:46.327570 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa5c35-7dde-4208-851f-1598dbd71290 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:46.328937 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa5c35-7dde-4208-851f-1598dbd71290 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:46.340512 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 970/1906] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:46.344838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa5c35-7dde-4208-851f-1598dbd71290 service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:46.355584 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa5c35-7dde-4208-851f-1598dbd71290 service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:46.360429 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a2af2-978a-47aa-b061-a91e49b38085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:46.363972 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a2af2-978a-47aa-b061-a91e49b38085 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:46.363972 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a2af2-978a-47aa-b061-a91e49b38085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:46.363972 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a2af2-978a-47aa-b061-a91e49b38085 admin admin] PATH_INFO: `/v3/projects/a88ca5e3fe294f68a146cf059943ba32/users/c517be9e04ed4205b226575973f5f274/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:46.364250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a2af2-978a-47aa-b061-a91e49b38085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a88ca5e3fe294f68a146cf059943ba32, user_id=c517be9e04ed4205b226575973f5f274, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:46.367578 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a2af2-978a-47aa-b061-a91e49b38085 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:46.396823 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 971/1907] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:46 2022] PUT /identity/v3/projects/a88ca5e3fe294f68a146cf059943ba32/users/c517be9e04ed4205b226575973f5f274/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:46.407970 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9bbc7-9bbb-4adc-bdb7-fec1044f0a11 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:46.408921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9bbc7-9bbb-4adc-bdb7-fec1044f0a11 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:46.409271 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9bbc7-9bbb-4adc-bdb7-fec1044f0a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:46.424285 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 937/1908] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:46 2022] POST /identity/v3/users => generated 296 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:46.428157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030d209-cd61-4293-a13c-539b74ca3520 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:46.441338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030d209-cd61-4293-a13c-539b74ca3520 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:46.444918 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-f9e9bbc7-9bbb-4adc-bdb7-fec1044f0a11 None None] MFA Rules not processed for user `c517be9e04ed4205b226575973f5f274`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:46.446719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f9e9bbc7-9bbb-4adc-bdb7-fec1044f0a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:46.527302 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b6f42-0fbe-4c4e-9086-8e93aedf7112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:46.528265 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b6f42-0fbe-4c4e-9086-8e93aedf7112 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:46.528551 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b6f42-0fbe-4c4e-9086-8e93aedf7112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:46.528891 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b6f42-0fbe-4c4e-9086-8e93aedf7112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:46.529646 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b6f42-0fbe-4c4e-9086-8e93aedf7112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:46.531288 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b6f42-0fbe-4c4e-9086-8e93aedf7112 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:46.544244 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 972/1909] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:46 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:01:46.546298 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 938/1910] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:01:46.547311 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9bbc7-9bbb-4adc-bdb7-fec1044f0a11 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:46.553096 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b6f42-0fbe-4c4e-9086-8e93aedf7112 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:46.580218 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b6f42-0fbe-4c4e-9086-8e93aedf7112 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:46.596408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ce78e-5a4b-437b-aecf-be1ecf83cb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:46.597652 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ce78e-5a4b-437b-aecf-be1ecf83cb77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:46.598169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ce78e-5a4b-437b-aecf-be1ecf83cb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:46.598655 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ce78e-5a4b-437b-aecf-be1ecf83cb77 admin admin] PATH_INFO: `/v3/projects/c8e9a5868e3047c58a5277ff0298f341/users/536432d7ed454ad68c1153e98c3785e6/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:46.625260 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ce78e-5a4b-437b-aecf-be1ecf83cb77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e9a5868e3047c58a5277ff0298f341, user_id=536432d7ed454ad68c1153e98c3785e6, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:46.628163 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ce78e-5a4b-437b-aecf-be1ecf83cb77 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:46.665226 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9bbc7-9bbb-4adc-bdb7-fec1044f0a11 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:46.669022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e4aa1-9ebf-449b-9675-6c0b3dc154f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:46.669784 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e4aa1-9ebf-449b-9675-6c0b3dc154f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:46.670071 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e4aa1-9ebf-449b-9675-6c0b3dc154f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:46.670395 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e4aa1-9ebf-449b-9675-6c0b3dc154f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:46.732826 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 939/1911] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:46 2022] PUT /identity/v3/projects/c8e9a5868e3047c58a5277ff0298f341/users/536432d7ed454ad68c1153e98c3785e6/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:46.734905 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ce78e-5a4b-437b-aecf-be1ecf83cb77 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:46.825357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e4aa1-9ebf-449b-9675-6c0b3dc154f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:46.830533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e4aa1-9ebf-449b-9675-6c0b3dc154f6 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:46.861092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 973/1912] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:46.881358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ce78e-5a4b-437b-aecf-be1ecf83cb77 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:46.890226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf4282-66c5-498d-bc96-15a879e42883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:46.891201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf4282-66c5-498d-bc96-15a879e42883 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:46.891669 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf4282-66c5-498d-bc96-15a879e42883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:46.891984 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf4282-66c5-498d-bc96-15a879e42883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:46.892742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf4282-66c5-498d-bc96-15a879e42883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:46.897559 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf4282-66c5-498d-bc96-15a879e42883 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:46.920553 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 940/1913] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:01:46.925442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e4aa1-9ebf-449b-9675-6c0b3dc154f6 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:46.938935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e4aa1-9ebf-449b-9675-6c0b3dc154f6 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:46.961726 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b5fc2-9f44-40fa-a6dc-bf879917f973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:46.965818 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b5fc2-9f44-40fa-a6dc-bf879917f973 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:46.967424 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b5fc2-9f44-40fa-a6dc-bf879917f973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:46.967903 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b5fc2-9f44-40fa-a6dc-bf879917f973 admin admin] PATH_INFO: `/v3/projects/c8e9a5868e3047c58a5277ff0298f341/users/536432d7ed454ad68c1153e98c3785e6/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:46.969642 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf4282-66c5-498d-bc96-15a879e42883 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:46.971994 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b5fc2-9f44-40fa-a6dc-bf879917f973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e9a5868e3047c58a5277ff0298f341, user_id=536432d7ed454ad68c1153e98c3785e6, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:46.972524 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1acf4282-66c5-498d-bc96-15a879e42883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:46.978129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b5fc2-9f44-40fa-a6dc-bf879917f973 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:46.999774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 974/1914] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:46 2022] PUT /identity/v3/projects/c8e9a5868e3047c58a5277ff0298f341/users/536432d7ed454ad68c1153e98c3785e6/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:47.009861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1ce3f-7294-4dea-9549-daf5d87560fd None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:47.010157 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1ce3f-7294-4dea-9549-daf5d87560fd None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:47.010445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1ce3f-7294-4dea-9549-daf5d87560fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:47.039861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-40a1ce3f-7294-4dea-9549-daf5d87560fd None None] MFA Rules not processed for user `536432d7ed454ad68c1153e98c3785e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:47.041198 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-40a1ce3f-7294-4dea-9549-daf5d87560fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:47.070066 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf4282-66c5-498d-bc96-15a879e42883 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:47.141479 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e81aeb-062f-4219-9212-a3f5024164e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:47.147805 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e81aeb-062f-4219-9212-a3f5024164e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:47.147805 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e81aeb-062f-4219-9212-a3f5024164e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:47.147805 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e81aeb-062f-4219-9212-a3f5024164e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:47.203170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 975/1915] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:01:47.214068 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e81aeb-062f-4219-9212-a3f5024164e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:47.215532 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e81aeb-062f-4219-9212-a3f5024164e6 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:47.226009 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 941/1916] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:46 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:47.383028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1ce3f-7294-4dea-9549-daf5d87560fd None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:47.393324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1ce3f-7294-4dea-9549-daf5d87560fd None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:47.398797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad9015-55f3-448c-a342-48386ae4af08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:47.399927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad9015-55f3-448c-a342-48386ae4af08 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:47.399927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad9015-55f3-448c-a342-48386ae4af08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:47.400118 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad9015-55f3-448c-a342-48386ae4af08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:47.415361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad9015-55f3-448c-a342-48386ae4af08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:47.416998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad9015-55f3-448c-a342-48386ae4af08 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:47.428520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 976/1917] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:47.595203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e81aeb-062f-4219-9212-a3f5024164e6 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:47.605025 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e81aeb-062f-4219-9212-a3f5024164e6 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:47.610831 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9d0c1-fe29-4592-a6cf-9d2380f2e544 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:47.611991 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9d0c1-fe29-4592-a6cf-9d2380f2e544 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:47.612390 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9d0c1-fe29-4592-a6cf-9d2380f2e544 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:47.613448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9d0c1-fe29-4592-a6cf-9d2380f2e544 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:47.691442 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9d0c1-fe29-4592-a6cf-9d2380f2e544 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:47.691442 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9d0c1-fe29-4592-a6cf-9d2380f2e544 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:47.701839 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 942/1918] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:47 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:48.045014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad9015-55f3-448c-a342-48386ae4af08 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:48.111748 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad9015-55f3-448c-a342-48386ae4af08 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:48.118272 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd7785-0423-4e46-b77e-5acf718cf3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:48.119170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd7785-0423-4e46-b77e-5acf718cf3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:48.119452 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd7785-0423-4e46-b77e-5acf718cf3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:48.119724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd7785-0423-4e46-b77e-5acf718cf3a8 admin admin] PATH_INFO: `/v3/users/1512808a4cfa45c892f4a861aa6951a4` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:48.120994 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd7785-0423-4e46-b77e-5acf718cf3a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1512808a4cfa45c892f4a861aa6951a4)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:48.122952 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd7785-0423-4e46-b77e-5acf718cf3a8 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:48.362079 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ffcd7785-0423-4e46-b77e-5acf718cf3a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1512808a4cfa45c892f4a861aa6951a4'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:48.371740 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ffcd7785-0423-4e46-b77e-5acf718cf3a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1512808a4cfa45c892f4a861aa6951a4'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:48.373062 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ffcd7785-0423-4e46-b77e-5acf718cf3a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1512808a4cfa45c892f4a861aa6951a4'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:48.374615 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ffcd7785-0423-4e46-b77e-5acf718cf3a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1512808a4cfa45c892f4a861aa6951a4'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:48.396782 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ffcd7785-0423-4e46-b77e-5acf718cf3a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1512808a4cfa45c892f4a861aa6951a4'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:48.411548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:48.471400 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 977/1919] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:48 2022] DELETE /identity/v3/users/1512808a4cfa45c892f4a861aa6951a4 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:48.476572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccddad-c69f-481b-8cca-014109bf7462 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:48.476980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccddad-c69f-481b-8cca-014109bf7462 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:48.477587 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccddad-c69f-481b-8cca-014109bf7462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:48.501063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e5ccddad-c69f-481b-8cca-014109bf7462 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:48.502467 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e5ccddad-c69f-481b-8cca-014109bf7462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:48.565630 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 943/1920] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:48.575600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd7785-0423-4e46-b77e-5acf718cf3a8 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:48.576988 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ffcd7785-0423-4e46-b77e-5acf718cf3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:48.622620 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:48.640008 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd7785-0423-4e46-b77e-5acf718cf3a8 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:48.643894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af7c79-24d1-439a-b943-2cd458222ba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:48.644830 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af7c79-24d1-439a-b943-2cd458222ba7 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:48.645230 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af7c79-24d1-439a-b943-2cd458222ba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:48.645790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af7c79-24d1-439a-b943-2cd458222ba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:48.656063 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af7c79-24d1-439a-b943-2cd458222ba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:48.657545 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af7c79-24d1-439a-b943-2cd458222ba7 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:48.667813 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 978/1921] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:49.135157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccddad-c69f-481b-8cca-014109bf7462 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:49.136624 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e5ccddad-c69f-481b-8cca-014109bf7462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:49.148896 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccddad-c69f-481b-8cca-014109bf7462 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:49.154013 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b51a4d-855a-4002-bbed-e93e173b9da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:49.154936 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b51a4d-855a-4002-bbed-e93e173b9da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:49.155253 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b51a4d-855a-4002-bbed-e93e173b9da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:49.155416 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b51a4d-855a-4002-bbed-e93e173b9da0 admin admin] PATH_INFO: `/v3/projects/073ebac5ad2d48989bd5f60f3e77f07d` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:49.156642 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b51a4d-855a-4002-bbed-e93e173b9da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=073ebac5ad2d48989bd5f60f3e77f07d)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:49.158547 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b51a4d-855a-4002-bbed-e93e173b9da0 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:49.275200 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-04b51a4d-855a-4002-bbed-e93e173b9da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073ebac5ad2d48989bd5f60f3e77f07d', 'request_id': 'req-04b51a4d-855a-4002-bbed-e93e173b9da0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:49.383651 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-04b51a4d-855a-4002-bbed-e93e173b9da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073ebac5ad2d48989bd5f60f3e77f07d', 'request_id': 'req-04b51a4d-855a-4002-bbed-e93e173b9da0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:49.390849 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-04b51a4d-855a-4002-bbed-e93e173b9da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073ebac5ad2d48989bd5f60f3e77f07d', 'request_id': 'req-04b51a4d-855a-4002-bbed-e93e173b9da0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:49.405347 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-04b51a4d-855a-4002-bbed-e93e173b9da0 admin admin] The token cache is being invalidate because project 073ebac5ad2d48989bd5f60f3e77f07d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:49.405729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-04b51a4d-855a-4002-bbed-e93e173b9da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:49.406480 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-04b51a4d-855a-4002-bbed-e93e173b9da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:49.408566 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 944/1922] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:49 2022] DELETE /identity/v3/projects/073ebac5ad2d48989bd5f60f3e77f07d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:49.414728 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af7c79-24d1-439a-b943-2cd458222ba7 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:49.427514 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af7c79-24d1-439a-b943-2cd458222ba7 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:49.499420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61ca60-d596-42b9-a693-237e820aeb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:49.500450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61ca60-d596-42b9-a693-237e820aeb2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:49.500833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61ca60-d596-42b9-a693-237e820aeb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:49.501177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61ca60-d596-42b9-a693-237e820aeb2c admin admin] PATH_INFO: `/v3/users/536432d7ed454ad68c1153e98c3785e6` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:49.502717 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61ca60-d596-42b9-a693-237e820aeb2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=536432d7ed454ad68c1153e98c3785e6)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:49.505293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61ca60-d596-42b9-a693-237e820aeb2c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:49.724898 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2b61ca60-d596-42b9-a693-237e820aeb2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536432d7ed454ad68c1153e98c3785e6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:49.733655 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2b61ca60-d596-42b9-a693-237e820aeb2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536432d7ed454ad68c1153e98c3785e6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:49.734357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2b61ca60-d596-42b9-a693-237e820aeb2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536432d7ed454ad68c1153e98c3785e6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:49.734973 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2b61ca60-d596-42b9-a693-237e820aeb2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536432d7ed454ad68c1153e98c3785e6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:49.748878 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2b61ca60-d596-42b9-a693-237e820aeb2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536432d7ed454ad68c1153e98c3785e6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:49.851813 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 979/1923] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:49 2022] DELETE /identity/v3/users/536432d7ed454ad68c1153e98c3785e6 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:50.034473 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:50.154736 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:50.414812 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b51a4d-855a-4002-bbed-e93e173b9da0 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:50.416826 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-04b51a4d-855a-4002-bbed-e93e173b9da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:50.435454 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b51a4d-855a-4002-bbed-e93e173b9da0 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:50.517479 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61ca60-d596-42b9-a693-237e820aeb2c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:50.519483 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2b61ca60-d596-42b9-a693-237e820aeb2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:50.531049 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1620b69-f821-4537-9212-a6e551b3c242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:50.532062 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1620b69-f821-4537-9212-a6e551b3c242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:50.532490 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1620b69-f821-4537-9212-a6e551b3c242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:50.532863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1620b69-f821-4537-9212-a6e551b3c242 admin admin] PATH_INFO: `/v3/projects/c8e9a5868e3047c58a5277ff0298f341` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:50.534267 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1620b69-f821-4537-9212-a6e551b3c242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e9a5868e3047c58a5277ff0298f341)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:50.536608 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1620b69-f821-4537-9212-a6e551b3c242 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:50.621543 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61ca60-d596-42b9-a693-237e820aeb2c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:50.627674 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73417f2-85f4-44bb-ba29-294d47b49dc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:50.628428 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73417f2-85f4-44bb-ba29-294d47b49dc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:50.629092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73417f2-85f4-44bb-ba29-294d47b49dc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:50.629549 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73417f2-85f4-44bb-ba29-294d47b49dc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:50.632105 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d73417f2-85f4-44bb-ba29-294d47b49dc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:50.740518 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73417f2-85f4-44bb-ba29-294d47b49dc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:50.745207 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73417f2-85f4-44bb-ba29-294d47b49dc7 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:50.760942 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c1620b69-f821-4537-9212-a6e551b3c242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e9a5868e3047c58a5277ff0298f341', 'request_id': 'req-c1620b69-f821-4537-9212-a6e551b3c242'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:50.774215 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 980/1924] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:50.937330 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c1620b69-f821-4537-9212-a6e551b3c242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e9a5868e3047c58a5277ff0298f341', 'request_id': 'req-c1620b69-f821-4537-9212-a6e551b3c242'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:50.946710 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c1620b69-f821-4537-9212-a6e551b3c242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e9a5868e3047c58a5277ff0298f341', 'request_id': 'req-c1620b69-f821-4537-9212-a6e551b3c242'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:50.965878 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c1620b69-f821-4537-9212-a6e551b3c242 admin admin] The token cache is being invalidate because project c8e9a5868e3047c58a5277ff0298f341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:50.966678 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c1620b69-f821-4537-9212-a6e551b3c242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:50.967605 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c1620b69-f821-4537-9212-a6e551b3c242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:50.969825 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 945/1925] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:50 2022] DELETE /identity/v3/projects/c8e9a5868e3047c58a5277ff0298f341 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:50.975234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7193da0-acbe-46dd-bbc0-09af74552097 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:50.976086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7193da0-acbe-46dd-bbc0-09af74552097 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:50.976621 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7193da0-acbe-46dd-bbc0-09af74552097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:50.998852 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b7193da0-acbe-46dd-bbc0-09af74552097 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:51.000211 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b7193da0-acbe-46dd-bbc0-09af74552097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:51.068754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 981/1926] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:51.077859 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e12ef-65c7-48a6-b756-9a9cba1f4601 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:51.078549 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e12ef-65c7-48a6-b756-9a9cba1f4601 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:51.078549 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e12ef-65c7-48a6-b756-9a9cba1f4601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:51.098460 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e76e12ef-65c7-48a6-b756-9a9cba1f4601 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:51.099792 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e76e12ef-65c7-48a6-b756-9a9cba1f4601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:51.108948 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 946/1927] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:01:51.113791 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7193da0-acbe-46dd-bbc0-09af74552097 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:51.125516 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7193da0-acbe-46dd-bbc0-09af74552097 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:51.130722 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e2006-d9db-4e3a-931c-ea754d569857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:51.131507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e2006-d9db-4e3a-931c-ea754d569857 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:51.131866 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e2006-d9db-4e3a-931c-ea754d569857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:51.132132 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e2006-d9db-4e3a-931c-ea754d569857 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:51.132904 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e2006-d9db-4e3a-931c-ea754d569857 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:01:51.137673 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e2006-d9db-4e3a-931c-ea754d569857 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:51.137673 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e2006-d9db-4e3a-931c-ea754d569857 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:51.151618 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 982/1928] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:01:51.152387 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e12ef-65c7-48a6-b756-9a9cba1f4601 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:51.161874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e12ef-65c7-48a6-b756-9a9cba1f4601 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:51.168947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac85a1-8317-473c-aac7-a4db18c01101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:51.169943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac85a1-8317-473c-aac7-a4db18c01101 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:51.170229 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac85a1-8317-473c-aac7-a4db18c01101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:51.170583 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac85a1-8317-473c-aac7-a4db18c01101 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:51.171305 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac85a1-8317-473c-aac7-a4db18c01101 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:51.173249 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac85a1-8317-473c-aac7-a4db18c01101 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:51.339867 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 947/1929] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:51 2022] POST /identity/v3/projects => generated 381 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:01:51.344120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e2006-d9db-4e3a-931c-ea754d569857 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:51.356007 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e2006-d9db-4e3a-931c-ea754d569857 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:51.420638 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ad139-986f-4313-baa1-e00f9c9feef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:51.421385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ad139-986f-4313-baa1-e00f9c9feef8 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:51.421682 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ad139-986f-4313-baa1-e00f9c9feef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:51.421960 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ad139-986f-4313-baa1-e00f9c9feef8 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:51.422672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ad139-986f-4313-baa1-e00f9c9feef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:51.424738 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ad139-986f-4313-baa1-e00f9c9feef8 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:51.567188 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 983/1930] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:51 2022] POST /identity/v3/users => generated 291 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:51.571162 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac85a1-8317-473c-aac7-a4db18c01101 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:51.581889 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac85a1-8317-473c-aac7-a4db18c01101 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:51.587530 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c1527-f849-4ea9-826c-7955d6a0699a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:51.588739 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c1527-f849-4ea9-826c-7955d6a0699a admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:51.590526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c1527-f849-4ea9-826c-7955d6a0699a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:51.590526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c1527-f849-4ea9-826c-7955d6a0699a admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:51.590526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c1527-f849-4ea9-826c-7955d6a0699a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:51.592021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c1527-f849-4ea9-826c-7955d6a0699a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:51.607925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 948/1931] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:51.609162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ad139-986f-4313-baa1-e00f9c9feef8 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:51.628788 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ad139-986f-4313-baa1-e00f9c9feef8 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:51.634517 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986dd0f-5ab7-446d-87a6-10fbb08ab2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:51.635267 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986dd0f-5ab7-446d-87a6-10fbb08ab2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:51.635644 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986dd0f-5ab7-446d-87a6-10fbb08ab2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:51.635988 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986dd0f-5ab7-446d-87a6-10fbb08ab2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:51.636833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986dd0f-5ab7-446d-87a6-10fbb08ab2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:51.638723 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986dd0f-5ab7-446d-87a6-10fbb08ab2f7 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:51.650887 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 984/1932] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:51.656539 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c1527-f849-4ea9-826c-7955d6a0699a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:51.666861 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c1527-f849-4ea9-826c-7955d6a0699a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:51.672282 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bbf73-2344-42e5-8fb5-b218a7968d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:51.673248 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bbf73-2344-42e5-8fb5-b218a7968d10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:51.673536 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bbf73-2344-42e5-8fb5-b218a7968d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:51.673818 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bbf73-2344-42e5-8fb5-b218a7968d10 admin admin] PATH_INFO: `/v3/projects/4c51808195c44dc58bc581d222f24d6f/users/f20377256e024abbb250bcaeb64dc6ae/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:51.689964 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bbf73-2344-42e5-8fb5-b218a7968d10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c51808195c44dc58bc581d222f24d6f, user_id=f20377256e024abbb250bcaeb64dc6ae, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:51.692942 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bbf73-2344-42e5-8fb5-b218a7968d10 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:51.826445 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 949/1933] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:51 2022] PUT /identity/v3/projects/4c51808195c44dc58bc581d222f24d6f/users/f20377256e024abbb250bcaeb64dc6ae/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:51.837016 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080e507-e88d-4129-bb90-91d63a0239b0 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:51.837412 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080e507-e88d-4129-bb90-91d63a0239b0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:51.837793 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080e507-e88d-4129-bb90-91d63a0239b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:51.870427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-3080e507-e88d-4129-bb90-91d63a0239b0 None None] MFA Rules not processed for user `f20377256e024abbb250bcaeb64dc6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:51.871793 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3080e507-e88d-4129-bb90-91d63a0239b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:51.951768 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 985/1934] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:52.043466 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bbf73-2344-42e5-8fb5-b218a7968d10 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:52.045510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b96bbf73-2344-42e5-8fb5-b218a7968d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:52.114970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bbf73-2344-42e5-8fb5-b218a7968d10 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:52.132152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e690cb-877b-4aec-ab12-c405921cd59e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:52.133998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e690cb-877b-4aec-ab12-c405921cd59e service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:52.133998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e690cb-877b-4aec-ab12-c405921cd59e service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:52.133998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e690cb-877b-4aec-ab12-c405921cd59e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:52.159925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e690cb-877b-4aec-ab12-c405921cd59e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:52.161436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e690cb-877b-4aec-ab12-c405921cd59e service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:52.191924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 950/1935] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:01:52.213039 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080e507-e88d-4129-bb90-91d63a0239b0 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:52.235566 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e690cb-877b-4aec-ab12-c405921cd59e service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:52.237109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f3e690cb-877b-4aec-ab12-c405921cd59e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:52.302379 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080e507-e88d-4129-bb90-91d63a0239b0 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:52.310610 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275ee97-504a-4c9d-9f43-6bc9a5e2b7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:52.311831 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275ee97-504a-4c9d-9f43-6bc9a5e2b7f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:52.312360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275ee97-504a-4c9d-9f43-6bc9a5e2b7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:52.312560 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275ee97-504a-4c9d-9f43-6bc9a5e2b7f0 admin admin] PATH_INFO: `/v3/users/f20377256e024abbb250bcaeb64dc6ae` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:52.315008 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275ee97-504a-4c9d-9f43-6bc9a5e2b7f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f20377256e024abbb250bcaeb64dc6ae)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:52.316639 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275ee97-504a-4c9d-9f43-6bc9a5e2b7f0 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:52.375584 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:52.381479 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e690cb-877b-4aec-ab12-c405921cd59e service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:52.387003 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91c204-092d-4955-b7f1-c053a7df31eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:52.388034 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91c204-092d-4955-b7f1-c053a7df31eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:52.388254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91c204-092d-4955-b7f1-c053a7df31eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:52.388681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91c204-092d-4955-b7f1-c053a7df31eb admin admin] PATH_INFO: `/v3/users/d7a84f4bd0474d47b501ecfff3d5e950` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:52.389989 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91c204-092d-4955-b7f1-c053a7df31eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a84f4bd0474d47b501ecfff3d5e950)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:52.392005 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91c204-092d-4955-b7f1-c053a7df31eb admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:52.448183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:52.575537 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8275ee97-504a-4c9d-9f43-6bc9a5e2b7f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f20377256e024abbb250bcaeb64dc6ae'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:52.582484 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8275ee97-504a-4c9d-9f43-6bc9a5e2b7f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f20377256e024abbb250bcaeb64dc6ae'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:52.583171 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8275ee97-504a-4c9d-9f43-6bc9a5e2b7f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f20377256e024abbb250bcaeb64dc6ae'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:52.583777 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8275ee97-504a-4c9d-9f43-6bc9a5e2b7f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f20377256e024abbb250bcaeb64dc6ae'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:52.597065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8275ee97-504a-4c9d-9f43-6bc9a5e2b7f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f20377256e024abbb250bcaeb64dc6ae'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:52.609488 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0e91c204-092d-4955-b7f1-c053a7df31eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a84f4bd0474d47b501ecfff3d5e950'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:52.619876 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0e91c204-092d-4955-b7f1-c053a7df31eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a84f4bd0474d47b501ecfff3d5e950'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:52.621103 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0e91c204-092d-4955-b7f1-c053a7df31eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a84f4bd0474d47b501ecfff3d5e950'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:52.622019 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0e91c204-092d-4955-b7f1-c053a7df31eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a84f4bd0474d47b501ecfff3d5e950'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:52.640090 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0e91c204-092d-4955-b7f1-c053a7df31eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a84f4bd0474d47b501ecfff3d5e950'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:52.685833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 986/1936] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:52 2022] DELETE /identity/v3/users/f20377256e024abbb250bcaeb64dc6ae => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:52.690320 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22172497-d47d-462d-9d8d-8a583d73150d None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:52.690615 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22172497-d47d-462d-9d8d-8a583d73150d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:52.690900 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22172497-d47d-462d-9d8d-8a583d73150d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:52.709826 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-22172497-d47d-462d-9d8d-8a583d73150d None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:52.718085 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-22172497-d47d-462d-9d8d-8a583d73150d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:52.772137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 987/1937] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:01:52.781981 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22172497-d47d-462d-9d8d-8a583d73150d None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:52.783491 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-22172497-d47d-462d-9d8d-8a583d73150d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:52.799852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 951/1938] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:52 2022] DELETE /identity/v3/users/d7a84f4bd0474d47b501ecfff3d5e950 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:52.801461 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d3b75-50d0-46d1-a91c-dbb0713c51b8 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:52.802032 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d3b75-50d0-46d1-a91c-dbb0713c51b8 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:52.811084 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d3b75-50d0-46d1-a91c-dbb0713c51b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:52.820768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-4f9d3b75-50d0-46d1-a91c-dbb0713c51b8 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:52.821972 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4f9d3b75-50d0-46d1-a91c-dbb0713c51b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:52.846910 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22172497-d47d-462d-9d8d-8a583d73150d None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:52.889928 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 952/1939] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:52.900519 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d3b75-50d0-46d1-a91c-dbb0713c51b8 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:52.902157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4f9d3b75-50d0-46d1-a91c-dbb0713c51b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:52.903774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0288c6-4856-4e4a-a155-a6986ab51893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:52.904455 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0288c6-4856-4e4a-a155-a6986ab51893 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:52.904824 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0288c6-4856-4e4a-a155-a6986ab51893 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:52.905145 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0288c6-4856-4e4a-a155-a6986ab51893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:52.916452 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0288c6-4856-4e4a-a155-a6986ab51893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:52.917698 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0288c6-4856-4e4a-a155-a6986ab51893 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:52.918559 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d3b75-50d0-46d1-a91c-dbb0713c51b8 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:52.921922 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ba343-69e0-4c9b-8670-0a16bb91d5cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:52.922695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ba343-69e0-4c9b-8670-0a16bb91d5cc service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:52.923051 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ba343-69e0-4c9b-8670-0a16bb91d5cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:52.923515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ba343-69e0-4c9b-8670-0a16bb91d5cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:52.929326 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 988/1940] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:01:52.933996 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ba343-69e0-4c9b-8670-0a16bb91d5cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:52.935853 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ba343-69e0-4c9b-8670-0a16bb91d5cc service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:52.948770 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 953/1941] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:01:53.504331 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0288c6-4856-4e4a-a155-a6986ab51893 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:53.505819 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0e0288c6-4856-4e4a-a155-a6986ab51893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:53.532737 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0288c6-4856-4e4a-a155-a6986ab51893 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:53.538922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c9f86-f5a3-4877-ba8d-83240615d656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:53.540294 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c9f86-f5a3-4877-ba8d-83240615d656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:53.540599 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c9f86-f5a3-4877-ba8d-83240615d656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:53.540891 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c9f86-f5a3-4877-ba8d-83240615d656 admin admin] PATH_INFO: `/v3/projects/4c51808195c44dc58bc581d222f24d6f` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:53.542819 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c9f86-f5a3-4877-ba8d-83240615d656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c51808195c44dc58bc581d222f24d6f)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:53.545331 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c9f86-f5a3-4877-ba8d-83240615d656 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:53.581293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ba343-69e0-4c9b-8670-0a16bb91d5cc service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:53.585271 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e11ba343-69e0-4c9b-8670-0a16bb91d5cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:53.609716 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ba343-69e0-4c9b-8670-0a16bb91d5cc service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:53.623915 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2c073-037e-4fd6-9ba5-a4ac1b8d800d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:53.623915 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2c073-037e-4fd6-9ba5-a4ac1b8d800d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:53.623915 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2c073-037e-4fd6-9ba5-a4ac1b8d800d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:53.623915 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2c073-037e-4fd6-9ba5-a4ac1b8d800d admin admin] PATH_INFO: `/v3/projects/849d06d037af4145b9dcd8f17f95a88d` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:53.625695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2c073-037e-4fd6-9ba5-a4ac1b8d800d admin admin] RBAC: Authorizing `identity:delete_project(project_id=849d06d037af4145b9dcd8f17f95a88d)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:53.628570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2c073-037e-4fd6-9ba5-a4ac1b8d800d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:53.661474 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-982c9f86-f5a3-4877-ba8d-83240615d656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c51808195c44dc58bc581d222f24d6f', 'request_id': 'req-982c9f86-f5a3-4877-ba8d-83240615d656'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:53.668238 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-982c9f86-f5a3-4877-ba8d-83240615d656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c51808195c44dc58bc581d222f24d6f', 'request_id': 'req-982c9f86-f5a3-4877-ba8d-83240615d656'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:53.675169 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-982c9f86-f5a3-4877-ba8d-83240615d656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c51808195c44dc58bc581d222f24d6f', 'request_id': 'req-982c9f86-f5a3-4877-ba8d-83240615d656'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:53.795716 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-82d2c073-037e-4fd6-9ba5-a4ac1b8d800d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '849d06d037af4145b9dcd8f17f95a88d', 'request_id': 'req-82d2c073-037e-4fd6-9ba5-a4ac1b8d800d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:53.801399 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-982c9f86-f5a3-4877-ba8d-83240615d656 admin admin] The token cache is being invalidate because project 4c51808195c44dc58bc581d222f24d6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:53.801695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-982c9f86-f5a3-4877-ba8d-83240615d656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:53.802324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-982c9f86-f5a3-4877-ba8d-83240615d656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:53.804929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 989/1942] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:53 2022] DELETE /identity/v3/projects/4c51808195c44dc58bc581d222f24d6f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:53.810448 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4ec2c-c7ce-42e0-b0c4-69ae2bad3d7d None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:53.810737 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4ec2c-c7ce-42e0-b0c4-69ae2bad3d7d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:53.811016 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4ec2c-c7ce-42e0-b0c4-69ae2bad3d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:53.829134 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-0cd4ec2c-c7ce-42e0-b0c4-69ae2bad3d7d None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:53.830356 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0cd4ec2c-c7ce-42e0-b0c4-69ae2bad3d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:53.867971 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-82d2c073-037e-4fd6-9ba5-a4ac1b8d800d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '849d06d037af4145b9dcd8f17f95a88d', 'request_id': 'req-82d2c073-037e-4fd6-9ba5-a4ac1b8d800d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:53.878768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-82d2c073-037e-4fd6-9ba5-a4ac1b8d800d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '849d06d037af4145b9dcd8f17f95a88d', 'request_id': 'req-82d2c073-037e-4fd6-9ba5-a4ac1b8d800d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:53.891396 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-82d2c073-037e-4fd6-9ba5-a4ac1b8d800d admin admin] The token cache is being invalidate because project 849d06d037af4145b9dcd8f17f95a88d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:53.891777 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-82d2c073-037e-4fd6-9ba5-a4ac1b8d800d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:53.892763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-82d2c073-037e-4fd6-9ba5-a4ac1b8d800d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:53.894654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 954/1943] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:53 2022] DELETE /identity/v3/projects/849d06d037af4145b9dcd8f17f95a88d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:53.898347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 990/1944] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:53.899525 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2c073-037e-4fd6-9ba5-a4ac1b8d800d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:53.901345 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-82d2c073-037e-4fd6-9ba5-a4ac1b8d800d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:53.903232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abeb3d-d7e3-4a01-b9de-426973a2b022 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:53.905115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abeb3d-d7e3-4a01-b9de-426973a2b022 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:53.905115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abeb3d-d7e3-4a01-b9de-426973a2b022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:53.917018 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2c073-037e-4fd6-9ba5-a4ac1b8d800d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:53.922267 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710a44a-aab8-4061-83c5-12483efdaaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:53.922633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-40abeb3d-d7e3-4a01-b9de-426973a2b022 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:53.923160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710a44a-aab8-4061-83c5-12483efdaaa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:53.923448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710a44a-aab8-4061-83c5-12483efdaaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:53.923858 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710a44a-aab8-4061-83c5-12483efdaaa2 admin admin] PATH_INFO: `/v3/users/740279a81ba74553a7639a7659c6ec37` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:53.923964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-40abeb3d-d7e3-4a01-b9de-426973a2b022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:53.925133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710a44a-aab8-4061-83c5-12483efdaaa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=740279a81ba74553a7639a7659c6ec37)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:53.927192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710a44a-aab8-4061-83c5-12483efdaaa2 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:53.934209 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 991/1945] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:01:53.938624 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abeb3d-d7e3-4a01-b9de-426973a2b022 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:53.948263 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abeb3d-d7e3-4a01-b9de-426973a2b022 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:53.953297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a650c-02fa-41ec-8dbd-7890cfb49d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:53.954064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a650c-02fa-41ec-8dbd-7890cfb49d3c admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:53.958762 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a650c-02fa-41ec-8dbd-7890cfb49d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:53.958762 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a650c-02fa-41ec-8dbd-7890cfb49d3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:53.958762 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a650c-02fa-41ec-8dbd-7890cfb49d3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:01:53.958762 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a650c-02fa-41ec-8dbd-7890cfb49d3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:53.958762 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a650c-02fa-41ec-8dbd-7890cfb49d3c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:53.973365 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 992/1946] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 13:01:53.974614 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a650c-02fa-41ec-8dbd-7890cfb49d3c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:53.987415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a650c-02fa-41ec-8dbd-7890cfb49d3c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:53.991967 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7cfb1-8ec7-4a04-bb3e-bc7a0e130e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:53.992698 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7cfb1-8ec7-4a04-bb3e-bc7a0e130e1b admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:53.992989 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7cfb1-8ec7-4a04-bb3e-bc7a0e130e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:53.993268 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7cfb1-8ec7-4a04-bb3e-bc7a0e130e1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:53.993957 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7cfb1-8ec7-4a04-bb3e-bc7a0e130e1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:53.995881 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7cfb1-8ec7-4a04-bb3e-bc7a0e130e1b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:54.170470 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 993/1947] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:53 2022] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:01:54.174430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7cfb1-8ec7-4a04-bb3e-bc7a0e130e1b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:54.196027 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a710a44a-aab8-4061-83c5-12483efdaaa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '740279a81ba74553a7639a7659c6ec37'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:54.202751 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a710a44a-aab8-4061-83c5-12483efdaaa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '740279a81ba74553a7639a7659c6ec37'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:54.203436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a710a44a-aab8-4061-83c5-12483efdaaa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '740279a81ba74553a7639a7659c6ec37'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:54.204074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a710a44a-aab8-4061-83c5-12483efdaaa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '740279a81ba74553a7639a7659c6ec37'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:54.216396 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a710a44a-aab8-4061-83c5-12483efdaaa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '740279a81ba74553a7639a7659c6ec37'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:54.238072 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7cfb1-8ec7-4a04-bb3e-bc7a0e130e1b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:54.242919 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e418f7-e303-4493-b98c-82c26c8d1caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:54.243643 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e418f7-e303-4493-b98c-82c26c8d1caf admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:54.243928 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e418f7-e303-4493-b98c-82c26c8d1caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:54.244210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e418f7-e303-4493-b98c-82c26c8d1caf admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:54.244945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e418f7-e303-4493-b98c-82c26c8d1caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:54.246919 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e418f7-e303-4493-b98c-82c26c8d1caf admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:54.296180 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 955/1948] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:53 2022] DELETE /identity/v3/users/740279a81ba74553a7639a7659c6ec37 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:01:54.377201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:54.400555 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 994/1949] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:54 2022] POST /identity/v3/users => generated 288 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:01:54.404483 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710a44a-aab8-4061-83c5-12483efdaaa2 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:54.405909 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a710a44a-aab8-4061-83c5-12483efdaaa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:54.471134 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710a44a-aab8-4061-83c5-12483efdaaa2 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:54.476224 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2b748-546b-4b1a-9c69-97e75fd8133e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:54.476953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2b748-546b-4b1a-9c69-97e75fd8133e admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:54.477505 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2b748-546b-4b1a-9c69-97e75fd8133e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:54.477790 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2b748-546b-4b1a-9c69-97e75fd8133e admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:54.478521 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2b748-546b-4b1a-9c69-97e75fd8133e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:54.480139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2b748-546b-4b1a-9c69-97e75fd8133e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:54.491633 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 956/1950] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:54.496285 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e418f7-e303-4493-b98c-82c26c8d1caf admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:54.505637 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e418f7-e303-4493-b98c-82c26c8d1caf admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:54.511181 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b70aeb-9a67-4d4f-b353-e59408be6b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:54.511940 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b70aeb-9a67-4d4f-b353-e59408be6b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:54.512227 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b70aeb-9a67-4d4f-b353-e59408be6b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:54.512504 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b70aeb-9a67-4d4f-b353-e59408be6b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:54.513276 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b70aeb-9a67-4d4f-b353-e59408be6b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:54.515198 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b70aeb-9a67-4d4f-b353-e59408be6b42 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:54.525761 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 995/1951] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:01:54.530193 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2b748-546b-4b1a-9c69-97e75fd8133e admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:54.540244 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2b748-546b-4b1a-9c69-97e75fd8133e admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:54.544914 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cc9fd-9efc-4ffc-af19-e8abcd5b24c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:54.545800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cc9fd-9efc-4ffc-af19-e8abcd5b24c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:54.546083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cc9fd-9efc-4ffc-af19-e8abcd5b24c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:54.546362 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cc9fd-9efc-4ffc-af19-e8abcd5b24c2 admin admin] PATH_INFO: `/v3/projects/f056fc876ece446da77fdd5feb4f0f99/users/2e41f84acfa4467b98ba6b038a209eda/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:54.561961 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cc9fd-9efc-4ffc-af19-e8abcd5b24c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f056fc876ece446da77fdd5feb4f0f99, user_id=2e41f84acfa4467b98ba6b038a209eda, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:54.565113 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cc9fd-9efc-4ffc-af19-e8abcd5b24c2 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:54.697225 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:54.714798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 957/1952] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:54 2022] PUT /identity/v3/projects/f056fc876ece446da77fdd5feb4f0f99/users/2e41f84acfa4467b98ba6b038a209eda/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:54.726545 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453da844-a028-46fa-bf18-f4c089965a27 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:54.727017 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453da844-a028-46fa-bf18-f4c089965a27 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:54.727744 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453da844-a028-46fa-bf18-f4c089965a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:54.758122 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-453da844-a028-46fa-bf18-f4c089965a27 None None] MFA Rules not processed for user `2e41f84acfa4467b98ba6b038a209eda`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:54.759485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-453da844-a028-46fa-bf18-f4c089965a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:54.828316 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 996/1953] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:54.836725 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cc9fd-9efc-4ffc-af19-e8abcd5b24c2 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:54.839382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6d6cc9fd-9efc-4ffc-af19-e8abcd5b24c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:54.840738 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453da844-a028-46fa-bf18-f4c089965a27 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:54.842201 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-453da844-a028-46fa-bf18-f4c089965a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:54.915852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cc9fd-9efc-4ffc-af19-e8abcd5b24c2 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:54.918987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453da844-a028-46fa-bf18-f4c089965a27 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:54.921314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890458d-3b1e-42e2-a8e6-c19ec77757fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:54.922215 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890458d-3b1e-42e2-a8e6-c19ec77757fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:54.922477 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890458d-3b1e-42e2-a8e6-c19ec77757fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:54.922758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890458d-3b1e-42e2-a8e6-c19ec77757fa admin admin] PATH_INFO: `/v3/projects/d2f7406fa0da47afbc57d5b113cc30d1` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:54.922919 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8765e-8d9e-485b-bebd-ccd95dca360c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:54.923774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8765e-8d9e-485b-bebd-ccd95dca360c service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:54.923957 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890458d-3b1e-42e2-a8e6-c19ec77757fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f7406fa0da47afbc57d5b113cc30d1)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:54.924179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8765e-8d9e-485b-bebd-ccd95dca360c service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:54.924525 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8765e-8d9e-485b-bebd-ccd95dca360c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:54.926070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890458d-3b1e-42e2-a8e6-c19ec77757fa admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:54.940902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8765e-8d9e-485b-bebd-ccd95dca360c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:54.942482 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8765e-8d9e-485b-bebd-ccd95dca360c service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:54.969616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 997/1954] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:01:55.086212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-7890458d-3b1e-42e2-a8e6-c19ec77757fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f7406fa0da47afbc57d5b113cc30d1', 'request_id': 'req-7890458d-3b1e-42e2-a8e6-c19ec77757fa'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:55.193803 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-7890458d-3b1e-42e2-a8e6-c19ec77757fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f7406fa0da47afbc57d5b113cc30d1', 'request_id': 'req-7890458d-3b1e-42e2-a8e6-c19ec77757fa'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:55.203077 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-7890458d-3b1e-42e2-a8e6-c19ec77757fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f7406fa0da47afbc57d5b113cc30d1', 'request_id': 'req-7890458d-3b1e-42e2-a8e6-c19ec77757fa'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:55.218277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-7890458d-3b1e-42e2-a8e6-c19ec77757fa admin admin] The token cache is being invalidate because project d2f7406fa0da47afbc57d5b113cc30d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:55.218627 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-7890458d-3b1e-42e2-a8e6-c19ec77757fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:55.219396 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-7890458d-3b1e-42e2-a8e6-c19ec77757fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:55.221070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 958/1955] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:54 2022] DELETE /identity/v3/projects/d2f7406fa0da47afbc57d5b113cc30d1 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:55.228648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83447ae-b0c0-4678-82a8-e3c2ce4f02d7 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:55.228939 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83447ae-b0c0-4678-82a8-e3c2ce4f02d7 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:55.229219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83447ae-b0c0-4678-82a8-e3c2ce4f02d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:55.251465 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-e83447ae-b0c0-4678-82a8-e3c2ce4f02d7 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:55.252756 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e83447ae-b0c0-4678-82a8-e3c2ce4f02d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:55.345298 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 998/1956] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:55.347410 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fc6ec-1910-4008-a481-8f19c463751a None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:55.348067 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fc6ec-1910-4008-a481-8f19c463751a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:55.348348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fc6ec-1910-4008-a481-8f19c463751a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:55.369248 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-5f3fc6ec-1910-4008-a481-8f19c463751a None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:55.370555 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5f3fc6ec-1910-4008-a481-8f19c463751a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:55.379631 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 959/1957] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:55.384838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83447ae-b0c0-4678-82a8-e3c2ce4f02d7 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:55.397921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83447ae-b0c0-4678-82a8-e3c2ce4f02d7 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:55.402715 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb6960-3d6c-4cfa-83fb-e8d688d056bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:55.403383 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb6960-3d6c-4cfa-83fb-e8d688d056bc admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:55.403669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb6960-3d6c-4cfa-83fb-e8d688d056bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:55.404004 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb6960-3d6c-4cfa-83fb-e8d688d056bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:55.407939 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb6960-3d6c-4cfa-83fb-e8d688d056bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:01:55.407939 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb6960-3d6c-4cfa-83fb-e8d688d056bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:55.407939 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb6960-3d6c-4cfa-83fb-e8d688d056bc admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:55.418699 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 999/1958] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:01:55.423182 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fc6ec-1910-4008-a481-8f19c463751a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:55.433096 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fc6ec-1910-4008-a481-8f19c463751a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:55.437893 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c639e6-23d1-4657-a36f-3333bae00bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:55.438551 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c639e6-23d1-4657-a36f-3333bae00bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:55.438839 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c639e6-23d1-4657-a36f-3333bae00bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:55.442591 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c639e6-23d1-4657-a36f-3333bae00bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:55.442591 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c639e6-23d1-4657-a36f-3333bae00bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:55.442591 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c639e6-23d1-4657-a36f-3333bae00bd6 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:55.522755 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 960/1959] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:55 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:55.527969 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb6960-3d6c-4cfa-83fb-e8d688d056bc admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:55.538053 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb6960-3d6c-4cfa-83fb-e8d688d056bc admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:55.596148 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dd7e9-509a-4c6e-9206-1bbd3d06304e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:55.597899 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dd7e9-509a-4c6e-9206-1bbd3d06304e admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:55.597899 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dd7e9-509a-4c6e-9206-1bbd3d06304e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:55.597899 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dd7e9-509a-4c6e-9206-1bbd3d06304e admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:55.598780 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dd7e9-509a-4c6e-9206-1bbd3d06304e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:55.601403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dd7e9-509a-4c6e-9206-1bbd3d06304e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:55.736875 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1000/1960] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:55 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:55.752676 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c639e6-23d1-4657-a36f-3333bae00bd6 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:55.764957 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c639e6-23d1-4657-a36f-3333bae00bd6 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:55.771058 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32cafd-b84b-4f26-b534-74961ebc3fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:55.771772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32cafd-b84b-4f26-b534-74961ebc3fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:55.772089 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32cafd-b84b-4f26-b534-74961ebc3fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:55.772369 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32cafd-b84b-4f26-b534-74961ebc3fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:55.773331 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32cafd-b84b-4f26-b534-74961ebc3fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:55.775249 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32cafd-b84b-4f26-b534-74961ebc3fe9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:55.788461 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 961/1961] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:55.792324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dd7e9-509a-4c6e-9206-1bbd3d06304e admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:55.804797 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dd7e9-509a-4c6e-9206-1bbd3d06304e admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:55.811543 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a15e3-6208-4941-9b15-e37f4da59175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:55.812282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a15e3-6208-4941-9b15-e37f4da59175 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:55.812571 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a15e3-6208-4941-9b15-e37f4da59175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:55.812978 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a15e3-6208-4941-9b15-e37f4da59175 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:55.813708 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a15e3-6208-4941-9b15-e37f4da59175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:55.815313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a15e3-6208-4941-9b15-e37f4da59175 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:55.827052 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1001/1962] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:55.831290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32cafd-b84b-4f26-b534-74961ebc3fe9 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:55.842518 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32cafd-b84b-4f26-b534-74961ebc3fe9 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:55.848066 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c277f-77a1-4a19-bbde-6ca65584e70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:55.849015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c277f-77a1-4a19-bbde-6ca65584e70f admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:55.849300 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c277f-77a1-4a19-bbde-6ca65584e70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:55.849680 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c277f-77a1-4a19-bbde-6ca65584e70f admin admin] PATH_INFO: `/v3/projects/ffce8bb2712b4d0293632d22284be991/users/e4959878a26b4e748a517013c7917983/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:55.867576 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c277f-77a1-4a19-bbde-6ca65584e70f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffce8bb2712b4d0293632d22284be991, user_id=e4959878a26b4e748a517013c7917983, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:55.870354 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c277f-77a1-4a19-bbde-6ca65584e70f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:55.989769 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 962/1963] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:55 2022] PUT /identity/v3/projects/ffce8bb2712b4d0293632d22284be991/users/e4959878a26b4e748a517013c7917983/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:01:56.001154 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9dd0a-5c3c-40f4-a334-8850bcb06b77 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:56.001464 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9dd0a-5c3c-40f4-a334-8850bcb06b77 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:56.001773 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9dd0a-5c3c-40f4-a334-8850bcb06b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:56.034692 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-d1e9dd0a-5c3c-40f4-a334-8850bcb06b77 None None] MFA Rules not processed for user `e4959878a26b4e748a517013c7917983`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:56.036157 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d1e9dd0a-5c3c-40f4-a334-8850bcb06b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:56.233935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1002/1964] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:56.234645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c277f-77a1-4a19-bbde-6ca65584e70f admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:56.310605 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c277f-77a1-4a19-bbde-6ca65584e70f admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:56.323405 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8ca57-7519-4278-8edf-1d711f988bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:56.324100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8ca57-7519-4278-8edf-1d711f988bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:56.324391 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8ca57-7519-4278-8edf-1d711f988bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:56.326466 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8ca57-7519-4278-8edf-1d711f988bc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:56.327192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8ca57-7519-4278-8edf-1d711f988bc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:56.330239 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8ca57-7519-4278-8edf-1d711f988bc3 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:56.366021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:56.458441 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 963/1965] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:01:56 2022] POST /identity/v3/projects => generated 383 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:56.463164 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9dd0a-5c3c-40f4-a334-8850bcb06b77 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:56.473743 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9dd0a-5c3c-40f4-a334-8850bcb06b77 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:56.480983 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:56.537600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b49e0-d59a-46de-9093-b09c2d181047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:56.538286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b49e0-d59a-46de-9093-b09c2d181047 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:56.538572 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b49e0-d59a-46de-9093-b09c2d181047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:56.539310 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b49e0-d59a-46de-9093-b09c2d181047 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:56.539551 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b49e0-d59a-46de-9093-b09c2d181047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:56.541572 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b49e0-d59a-46de-9093-b09c2d181047 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:56.561631 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8ca57-7519-4278-8edf-1d711f988bc3 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:56.563463 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-40f8ca57-7519-4278-8edf-1d711f988bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:56.577539 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8ca57-7519-4278-8edf-1d711f988bc3 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:56.585026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2357573-66e0-47e9-9558-8ab82d8afecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:56.585026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2357573-66e0-47e9-9558-8ab82d8afecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:56.585026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2357573-66e0-47e9-9558-8ab82d8afecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:56.585589 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2357573-66e0-47e9-9558-8ab82d8afecc admin admin] PATH_INFO: `/v3/users/57b1cd298c40470bb3fb850b65501f66` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:56.587217 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2357573-66e0-47e9-9558-8ab82d8afecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b1cd298c40470bb3fb850b65501f66)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:56.589413 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2357573-66e0-47e9-9558-8ab82d8afecc admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:56.676208 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1003/1966] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:01:56 2022] POST /identity/v3/users => generated 298 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:01:56.678353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b49e0-d59a-46de-9093-b09c2d181047 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:56.688782 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b49e0-d59a-46de-9093-b09c2d181047 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:56.693999 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743ce6b-7e85-4353-b7f8-9503d844f976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:56.694702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743ce6b-7e85-4353-b7f8-9503d844f976 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:56.694990 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743ce6b-7e85-4353-b7f8-9503d844f976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:56.695546 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743ce6b-7e85-4353-b7f8-9503d844f976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:56.696337 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743ce6b-7e85-4353-b7f8-9503d844f976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:56.698932 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743ce6b-7e85-4353-b7f8-9503d844f976 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:56.710841 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1004/1967] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:01:56.715454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743ce6b-7e85-4353-b7f8-9503d844f976 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:56.727900 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743ce6b-7e85-4353-b7f8-9503d844f976 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:56.734595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e91372-4079-4a0b-a59d-907905a4a070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:56.735974 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e91372-4079-4a0b-a59d-907905a4a070 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:56.736398 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e91372-4079-4a0b-a59d-907905a4a070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:56.736877 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e91372-4079-4a0b-a59d-907905a4a070 admin admin] PATH_INFO: `/v3/projects/e8205c9e823b438baf5e52df58453832/users/fa85cc6b7ffa4e55af83e51355ea6d19/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:56.755938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e91372-4079-4a0b-a59d-907905a4a070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8205c9e823b438baf5e52df58453832, user_id=fa85cc6b7ffa4e55af83e51355ea6d19, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:56.758632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e91372-4079-4a0b-a59d-907905a4a070 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:56.827388 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a2357573-66e0-47e9-9558-8ab82d8afecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b1cd298c40470bb3fb850b65501f66'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:56.835475 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a2357573-66e0-47e9-9558-8ab82d8afecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b1cd298c40470bb3fb850b65501f66'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:56.836195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a2357573-66e0-47e9-9558-8ab82d8afecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b1cd298c40470bb3fb850b65501f66'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:56.836841 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a2357573-66e0-47e9-9558-8ab82d8afecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b1cd298c40470bb3fb850b65501f66'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:56.849405 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a2357573-66e0-47e9-9558-8ab82d8afecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b1cd298c40470bb3fb850b65501f66'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:56.898765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1005/1968] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:56 2022] PUT /identity/v3/projects/e8205c9e823b438baf5e52df58453832/users/fa85cc6b7ffa4e55af83e51355ea6d19/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:01:56.902546 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e91372-4079-4a0b-a59d-907905a4a070 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:56.913670 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-63e91372-4079-4a0b-a59d-907905a4a070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:56.962468 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 964/1969] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:56 2022] DELETE /identity/v3/users/57b1cd298c40470bb3fb850b65501f66 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:01:56.966732 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81ed03-5923-4746-aff0-bc903ae54f93 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:56.968463 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81ed03-5923-4746-aff0-bc903ae54f93 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:56.968797 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81ed03-5923-4746-aff0-bc903ae54f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:56.984739 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e91372-4079-4a0b-a59d-907905a4a070 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:56.992930 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-7a81ed03-5923-4746-aff0-bc903ae54f93 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:56.997206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7a81ed03-5923-4746-aff0-bc903ae54f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:57.055348 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e3f67-e549-4832-8507-e675583c3b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:57.056205 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e3f67-e549-4832-8507-e675583c3b48 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:57.056623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e3f67-e549-4832-8507-e675583c3b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:57.057028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e3f67-e549-4832-8507-e675583c3b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:57.057917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e3f67-e549-4832-8507-e675583c3b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:57.061604 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e3f67-e549-4832-8507-e675583c3b48 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:57.076521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1006/1970] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:01:57.077514 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e3f67-e549-4832-8507-e675583c3b48 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:57.088645 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e3f67-e549-4832-8507-e675583c3b48 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:57.092136 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 965/1971] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:57.094394 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790af0e-36a1-4135-a021-699a7f28eade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:57.095377 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790af0e-36a1-4135-a021-699a7f28eade admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:57.098765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790af0e-36a1-4135-a021-699a7f28eade admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:57.098765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790af0e-36a1-4135-a021-699a7f28eade admin admin] PATH_INFO: `/v3/projects/e8205c9e823b438baf5e52df58453832/users/fa85cc6b7ffa4e55af83e51355ea6d19/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:57.100766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790af0e-36a1-4135-a021-699a7f28eade admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8205c9e823b438baf5e52df58453832, user_id=fa85cc6b7ffa4e55af83e51355ea6d19, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:57.104003 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790af0e-36a1-4135-a021-699a7f28eade admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:57.107682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81ed03-5923-4746-aff0-bc903ae54f93 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:57.109494 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7a81ed03-5923-4746-aff0-bc903ae54f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:57.116149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1007/1972] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:01:57 2022] PUT /identity/v3/projects/e8205c9e823b438baf5e52df58453832/users/fa85cc6b7ffa4e55af83e51355ea6d19/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:57.139138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7f6cb-57ac-474d-aea7-88f164904bb0 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:57.139395 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7f6cb-57ac-474d-aea7-88f164904bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:57.141834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7f6cb-57ac-474d-aea7-88f164904bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:57.185735 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-50a7f6cb-57ac-474d-aea7-88f164904bb0 None None] MFA Rules not processed for user `fa85cc6b7ffa4e55af83e51355ea6d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:01:57.186951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-50a7f6cb-57ac-474d-aea7-88f164904bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:57.190922 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81ed03-5923-4746-aff0-bc903ae54f93 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:57.241855 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b80c03-f35e-4373-8ca8-94e428c1bfd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:57.242544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b80c03-f35e-4373-8ca8-94e428c1bfd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:57.242837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b80c03-f35e-4373-8ca8-94e428c1bfd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:57.243132 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b80c03-f35e-4373-8ca8-94e428c1bfd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:57.262062 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1008/1973] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:01:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:01:57.284449 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7f6cb-57ac-474d-aea7-88f164904bb0 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:57.286302 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-50a7f6cb-57ac-474d-aea7-88f164904bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:57.313589 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b80c03-f35e-4373-8ca8-94e428c1bfd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:57.315087 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b80c03-f35e-4373-8ca8-94e428c1bfd3 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:57.326244 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 966/1974] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:01:57.348005 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7f6cb-57ac-474d-aea7-88f164904bb0 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:57.351801 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324c3e8-1809-41bb-841f-c07348e305fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:57.352791 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324c3e8-1809-41bb-841f-c07348e305fe service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:57.353663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324c3e8-1809-41bb-841f-c07348e305fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:57.354229 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324c3e8-1809-41bb-841f-c07348e305fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:57.356856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5324c3e8-1809-41bb-841f-c07348e305fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:57.456190 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324c3e8-1809-41bb-841f-c07348e305fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:57.457813 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324c3e8-1809-41bb-841f-c07348e305fe service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:57.468812 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1009/1975] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:01:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:01:57.855174 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b80c03-f35e-4373-8ca8-94e428c1bfd3 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:57.857386 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-43b80c03-f35e-4373-8ca8-94e428c1bfd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:57.874545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b80c03-f35e-4373-8ca8-94e428c1bfd3 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:57.879948 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb111f90-805b-40b5-bbf8-3f53887d3a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:57.889194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb111f90-805b-40b5-bbf8-3f53887d3a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:57.889708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb111f90-805b-40b5-bbf8-3f53887d3a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:57.890223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb111f90-805b-40b5-bbf8-3f53887d3a48 admin admin] PATH_INFO: `/v3/projects/16ad64c7a8f04eb09faca69ed4470cd7` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:57.891826 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb111f90-805b-40b5-bbf8-3f53887d3a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ad64c7a8f04eb09faca69ed4470cd7)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:57.893905 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb111f90-805b-40b5-bbf8-3f53887d3a48 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:58.057504 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:58.060257 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-eb111f90-805b-40b5-bbf8-3f53887d3a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ad64c7a8f04eb09faca69ed4470cd7', 'request_id': 'req-eb111f90-805b-40b5-bbf8-3f53887d3a48'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:58.183229 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-eb111f90-805b-40b5-bbf8-3f53887d3a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ad64c7a8f04eb09faca69ed4470cd7', 'request_id': 'req-eb111f90-805b-40b5-bbf8-3f53887d3a48'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:58.191199 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-eb111f90-805b-40b5-bbf8-3f53887d3a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ad64c7a8f04eb09faca69ed4470cd7', 'request_id': 'req-eb111f90-805b-40b5-bbf8-3f53887d3a48'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:58.205807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-eb111f90-805b-40b5-bbf8-3f53887d3a48 admin admin] The token cache is being invalidate because project 16ad64c7a8f04eb09faca69ed4470cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:58.206161 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-eb111f90-805b-40b5-bbf8-3f53887d3a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:58.207280 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-eb111f90-805b-40b5-bbf8-3f53887d3a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:58.210427 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 967/1976] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:57 2022] DELETE /identity/v3/projects/16ad64c7a8f04eb09faca69ed4470cd7 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:58.214248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324c3e8-1809-41bb-841f-c07348e305fe service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:58.229691 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324c3e8-1809-41bb-841f-c07348e305fe service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:58.297006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c90af-2221-4247-84f4-6f812520a581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:58.298067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c90af-2221-4247-84f4-6f812520a581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:58.298404 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c90af-2221-4247-84f4-6f812520a581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:58.298685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c90af-2221-4247-84f4-6f812520a581 admin admin] PATH_INFO: `/v3/users/c517be9e04ed4205b226575973f5f274` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:58.299931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c90af-2221-4247-84f4-6f812520a581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c517be9e04ed4205b226575973f5f274)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:58.302073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c90af-2221-4247-84f4-6f812520a581 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:58.612881 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b63c90af-2221-4247-84f4-6f812520a581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c517be9e04ed4205b226575973f5f274'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:58.620760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b63c90af-2221-4247-84f4-6f812520a581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c517be9e04ed4205b226575973f5f274'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:58.621987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b63c90af-2221-4247-84f4-6f812520a581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c517be9e04ed4205b226575973f5f274'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:58.622632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b63c90af-2221-4247-84f4-6f812520a581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c517be9e04ed4205b226575973f5f274'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:58.636773 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b63c90af-2221-4247-84f4-6f812520a581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c517be9e04ed4205b226575973f5f274'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:58.778451 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:58.790688 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1010/1977] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:01:58 2022] DELETE /identity/v3/users/c517be9e04ed4205b226575973f5f274 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:01:59.565434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb111f90-805b-40b5-bbf8-3f53887d3a48 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:01:59.567188 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-eb111f90-805b-40b5-bbf8-3f53887d3a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:01:59.584801 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb111f90-805b-40b5-bbf8-3f53887d3a48 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:01:59.616895 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:01:59.680925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583cb599-5877-4e3c-872b-ab523318086d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:01:59.681717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cb599-5877-4e3c-872b-ab523318086d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:01:59.682000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cb599-5877-4e3c-872b-ab523318086d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:01:59.682284 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cb599-5877-4e3c-872b-ab523318086d admin admin] PATH_INFO: `/v3/projects/a88ca5e3fe294f68a146cf059943ba32` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:01:59.683494 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583cb599-5877-4e3c-872b-ab523318086d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a88ca5e3fe294f68a146cf059943ba32)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:01:59.685447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583cb599-5877-4e3c-872b-ab523318086d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:01:59.817868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-583cb599-5877-4e3c-872b-ab523318086d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a88ca5e3fe294f68a146cf059943ba32', 'request_id': 'req-583cb599-5877-4e3c-872b-ab523318086d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:59.977426 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-583cb599-5877-4e3c-872b-ab523318086d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a88ca5e3fe294f68a146cf059943ba32', 'request_id': 'req-583cb599-5877-4e3c-872b-ab523318086d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:59.984378 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-583cb599-5877-4e3c-872b-ab523318086d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a88ca5e3fe294f68a146cf059943ba32', 'request_id': 'req-583cb599-5877-4e3c-872b-ab523318086d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:59.994564 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-583cb599-5877-4e3c-872b-ab523318086d admin admin] The token cache is being invalidate because project a88ca5e3fe294f68a146cf059943ba32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:01:59.994852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-583cb599-5877-4e3c-872b-ab523318086d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:59.995495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-583cb599-5877-4e3c-872b-ab523318086d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:01:59.997080 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 968/1978] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:01:59 2022] DELETE /identity/v3/projects/a88ca5e3fe294f68a146cf059943ba32 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:00.002005 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81ee1e-bb99-46ea-904a-1074688866cb None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:00.002473 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81ee1e-bb99-46ea-904a-1074688866cb None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:00.002731 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81ee1e-bb99-46ea-904a-1074688866cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:00.020742 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-8c81ee1e-bb99-46ea-904a-1074688866cb None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:00.022484 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8c81ee1e-bb99-46ea-904a-1074688866cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:00.085766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1011/1979] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:00.093629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23106b-00b2-460a-8637-9ea14888843b None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:00.093929 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23106b-00b2-460a-8637-9ea14888843b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:00.094214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23106b-00b2-460a-8637-9ea14888843b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:00.114356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-fe23106b-00b2-460a-8637-9ea14888843b None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:00.115594 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-fe23106b-00b2-460a-8637-9ea14888843b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:00.124049 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 969/1980] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:00.128692 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81ee1e-bb99-46ea-904a-1074688866cb None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:00.140272 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81ee1e-bb99-46ea-904a-1074688866cb None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:00.146912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0c8de-0988-4831-bd0f-d2297b368cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:00.146912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0c8de-0988-4831-bd0f-d2297b368cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:00.147358 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0c8de-0988-4831-bd0f-d2297b368cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:00.147641 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0c8de-0988-4831-bd0f-d2297b368cd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:00.148417 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0c8de-0988-4831-bd0f-d2297b368cd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:02:00.148766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0c8de-0988-4831-bd0f-d2297b368cd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:00.150469 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0c8de-0988-4831-bd0f-d2297b368cd9 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:00.167299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1012/1981] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 13:02:00.171808 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23106b-00b2-460a-8637-9ea14888843b None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:00.183727 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23106b-00b2-460a-8637-9ea14888843b None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:00.190423 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec08252-cfc8-427d-bfa3-34ee654fcb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:00.191086 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec08252-cfc8-427d-bfa3-34ee654fcb14 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:00.191370 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec08252-cfc8-427d-bfa3-34ee654fcb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:00.191643 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec08252-cfc8-427d-bfa3-34ee654fcb14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:00.192346 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec08252-cfc8-427d-bfa3-34ee654fcb14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:00.194545 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec08252-cfc8-427d-bfa3-34ee654fcb14 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:00.281332 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 970/1982] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:02:00 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:00.285557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0c8de-0988-4831-bd0f-d2297b368cd9 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:00.296200 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0c8de-0988-4831-bd0f-d2297b368cd9 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:00.353009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25304da6-a255-4fd3-a14e-f175990365db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:00.353693 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25304da6-a255-4fd3-a14e-f175990365db admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:00.353977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25304da6-a255-4fd3-a14e-f175990365db admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:00.354253 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25304da6-a255-4fd3-a14e-f175990365db admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:00.354933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25304da6-a255-4fd3-a14e-f175990365db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:00.356885 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25304da6-a255-4fd3-a14e-f175990365db admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:00.388281 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:00.448051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1013/1983] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:02:00 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:00.453070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec08252-cfc8-427d-bfa3-34ee654fcb14 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:00.466625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec08252-cfc8-427d-bfa3-34ee654fcb14 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:00.471880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72ee73-50fe-45ca-8bde-0a3732a945b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:00.472693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72ee73-50fe-45ca-8bde-0a3732a945b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:00.473050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72ee73-50fe-45ca-8bde-0a3732a945b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:00.473399 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72ee73-50fe-45ca-8bde-0a3732a945b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:00.474364 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72ee73-50fe-45ca-8bde-0a3732a945b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:00.476646 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72ee73-50fe-45ca-8bde-0a3732a945b9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:00.497698 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 971/1984] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:00.500814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25304da6-a255-4fd3-a14e-f175990365db admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:00.525328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25304da6-a255-4fd3-a14e-f175990365db admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:00.525328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f612d0c-073b-4723-9d6c-784257672efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:00.525328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f612d0c-073b-4723-9d6c-784257672efd admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:00.525328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f612d0c-073b-4723-9d6c-784257672efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:00.525660 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f612d0c-073b-4723-9d6c-784257672efd admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:00.525660 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f612d0c-073b-4723-9d6c-784257672efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:00.525660 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f612d0c-073b-4723-9d6c-784257672efd admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:00.538780 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1014/1985] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:00.548918 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72ee73-50fe-45ca-8bde-0a3732a945b9 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:00.560394 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72ee73-50fe-45ca-8bde-0a3732a945b9 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:00.570303 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05448ca3-43a2-429b-baa1-c06349ffff19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:00.571289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05448ca3-43a2-429b-baa1-c06349ffff19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:00.571516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05448ca3-43a2-429b-baa1-c06349ffff19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:00.571796 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05448ca3-43a2-429b-baa1-c06349ffff19 admin admin] PATH_INFO: `/v3/projects/5cd3f08d2802424b99eabe7ef9714fc4/users/bab9bccd5b664e969f80865de3d863e1/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:00.596015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05448ca3-43a2-429b-baa1-c06349ffff19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd3f08d2802424b99eabe7ef9714fc4, user_id=bab9bccd5b664e969f80865de3d863e1, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:00.599256 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05448ca3-43a2-429b-baa1-c06349ffff19 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:00.676289 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 972/1986] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:00 2022] PUT /identity/v3/projects/5cd3f08d2802424b99eabe7ef9714fc4/users/bab9bccd5b664e969f80865de3d863e1/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:00.688221 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58d953-a943-4e0e-9b6b-4f7cfbb11ade None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:00.688512 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58d953-a943-4e0e-9b6b-4f7cfbb11ade None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:00.688844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58d953-a943-4e0e-9b6b-4f7cfbb11ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:00.720003 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-9f58d953-a943-4e0e-9b6b-4f7cfbb11ade None None] MFA Rules not processed for user `bab9bccd5b664e969f80865de3d863e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:00.721786 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9f58d953-a943-4e0e-9b6b-4f7cfbb11ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:00.804503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1015/1987] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:00.813826 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05448ca3-43a2-429b-baa1-c06349ffff19 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:00.870235 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:00.890601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05448ca3-43a2-429b-baa1-c06349ffff19 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:00.897998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff07096-ed1b-4ec6-ad1f-24d98206bf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:00.899027 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff07096-ed1b-4ec6-ad1f-24d98206bf81 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:00.899418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff07096-ed1b-4ec6-ad1f-24d98206bf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:00.899807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff07096-ed1b-4ec6-ad1f-24d98206bf81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:00.900654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff07096-ed1b-4ec6-ad1f-24d98206bf81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:00.902971 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff07096-ed1b-4ec6-ad1f-24d98206bf81 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:01.026878 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 973/1988] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:02:00 2022] POST /identity/v3/projects => generated 381 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:01.027995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58d953-a943-4e0e-9b6b-4f7cfbb11ade None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:01.039312 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58d953-a943-4e0e-9b6b-4f7cfbb11ade None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:01.096370 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c846d-5aa8-4692-ac2d-5a2ccc34adbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:01.097089 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c846d-5aa8-4692-ac2d-5a2ccc34adbf admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:01.097370 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c846d-5aa8-4692-ac2d-5a2ccc34adbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:01.097644 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c846d-5aa8-4692-ac2d-5a2ccc34adbf admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:01.098497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c846d-5aa8-4692-ac2d-5a2ccc34adbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:01.100885 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c846d-5aa8-4692-ac2d-5a2ccc34adbf admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:01.222666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1016/1989] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:02:01 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:02:01.227624 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff07096-ed1b-4ec6-ad1f-24d98206bf81 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:01.238587 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff07096-ed1b-4ec6-ad1f-24d98206bf81 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:01.241315 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:01.244431 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee27eb7-bc9b-4d0d-b7d4-bedf170183ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:01.245139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee27eb7-bc9b-4d0d-b7d4-bedf170183ac admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:01.245432 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee27eb7-bc9b-4d0d-b7d4-bedf170183ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:01.245742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee27eb7-bc9b-4d0d-b7d4-bedf170183ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:01.246487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee27eb7-bc9b-4d0d-b7d4-bedf170183ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:01.248103 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee27eb7-bc9b-4d0d-b7d4-bedf170183ac admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:01.260382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 974/1990] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:01.275277 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c846d-5aa8-4692-ac2d-5a2ccc34adbf admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:01.286311 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c846d-5aa8-4692-ac2d-5a2ccc34adbf admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:01.291575 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12b22c-cf57-4fb9-812f-980abdd69197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:01.292485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12b22c-cf57-4fb9-812f-980abdd69197 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:01.292804 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12b22c-cf57-4fb9-812f-980abdd69197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:01.293088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12b22c-cf57-4fb9-812f-980abdd69197 admin admin] PATH_INFO: `/v3/projects/dc7702aea1574bd8b4a863d704d628f3/users/bd64f0ed4e624569a6f0c071f07dd65d/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:01.310175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12b22c-cf57-4fb9-812f-980abdd69197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc7702aea1574bd8b4a863d704d628f3, user_id=bd64f0ed4e624569a6f0c071f07dd65d, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:01.313065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12b22c-cf57-4fb9-812f-980abdd69197 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:01.371264 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1017/1991] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:01 2022] PUT /identity/v3/projects/dc7702aea1574bd8b4a863d704d628f3/users/bd64f0ed4e624569a6f0c071f07dd65d/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:01.376503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee27eb7-bc9b-4d0d-b7d4-bedf170183ac admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:01.387092 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee27eb7-bc9b-4d0d-b7d4-bedf170183ac admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:01.451275 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e525aa9-8510-446c-8c9a-d06cd22f1db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:01.452208 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e525aa9-8510-446c-8c9a-d06cd22f1db2 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:01.452495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e525aa9-8510-446c-8c9a-d06cd22f1db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:01.452818 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e525aa9-8510-446c-8c9a-d06cd22f1db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:01.453597 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e525aa9-8510-446c-8c9a-d06cd22f1db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:01.455361 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e525aa9-8510-446c-8c9a-d06cd22f1db2 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:01.466376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 975/1992] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:01.470673 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12b22c-cf57-4fb9-812f-980abdd69197 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:01.482140 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12b22c-cf57-4fb9-812f-980abdd69197 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:01.487011 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5cfd8-60b1-4db3-92c8-393aa49897ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:01.487897 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5cfd8-60b1-4db3-92c8-393aa49897ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:01.488180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5cfd8-60b1-4db3-92c8-393aa49897ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:01.488453 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5cfd8-60b1-4db3-92c8-393aa49897ad admin admin] PATH_INFO: `/v3/projects/dc7702aea1574bd8b4a863d704d628f3/users/bd64f0ed4e624569a6f0c071f07dd65d/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:01.490991 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5cfd8-60b1-4db3-92c8-393aa49897ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc7702aea1574bd8b4a863d704d628f3, user_id=bd64f0ed4e624569a6f0c071f07dd65d, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:01.493724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5cfd8-60b1-4db3-92c8-393aa49897ad admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:01.504871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1018/1993] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:01 2022] PUT /identity/v3/projects/dc7702aea1574bd8b4a863d704d628f3/users/bd64f0ed4e624569a6f0c071f07dd65d/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:02:01.514970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe025be-2b2c-4052-bfb1-6e187786c385 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:01.515263 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe025be-2b2c-4052-bfb1-6e187786c385 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:01.515548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe025be-2b2c-4052-bfb1-6e187786c385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:01.545714 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-6fe025be-2b2c-4052-bfb1-6e187786c385 None None] MFA Rules not processed for user `bd64f0ed4e624569a6f0c071f07dd65d`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:01.547098 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6fe025be-2b2c-4052-bfb1-6e187786c385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:01.624398 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 976/1994] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:01.633743 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5cfd8-60b1-4db3-92c8-393aa49897ad admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:01.636198 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-69a5cfd8-60b1-4db3-92c8-393aa49897ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:01.710099 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5cfd8-60b1-4db3-92c8-393aa49897ad admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:01.714011 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aaa328-c009-4f4e-afa5-b7cb5a7729b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:01.714670 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaa328-c009-4f4e-afa5-b7cb5a7729b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:01.715135 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaa328-c009-4f4e-afa5-b7cb5a7729b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:01.715558 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaa328-c009-4f4e-afa5-b7cb5a7729b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:01.728901 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aaa328-c009-4f4e-afa5-b7cb5a7729b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:01.731142 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aaa328-c009-4f4e-afa5-b7cb5a7729b2 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:01.744172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:01.746375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1019/1995] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:01.771477 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:01.858036 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe025be-2b2c-4052-bfb1-6e187786c385 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:01.868172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe025be-2b2c-4052-bfb1-6e187786c385 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:01.873961 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ef4d7-1723-498f-b2db-000c430e67d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:01.874655 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ef4d7-1723-498f-b2db-000c430e67d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:01.874944 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ef4d7-1723-498f-b2db-000c430e67d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:01.875223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ef4d7-1723-498f-b2db-000c430e67d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:01.934709 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ef4d7-1723-498f-b2db-000c430e67d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:01.937991 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ef4d7-1723-498f-b2db-000c430e67d9 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:01.950132 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 977/1996] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:02.794038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:03.290763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:03.610381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:03.856699 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:03.907900 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:04.039642 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:04.068816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:04.233757 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:04.262454 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:04.359274 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:04.387985 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:04.474117 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:04.542917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:04.719407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:INSERT=2,keystone:SELECT=90,keystone:DELETE=8 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:05.079342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:05.130686 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:05.165124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:05.302539 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:05.325439 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:05.536566 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:05.565190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:05.719285 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:05.765207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:05.852698 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:05.976872 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:06.045414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:06.155357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:06.244721 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:06.267542 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:14.778293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aaa328-c009-4f4e-afa5-b7cb5a7729b2 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:14.787497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:14.879682 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aaa328-c009-4f4e-afa5-b7cb5a7729b2 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:14.888871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d04f1b-4e56-47ff-bbc1-0197dc05623e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:14.889872 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d04f1b-4e56-47ff-bbc1-0197dc05623e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:14.890154 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d04f1b-4e56-47ff-bbc1-0197dc05623e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:14.890429 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d04f1b-4e56-47ff-bbc1-0197dc05623e admin admin] PATH_INFO: `/v3/users/bab9bccd5b664e969f80865de3d863e1` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:14.891641 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d04f1b-4e56-47ff-bbc1-0197dc05623e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bab9bccd5b664e969f80865de3d863e1)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:14.894528 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d04f1b-4e56-47ff-bbc1-0197dc05623e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:15.223349 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-77d04f1b-4e56-47ff-bbc1-0197dc05623e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bab9bccd5b664e969f80865de3d863e1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:15.232259 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-77d04f1b-4e56-47ff-bbc1-0197dc05623e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bab9bccd5b664e969f80865de3d863e1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:15.233019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-77d04f1b-4e56-47ff-bbc1-0197dc05623e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bab9bccd5b664e969f80865de3d863e1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:15.238377 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-77d04f1b-4e56-47ff-bbc1-0197dc05623e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bab9bccd5b664e969f80865de3d863e1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:15.246682 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-77d04f1b-4e56-47ff-bbc1-0197dc05623e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bab9bccd5b664e969f80865de3d863e1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:15.318490 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1020/1997] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:02:14 2022] DELETE /identity/v3/users/bab9bccd5b664e969f80865de3d863e1 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:15.323096 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08acc0f-3f52-4e40-b042-7637286c81be None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:15.323592 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08acc0f-3f52-4e40-b042-7637286c81be None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:15.323692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08acc0f-3f52-4e40-b042-7637286c81be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:15.351756 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c08acc0f-3f52-4e40-b042-7637286c81be None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:15.351756 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c08acc0f-3f52-4e40-b042-7637286c81be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:15.400181 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 978/1998] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:15.409735 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d04f1b-4e56-47ff-bbc1-0197dc05623e admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:15.411854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-77d04f1b-4e56-47ff-bbc1-0197dc05623e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:15.469628 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d04f1b-4e56-47ff-bbc1-0197dc05623e admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:15.473431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fbf87-19ed-461c-bc3a-97ef70eb079d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:15.474330 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fbf87-19ed-461c-bc3a-97ef70eb079d service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:15.474733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fbf87-19ed-461c-bc3a-97ef70eb079d service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:15.475098 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fbf87-19ed-461c-bc3a-97ef70eb079d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:15.487430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fbf87-19ed-461c-bc3a-97ef70eb079d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:15.489571 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fbf87-19ed-461c-bc3a-97ef70eb079d service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:15.499764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1021/1999] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:15.973544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08acc0f-3f52-4e40-b042-7637286c81be None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:15.975753 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c08acc0f-3f52-4e40-b042-7637286c81be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:16.003351 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fbf87-19ed-461c-bc3a-97ef70eb079d service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:16.010940 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a51fbf87-19ed-461c-bc3a-97ef70eb079d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:16.018282 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08acc0f-3f52-4e40-b042-7637286c81be None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:16.023342 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54abd4e-f763-4cd0-ac60-c68339743f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:16.024325 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54abd4e-f763-4cd0-ac60-c68339743f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:16.024878 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54abd4e-f763-4cd0-ac60-c68339743f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:16.025267 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54abd4e-f763-4cd0-ac60-c68339743f70 admin admin] PATH_INFO: `/v3/projects/5cd3f08d2802424b99eabe7ef9714fc4` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:16.026863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54abd4e-f763-4cd0-ac60-c68339743f70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd3f08d2802424b99eabe7ef9714fc4)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:16.029012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54abd4e-f763-4cd0-ac60-c68339743f70 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:16.031866 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:16.043848 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:16.069533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fbf87-19ed-461c-bc3a-97ef70eb079d service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:16.073385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534ef1a-8c35-4c1c-9bdf-ca4e4cbe6f66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:16.074032 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534ef1a-8c35-4c1c-9bdf-ca4e4cbe6f66 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:16.074317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534ef1a-8c35-4c1c-9bdf-ca4e4cbe6f66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:16.074597 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534ef1a-8c35-4c1c-9bdf-ca4e4cbe6f66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:16.076398 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6534ef1a-8c35-4c1c-9bdf-ca4e4cbe6f66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:16.141628 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534ef1a-8c35-4c1c-9bdf-ca4e4cbe6f66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:16.143117 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534ef1a-8c35-4c1c-9bdf-ca4e4cbe6f66 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:16.153516 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1022/2000] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:02:16.188667 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f54abd4e-f763-4cd0-ac60-c68339743f70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd3f08d2802424b99eabe7ef9714fc4', 'request_id': 'req-f54abd4e-f763-4cd0-ac60-c68339743f70'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:16.318862 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f54abd4e-f763-4cd0-ac60-c68339743f70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd3f08d2802424b99eabe7ef9714fc4', 'request_id': 'req-f54abd4e-f763-4cd0-ac60-c68339743f70'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:16.325674 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f54abd4e-f763-4cd0-ac60-c68339743f70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd3f08d2802424b99eabe7ef9714fc4', 'request_id': 'req-f54abd4e-f763-4cd0-ac60-c68339743f70'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:16.337066 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f54abd4e-f763-4cd0-ac60-c68339743f70 admin admin] The token cache is being invalidate because project 5cd3f08d2802424b99eabe7ef9714fc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:02:16.337368 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f54abd4e-f763-4cd0-ac60-c68339743f70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:16.338033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f54abd4e-f763-4cd0-ac60-c68339743f70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:16.339592 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 979/2001] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:02:15 2022] DELETE /identity/v3/projects/5cd3f08d2802424b99eabe7ef9714fc4 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:16.343687 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534ef1a-8c35-4c1c-9bdf-ca4e4cbe6f66 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:16.354905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534ef1a-8c35-4c1c-9bdf-ca4e4cbe6f66 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:16.410520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6052ee-bc10-42c4-a34a-ecdc4ff4ea61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:16.411962 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6052ee-bc10-42c4-a34a-ecdc4ff4ea61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:16.412193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6052ee-bc10-42c4-a34a-ecdc4ff4ea61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:16.412466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6052ee-bc10-42c4-a34a-ecdc4ff4ea61 admin admin] PATH_INFO: `/v3/users/bd64f0ed4e624569a6f0c071f07dd65d` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:16.413673 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6052ee-bc10-42c4-a34a-ecdc4ff4ea61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd64f0ed4e624569a6f0c071f07dd65d)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:16.415633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6052ee-bc10-42c4-a34a-ecdc4ff4ea61 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:16.755791 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2c6052ee-bc10-42c4-a34a-ecdc4ff4ea61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd64f0ed4e624569a6f0c071f07dd65d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:16.762582 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2c6052ee-bc10-42c4-a34a-ecdc4ff4ea61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd64f0ed4e624569a6f0c071f07dd65d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:16.763257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2c6052ee-bc10-42c4-a34a-ecdc4ff4ea61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd64f0ed4e624569a6f0c071f07dd65d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:16.763880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2c6052ee-bc10-42c4-a34a-ecdc4ff4ea61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd64f0ed4e624569a6f0c071f07dd65d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:16.775741 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2c6052ee-bc10-42c4-a34a-ecdc4ff4ea61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd64f0ed4e624569a6f0c071f07dd65d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:16.879354 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1023/2002] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:02:16 2022] DELETE /identity/v3/users/bd64f0ed4e624569a6f0c071f07dd65d => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:17.086718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:17.468924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54abd4e-f763-4cd0-ac60-c68339743f70 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:17.470597 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f54abd4e-f763-4cd0-ac60-c68339743f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:17.488813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54abd4e-f763-4cd0-ac60-c68339743f70 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:17.547328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d6e03-79f7-49a7-94d0-ae87812c709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:17.548200 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d6e03-79f7-49a7-94d0-ae87812c709a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:17.548487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d6e03-79f7-49a7-94d0-ae87812c709a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:17.548788 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d6e03-79f7-49a7-94d0-ae87812c709a admin admin] PATH_INFO: `/v3/projects/dc7702aea1574bd8b4a863d704d628f3` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:17.550002 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d6e03-79f7-49a7-94d0-ae87812c709a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc7702aea1574bd8b4a863d704d628f3)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:17.552686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d6e03-79f7-49a7-94d0-ae87812c709a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:17.757617 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a21d6e03-79f7-49a7-94d0-ae87812c709a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc7702aea1574bd8b4a863d704d628f3', 'request_id': 'req-a21d6e03-79f7-49a7-94d0-ae87812c709a'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:17.930326 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a21d6e03-79f7-49a7-94d0-ae87812c709a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc7702aea1574bd8b4a863d704d628f3', 'request_id': 'req-a21d6e03-79f7-49a7-94d0-ae87812c709a'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:17.937049 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a21d6e03-79f7-49a7-94d0-ae87812c709a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc7702aea1574bd8b4a863d704d628f3', 'request_id': 'req-a21d6e03-79f7-49a7-94d0-ae87812c709a'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:17.947787 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a21d6e03-79f7-49a7-94d0-ae87812c709a admin admin] The token cache is being invalidate because project dc7702aea1574bd8b4a863d704d628f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:02:17.948076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a21d6e03-79f7-49a7-94d0-ae87812c709a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:17.948788 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a21d6e03-79f7-49a7-94d0-ae87812c709a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:17.950353 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 980/2003] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:02:17 2022] DELETE /identity/v3/projects/dc7702aea1574bd8b4a863d704d628f3 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:17.955270 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4e505-1f9e-4241-924f-5ab8d978838e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:17.955565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4e505-1f9e-4241-924f-5ab8d978838e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:17.955853 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4e505-1f9e-4241-924f-5ab8d978838e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:17.974819 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-f8b4e505-1f9e-4241-924f-5ab8d978838e None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:17.976028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f8b4e505-1f9e-4241-924f-5ab8d978838e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:18.033493 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1024/2004] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:18.041874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752bf52-d7b4-4cf5-becc-e5d861d3bef3 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:18.042234 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752bf52-d7b4-4cf5-becc-e5d861d3bef3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:18.042445 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752bf52-d7b4-4cf5-becc-e5d861d3bef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:18.062938 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e752bf52-d7b4-4cf5-becc-e5d861d3bef3 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:18.064262 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e752bf52-d7b4-4cf5-becc-e5d861d3bef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:18.072740 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 981/2005] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:18.076941 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4e505-1f9e-4241-924f-5ab8d978838e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:18.087807 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4e505-1f9e-4241-924f-5ab8d978838e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:18.092350 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc126c7f-8edd-4962-a64a-c5dbdc10e916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:18.093034 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc126c7f-8edd-4962-a64a-c5dbdc10e916 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:18.093316 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc126c7f-8edd-4962-a64a-c5dbdc10e916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:18.093617 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc126c7f-8edd-4962-a64a-c5dbdc10e916 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:18.094343 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc126c7f-8edd-4962-a64a-c5dbdc10e916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:02:18.094650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc126c7f-8edd-4962-a64a-c5dbdc10e916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:18.096304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc126c7f-8edd-4962-a64a-c5dbdc10e916 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:18.108904 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1025/2006] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:02:18.113210 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752bf52-d7b4-4cf5-becc-e5d861d3bef3 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:18.122803 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752bf52-d7b4-4cf5-becc-e5d861d3bef3 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:18.127544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46368cf1-4664-4e93-91e1-42f6a7088369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:18.128192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46368cf1-4664-4e93-91e1-42f6a7088369 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:18.128481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46368cf1-4664-4e93-91e1-42f6a7088369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:18.128799 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46368cf1-4664-4e93-91e1-42f6a7088369 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:18.129529 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46368cf1-4664-4e93-91e1-42f6a7088369 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:18.131426 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46368cf1-4664-4e93-91e1-42f6a7088369 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:18.144297 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:18.209499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 982/2007] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:02:18 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:18.210791 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc126c7f-8edd-4962-a64a-c5dbdc10e916 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:18.221737 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc126c7f-8edd-4962-a64a-c5dbdc10e916 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:18.279855 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ffb67-7e39-48d5-a0d4-ec2ce3d2e822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:18.280551 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ffb67-7e39-48d5-a0d4-ec2ce3d2e822 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:18.280866 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ffb67-7e39-48d5-a0d4-ec2ce3d2e822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:18.281146 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ffb67-7e39-48d5-a0d4-ec2ce3d2e822 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:18.281834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ffb67-7e39-48d5-a0d4-ec2ce3d2e822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:18.283764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ffb67-7e39-48d5-a0d4-ec2ce3d2e822 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:18.392411 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1026/2008] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:02:18 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:18.396821 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46368cf1-4664-4e93-91e1-42f6a7088369 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:18.408791 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46368cf1-4664-4e93-91e1-42f6a7088369 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:18.413555 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344231b-afb7-45f2-9bd8-e47ad333a57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:18.414212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344231b-afb7-45f2-9bd8-e47ad333a57d admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:18.414497 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344231b-afb7-45f2-9bd8-e47ad333a57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:18.414775 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344231b-afb7-45f2-9bd8-e47ad333a57d admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:18.415502 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344231b-afb7-45f2-9bd8-e47ad333a57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:18.417173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344231b-afb7-45f2-9bd8-e47ad333a57d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:18.427779 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 983/2009] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:18.431728 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ffb67-7e39-48d5-a0d4-ec2ce3d2e822 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:18.441998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ffb67-7e39-48d5-a0d4-ec2ce3d2e822 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:18.447315 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c49d9-314c-430b-a092-d96542f8c0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:18.448202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c49d9-314c-430b-a092-d96542f8c0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:18.448628 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c49d9-314c-430b-a092-d96542f8c0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:18.448938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c49d9-314c-430b-a092-d96542f8c0b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:18.449738 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c49d9-314c-430b-a092-d96542f8c0b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:18.451464 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c49d9-314c-430b-a092-d96542f8c0b1 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:18.466513 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1027/2010] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:02:18.470523 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344231b-afb7-45f2-9bd8-e47ad333a57d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:18.480772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344231b-afb7-45f2-9bd8-e47ad333a57d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:18.485610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9804b-d529-4d68-aec7-58ffc33b3de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:18.486483 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9804b-d529-4d68-aec7-58ffc33b3de9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:18.486767 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9804b-d529-4d68-aec7-58ffc33b3de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:18.487043 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9804b-d529-4d68-aec7-58ffc33b3de9 admin admin] PATH_INFO: `/v3/projects/63db4b4403d940cda3ea01b1c0ddbcf3/users/7ebe29f1ed5449018d61ac36cddc8ae2/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:18.501658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9804b-d529-4d68-aec7-58ffc33b3de9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63db4b4403d940cda3ea01b1c0ddbcf3, user_id=7ebe29f1ed5449018d61ac36cddc8ae2, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:18.504348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9804b-d529-4d68-aec7-58ffc33b3de9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:18.581491 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 984/2011] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:18 2022] PUT /identity/v3/projects/63db4b4403d940cda3ea01b1c0ddbcf3/users/7ebe29f1ed5449018d61ac36cddc8ae2/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:18.593146 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c13d0-2507-40fa-b4d1-749a1e02d926 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:18.593438 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c13d0-2507-40fa-b4d1-749a1e02d926 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:18.593718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c13d0-2507-40fa-b4d1-749a1e02d926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:18.620097 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-e07c13d0-2507-40fa-b4d1-749a1e02d926 None None] MFA Rules not processed for user `7ebe29f1ed5449018d61ac36cddc8ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:18.621335 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e07c13d0-2507-40fa-b4d1-749a1e02d926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:18.675289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:18.685521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1028/2012] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:18.689931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9804b-d529-4d68-aec7-58ffc33b3de9 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:18.751458 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9804b-d529-4d68-aec7-58ffc33b3de9 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:18.756617 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fd603-1f59-4b0f-8d31-d2c858b6e603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:18.757324 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fd603-1f59-4b0f-8d31-d2c858b6e603 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:18.757604 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fd603-1f59-4b0f-8d31-d2c858b6e603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:18.757875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fd603-1f59-4b0f-8d31-d2c858b6e603 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:18.758558 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195fd603-1f59-4b0f-8d31-d2c858b6e603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:18.760456 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195fd603-1f59-4b0f-8d31-d2c858b6e603 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:18.845569 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 985/2013] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:02:18 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:18.849592 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c13d0-2507-40fa-b4d1-749a1e02d926 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:18.860509 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c13d0-2507-40fa-b4d1-749a1e02d926 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:18.916493 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babb533-fbf2-476e-bc20-5c1016df3e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:18.917201 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babb533-fbf2-476e-bc20-5c1016df3e12 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:18.917486 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babb533-fbf2-476e-bc20-5c1016df3e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:18.917765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babb533-fbf2-476e-bc20-5c1016df3e12 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:18.918454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5babb533-fbf2-476e-bc20-5c1016df3e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:18.920408 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5babb533-fbf2-476e-bc20-5c1016df3e12 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:18.999042 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1029/2014] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:02:18 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:19.002875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fd603-1f59-4b0f-8d31-d2c858b6e603 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:19.013176 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fd603-1f59-4b0f-8d31-d2c858b6e603 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:19.017974 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6329cd-8ab0-4c0b-8ebc-42199bac64a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:19.018636 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6329cd-8ab0-4c0b-8ebc-42199bac64a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:19.018942 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6329cd-8ab0-4c0b-8ebc-42199bac64a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:19.019203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6329cd-8ab0-4c0b-8ebc-42199bac64a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:19.019927 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6329cd-8ab0-4c0b-8ebc-42199bac64a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:19.021631 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6329cd-8ab0-4c0b-8ebc-42199bac64a8 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:19.032145 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 986/2015] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:19.036530 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babb533-fbf2-476e-bc20-5c1016df3e12 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:19.046480 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babb533-fbf2-476e-bc20-5c1016df3e12 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:19.051284 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e62f39-1452-47a9-aac9-f76fadaff4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:19.052760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e62f39-1452-47a9-aac9-f76fadaff4ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:19.053046 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e62f39-1452-47a9-aac9-f76fadaff4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:19.053327 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e62f39-1452-47a9-aac9-f76fadaff4ca admin admin] PATH_INFO: `/v3/projects/3ca8bbbc65ad4e9cbf3e1b8a06d30cab/users/ba44b36f3d0c4eebb0bf320e1f48aba1/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:19.068249 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e62f39-1452-47a9-aac9-f76fadaff4ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ca8bbbc65ad4e9cbf3e1b8a06d30cab, user_id=ba44b36f3d0c4eebb0bf320e1f48aba1, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:19.070993 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e62f39-1452-47a9-aac9-f76fadaff4ca admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:19.135336 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1030/2016] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:19 2022] PUT /identity/v3/projects/3ca8bbbc65ad4e9cbf3e1b8a06d30cab/users/ba44b36f3d0c4eebb0bf320e1f48aba1/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:19.139224 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6329cd-8ab0-4c0b-8ebc-42199bac64a8 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:19.149069 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6329cd-8ab0-4c0b-8ebc-42199bac64a8 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:19.216094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acadb50-b353-4a76-bb9f-91fc9ea43396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:19.216706 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acadb50-b353-4a76-bb9f-91fc9ea43396 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:19.216997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acadb50-b353-4a76-bb9f-91fc9ea43396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:19.217276 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acadb50-b353-4a76-bb9f-91fc9ea43396 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:19.218034 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acadb50-b353-4a76-bb9f-91fc9ea43396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:19.219630 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acadb50-b353-4a76-bb9f-91fc9ea43396 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:19.230471 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 987/2017] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:19.234396 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e62f39-1452-47a9-aac9-f76fadaff4ca admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:19.245261 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e62f39-1452-47a9-aac9-f76fadaff4ca admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:19.249951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53513a38-d405-4f3a-96eb-9ddb6883c8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:19.250839 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53513a38-d405-4f3a-96eb-9ddb6883c8cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:19.251119 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53513a38-d405-4f3a-96eb-9ddb6883c8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:19.251393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53513a38-d405-4f3a-96eb-9ddb6883c8cd admin admin] PATH_INFO: `/v3/projects/3ca8bbbc65ad4e9cbf3e1b8a06d30cab/users/ba44b36f3d0c4eebb0bf320e1f48aba1/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:19.253415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53513a38-d405-4f3a-96eb-9ddb6883c8cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ca8bbbc65ad4e9cbf3e1b8a06d30cab, user_id=ba44b36f3d0c4eebb0bf320e1f48aba1, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:19.256105 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53513a38-d405-4f3a-96eb-9ddb6883c8cd admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:19.267276 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1031/2018] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:19 2022] PUT /identity/v3/projects/3ca8bbbc65ad4e9cbf3e1b8a06d30cab/users/ba44b36f3d0c4eebb0bf320e1f48aba1/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:02:19.285335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292bbb0-dda1-4742-96c5-7a780fbead3f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:19.285635 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292bbb0-dda1-4742-96c5-7a780fbead3f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:19.285919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292bbb0-dda1-4742-96c5-7a780fbead3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:19.315035 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2292bbb0-dda1-4742-96c5-7a780fbead3f None None] MFA Rules not processed for user `ba44b36f3d0c4eebb0bf320e1f48aba1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:19.316253 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2292bbb0-dda1-4742-96c5-7a780fbead3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:19.332421 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:19.385055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 988/2019] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:19.396658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53513a38-d405-4f3a-96eb-9ddb6883c8cd admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:19.398366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-53513a38-d405-4f3a-96eb-9ddb6883c8cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:19.460098 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53513a38-d405-4f3a-96eb-9ddb6883c8cd admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:19.463745 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739c2f6-5191-4fce-88b4-4d575f1f1655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:19.464530 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739c2f6-5191-4fce-88b4-4d575f1f1655 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:19.464843 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739c2f6-5191-4fce-88b4-4d575f1f1655 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:19.465086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739c2f6-5191-4fce-88b4-4d575f1f1655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:19.522664 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739c2f6-5191-4fce-88b4-4d575f1f1655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:19.524118 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739c2f6-5191-4fce-88b4-4d575f1f1655 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:19.529335 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:19.534095 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1032/2020] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:26.365005 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292bbb0-dda1-4742-96c5-7a780fbead3f None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:26.430913 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292bbb0-dda1-4742-96c5-7a780fbead3f None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:26.436441 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64012d5-fed4-4558-815d-f22df60e2af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:26.437443 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64012d5-fed4-4558-815d-f22df60e2af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:26.437728 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64012d5-fed4-4558-815d-f22df60e2af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:26.438005 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64012d5-fed4-4558-815d-f22df60e2af4 admin admin] PATH_INFO: `/v3/users/7ebe29f1ed5449018d61ac36cddc8ae2` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:26.439323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64012d5-fed4-4558-815d-f22df60e2af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ebe29f1ed5449018d61ac36cddc8ae2)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:26.441424 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64012d5-fed4-4558-815d-f22df60e2af4 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:26.668606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f64012d5-fed4-4558-815d-f22df60e2af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ebe29f1ed5449018d61ac36cddc8ae2'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:26.675913 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f64012d5-fed4-4558-815d-f22df60e2af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ebe29f1ed5449018d61ac36cddc8ae2'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:26.676733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f64012d5-fed4-4558-815d-f22df60e2af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ebe29f1ed5449018d61ac36cddc8ae2'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:26.682572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f64012d5-fed4-4558-815d-f22df60e2af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ebe29f1ed5449018d61ac36cddc8ae2'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:26.689350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f64012d5-fed4-4558-815d-f22df60e2af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ebe29f1ed5449018d61ac36cddc8ae2'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:26.753163 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 989/2021] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:02:26 2022] DELETE /identity/v3/users/7ebe29f1ed5449018d61ac36cddc8ae2 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:26.758124 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e249d5-56b4-496d-8a28-a9824d8fbc88 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:26.758625 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e249d5-56b4-496d-8a28-a9824d8fbc88 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:26.758731 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e249d5-56b4-496d-8a28-a9824d8fbc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:26.776767 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-f0e249d5-56b4-496d-8a28-a9824d8fbc88 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:26.777989 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f0e249d5-56b4-496d-8a28-a9824d8fbc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:26.842562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1033/2022] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:26.852654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64012d5-fed4-4558-815d-f22df60e2af4 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:26.854151 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f64012d5-fed4-4558-815d-f22df60e2af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:26.894781 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:26.917564 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64012d5-fed4-4558-815d-f22df60e2af4 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:26.922263 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350f024-14ab-4d12-b833-4b68a8e926d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:26.922263 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350f024-14ab-4d12-b833-4b68a8e926d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:26.922263 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350f024-14ab-4d12-b833-4b68a8e926d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:26.922595 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350f024-14ab-4d12-b833-4b68a8e926d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:26.932536 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350f024-14ab-4d12-b833-4b68a8e926d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:26.934156 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350f024-14ab-4d12-b833-4b68a8e926d4 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:26.946457 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 990/2023] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:27.390926 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e249d5-56b4-496d-8a28-a9824d8fbc88 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:27.391901 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f0e249d5-56b4-496d-8a28-a9824d8fbc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:27.407575 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e249d5-56b4-496d-8a28-a9824d8fbc88 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:27.413427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0d66f-8a31-457b-be87-a3193b415bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:27.414356 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0d66f-8a31-457b-be87-a3193b415bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:27.414938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0d66f-8a31-457b-be87-a3193b415bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:27.414938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0d66f-8a31-457b-be87-a3193b415bb4 admin admin] PATH_INFO: `/v3/projects/63db4b4403d940cda3ea01b1c0ddbcf3` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:27.417150 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0d66f-8a31-457b-be87-a3193b415bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63db4b4403d940cda3ea01b1c0ddbcf3)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:27.419684 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0d66f-8a31-457b-be87-a3193b415bb4 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:27.560207 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-83f0d66f-8a31-457b-be87-a3193b415bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63db4b4403d940cda3ea01b1c0ddbcf3', 'request_id': 'req-83f0d66f-8a31-457b-be87-a3193b415bb4'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:27.565852 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-83f0d66f-8a31-457b-be87-a3193b415bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63db4b4403d940cda3ea01b1c0ddbcf3', 'request_id': 'req-83f0d66f-8a31-457b-be87-a3193b415bb4'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:27.572297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-83f0d66f-8a31-457b-be87-a3193b415bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63db4b4403d940cda3ea01b1c0ddbcf3', 'request_id': 'req-83f0d66f-8a31-457b-be87-a3193b415bb4'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:27.656467 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-83f0d66f-8a31-457b-be87-a3193b415bb4 admin admin] The token cache is being invalidate because project 63db4b4403d940cda3ea01b1c0ddbcf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:02:27.656714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-83f0d66f-8a31-457b-be87-a3193b415bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:27.657458 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-83f0d66f-8a31-457b-be87-a3193b415bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:27.659141 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1034/2024] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:02:27 2022] DELETE /identity/v3/projects/63db4b4403d940cda3ea01b1c0ddbcf3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:27.667286 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350f024-14ab-4d12-b833-4b68a8e926d4 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:27.679268 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350f024-14ab-4d12-b833-4b68a8e926d4 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:27.740189 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d01309-9ff8-41f5-9d90-b5ff901b3bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:27.741098 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d01309-9ff8-41f5-9d90-b5ff901b3bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:27.741382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d01309-9ff8-41f5-9d90-b5ff901b3bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:27.741659 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d01309-9ff8-41f5-9d90-b5ff901b3bc7 admin admin] PATH_INFO: `/v3/users/ba44b36f3d0c4eebb0bf320e1f48aba1` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:27.743006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d01309-9ff8-41f5-9d90-b5ff901b3bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba44b36f3d0c4eebb0bf320e1f48aba1)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:27.745113 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d01309-9ff8-41f5-9d90-b5ff901b3bc7 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:28.018409 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f2d01309-9ff8-41f5-9d90-b5ff901b3bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba44b36f3d0c4eebb0bf320e1f48aba1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:28.027476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f2d01309-9ff8-41f5-9d90-b5ff901b3bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba44b36f3d0c4eebb0bf320e1f48aba1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:28.028981 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f2d01309-9ff8-41f5-9d90-b5ff901b3bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba44b36f3d0c4eebb0bf320e1f48aba1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:28.029640 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f2d01309-9ff8-41f5-9d90-b5ff901b3bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba44b36f3d0c4eebb0bf320e1f48aba1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:28.045891 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f2d01309-9ff8-41f5-9d90-b5ff901b3bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba44b36f3d0c4eebb0bf320e1f48aba1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:28.166812 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 991/2025] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:02:27 2022] DELETE /identity/v3/users/ba44b36f3d0c4eebb0bf320e1f48aba1 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:28.219489 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0d66f-8a31-457b-be87-a3193b415bb4 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:28.221719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-83f0d66f-8a31-457b-be87-a3193b415bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:28.236866 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0d66f-8a31-457b-be87-a3193b415bb4 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:28.302530 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6386b-f189-4279-8028-9dffc81b0338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:28.303449 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6386b-f189-4279-8028-9dffc81b0338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:28.303724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6386b-f189-4279-8028-9dffc81b0338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:28.304049 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6386b-f189-4279-8028-9dffc81b0338 admin admin] PATH_INFO: `/v3/users/b017de8a373842a385c0fb9dca571893` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:28.305846 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6386b-f189-4279-8028-9dffc81b0338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b017de8a373842a385c0fb9dca571893)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:28.309182 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6386b-f189-4279-8028-9dffc81b0338 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:28.416363 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:28.546768 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-26a6386b-f189-4279-8028-9dffc81b0338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b017de8a373842a385c0fb9dca571893'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:28.553834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-26a6386b-f189-4279-8028-9dffc81b0338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b017de8a373842a385c0fb9dca571893'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:28.554541 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-26a6386b-f189-4279-8028-9dffc81b0338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b017de8a373842a385c0fb9dca571893'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:28.555266 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-26a6386b-f189-4279-8028-9dffc81b0338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b017de8a373842a385c0fb9dca571893'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:28.567761 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-26a6386b-f189-4279-8028-9dffc81b0338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b017de8a373842a385c0fb9dca571893'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:28.720893 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d01309-9ff8-41f5-9d90-b5ff901b3bc7 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:28.722433 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f2d01309-9ff8-41f5-9d90-b5ff901b3bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:28.727191 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1035/2026] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:02:28 2022] DELETE /identity/v3/users/b017de8a373842a385c0fb9dca571893 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:28.736315 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052d654-7d8d-4af9-993d-300ee057aaf2 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:28.736989 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052d654-7d8d-4af9-993d-300ee057aaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:28.737116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052d654-7d8d-4af9-993d-300ee057aaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:28.741706 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d01309-9ff8-41f5-9d90-b5ff901b3bc7 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:28.762946 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a052d654-7d8d-4af9-993d-300ee057aaf2 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:28.763174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a052d654-7d8d-4af9-993d-300ee057aaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:28.809594 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:28.818915 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4a016-c08a-4200-81a7-d7bd1fdcb170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:28.819970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4a016-c08a-4200-81a7-d7bd1fdcb170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:28.820375 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4a016-c08a-4200-81a7-d7bd1fdcb170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:28.820699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4a016-c08a-4200-81a7-d7bd1fdcb170 admin admin] PATH_INFO: `/v3/projects/3ca8bbbc65ad4e9cbf3e1b8a06d30cab` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:28.821950 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4a016-c08a-4200-81a7-d7bd1fdcb170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ca8bbbc65ad4e9cbf3e1b8a06d30cab)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:28.824119 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4a016-c08a-4200-81a7-d7bd1fdcb170 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:28.832228 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1036/2027] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:28.844747 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052d654-7d8d-4af9-993d-300ee057aaf2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:28.845709 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a052d654-7d8d-4af9-993d-300ee057aaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:28.927229 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052d654-7d8d-4af9-993d-300ee057aaf2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:28.935222 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888adb4-8671-4fac-914d-21396df0902b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:28.935897 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888adb4-8671-4fac-914d-21396df0902b service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:28.936233 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888adb4-8671-4fac-914d-21396df0902b service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:28.937314 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888adb4-8671-4fac-914d-21396df0902b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:28.951135 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888adb4-8671-4fac-914d-21396df0902b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:28.953175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888adb4-8671-4fac-914d-21396df0902b service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:28.968524 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1037/2028] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:28.976207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3ac4a016-c08a-4200-81a7-d7bd1fdcb170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ca8bbbc65ad4e9cbf3e1b8a06d30cab', 'request_id': 'req-3ac4a016-c08a-4200-81a7-d7bd1fdcb170'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:29.055507 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3ac4a016-c08a-4200-81a7-d7bd1fdcb170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ca8bbbc65ad4e9cbf3e1b8a06d30cab', 'request_id': 'req-3ac4a016-c08a-4200-81a7-d7bd1fdcb170'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:29.067529 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3ac4a016-c08a-4200-81a7-d7bd1fdcb170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ca8bbbc65ad4e9cbf3e1b8a06d30cab', 'request_id': 'req-3ac4a016-c08a-4200-81a7-d7bd1fdcb170'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:29.088214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3ac4a016-c08a-4200-81a7-d7bd1fdcb170 admin admin] The token cache is being invalidate because project 3ca8bbbc65ad4e9cbf3e1b8a06d30cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:02:29.088554 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3ac4a016-c08a-4200-81a7-d7bd1fdcb170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:29.090814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3ac4a016-c08a-4200-81a7-d7bd1fdcb170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:29.099173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 992/2029] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:02:28 2022] DELETE /identity/v3/projects/3ca8bbbc65ad4e9cbf3e1b8a06d30cab => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:29.104940 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ce0e0-3842-47d7-968f-a1b3ad335945 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:29.105283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ce0e0-3842-47d7-968f-a1b3ad335945 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:29.105605 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ce0e0-3842-47d7-968f-a1b3ad335945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:29.132938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-0e5ce0e0-3842-47d7-968f-a1b3ad335945 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:29.134271 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0e5ce0e0-3842-47d7-968f-a1b3ad335945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:29.178159 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:29.197460 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1038/2030] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:29.205228 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba06ca9-1b7e-4ca0-acb3-b42f7b331839 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:29.205526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba06ca9-1b7e-4ca0-acb3-b42f7b331839 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:29.205811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba06ca9-1b7e-4ca0-acb3-b42f7b331839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:29.225931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-4ba06ca9-1b7e-4ca0-acb3-b42f7b331839 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:29.227381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4ba06ca9-1b7e-4ca0-acb3-b42f7b331839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:29.236876 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 993/2031] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:29.240829 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ce0e0-3842-47d7-968f-a1b3ad335945 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:29.250988 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ce0e0-3842-47d7-968f-a1b3ad335945 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:29.256328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec943d-6da7-412d-9d68-b4cea6a69960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:29.257037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec943d-6da7-412d-9d68-b4cea6a69960 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:29.257321 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec943d-6da7-412d-9d68-b4cea6a69960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:29.257604 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec943d-6da7-412d-9d68-b4cea6a69960 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:29.258332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec943d-6da7-412d-9d68-b4cea6a69960 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:02:29.258657 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec943d-6da7-412d-9d68-b4cea6a69960 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:29.260314 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec943d-6da7-412d-9d68-b4cea6a69960 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:29.272538 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1039/2032] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:02:29.277808 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba06ca9-1b7e-4ca0-acb3-b42f7b331839 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:29.289442 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba06ca9-1b7e-4ca0-acb3-b42f7b331839 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:29.289833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec943d-6da7-412d-9d68-b4cea6a69960 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:29.292166 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8fec943d-6da7-412d-9d68-b4cea6a69960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:29.294951 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134ada9-7638-49dd-9b35-415bae6cad12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:29.295615 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134ada9-7638-49dd-9b35-415bae6cad12 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:29.295900 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134ada9-7638-49dd-9b35-415bae6cad12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:29.296629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134ada9-7638-49dd-9b35-415bae6cad12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:29.297008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134ada9-7638-49dd-9b35-415bae6cad12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:29.299047 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134ada9-7638-49dd-9b35-415bae6cad12 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:29.306834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec943d-6da7-412d-9d68-b4cea6a69960 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:29.312149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b7c8f-ca65-43ed-8934-ae8de707182b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:29.318652 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b7c8f-ca65-43ed-8934-ae8de707182b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:29.318652 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b7c8f-ca65-43ed-8934-ae8de707182b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:29.319561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b7c8f-ca65-43ed-8934-ae8de707182b admin admin] PATH_INFO: `/v3/users/e4959878a26b4e748a517013c7917983` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:29.322929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b7c8f-ca65-43ed-8934-ae8de707182b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4959878a26b4e748a517013c7917983)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:29.324945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b7c8f-ca65-43ed-8934-ae8de707182b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:29.452576 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 994/2033] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:02:29 2022] POST /identity/v3/projects => generated 369 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:29.453572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134ada9-7638-49dd-9b35-415bae6cad12 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:29.518006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0d8b7c8f-ca65-43ed-8934-ae8de707182b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4959878a26b4e748a517013c7917983'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:29.524557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134ada9-7638-49dd-9b35-415bae6cad12 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:29.525864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0d8b7c8f-ca65-43ed-8934-ae8de707182b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4959878a26b4e748a517013c7917983'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:29.526674 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0d8b7c8f-ca65-43ed-8934-ae8de707182b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4959878a26b4e748a517013c7917983'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:29.527402 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0d8b7c8f-ca65-43ed-8934-ae8de707182b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4959878a26b4e748a517013c7917983'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:29.530000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6538f79-141b-4d1c-83f9-0525ba5dd6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:29.530699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6538f79-141b-4d1c-83f9-0525ba5dd6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:29.531024 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6538f79-141b-4d1c-83f9-0525ba5dd6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:29.531328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6538f79-141b-4d1c-83f9-0525ba5dd6e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:29.532533 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6538f79-141b-4d1c-83f9-0525ba5dd6e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:29.534562 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6538f79-141b-4d1c-83f9-0525ba5dd6e3 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:29.542692 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0d8b7c8f-ca65-43ed-8934-ae8de707182b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4959878a26b4e748a517013c7917983'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:29.606347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1040/2034] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:02:29 2022] DELETE /identity/v3/users/e4959878a26b4e748a517013c7917983 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:02:29.611319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95005149-5619-4130-908d-be5eef8d2bbf None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:29.613405 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95005149-5619-4130-908d-be5eef8d2bbf None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:29.613721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95005149-5619-4130-908d-be5eef8d2bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:29.639502 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 995/2035] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:02:29 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:29.642416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-95005149-5619-4130-908d-be5eef8d2bbf None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:29.644276 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6538f79-141b-4d1c-83f9-0525ba5dd6e3 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:29.645707 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-95005149-5619-4130-908d-be5eef8d2bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:29.647284 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a6538f79-141b-4d1c-83f9-0525ba5dd6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:29.675070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6538f79-141b-4d1c-83f9-0525ba5dd6e3 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:29.746291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1041/2036] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:02:29.757928 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95005149-5619-4130-908d-be5eef8d2bbf None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:29.759815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-95005149-5619-4130-908d-be5eef8d2bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:29.792620 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:29.814124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d7bf6-e4a8-4e9c-9140-43d8f643af73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:29.814124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d7bf6-e4a8-4e9c-9140-43d8f643af73 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:29.814124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d7bf6-e4a8-4e9c-9140-43d8f643af73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:29.814124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d7bf6-e4a8-4e9c-9140-43d8f643af73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:29.814717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d7bf6-e4a8-4e9c-9140-43d8f643af73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:29.814717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d7bf6-e4a8-4e9c-9140-43d8f643af73 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:29.829296 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 996/2037] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:02:29.830342 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d7bf6-e4a8-4e9c-9140-43d8f643af73 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:29.841233 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d7bf6-e4a8-4e9c-9140-43d8f643af73 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:29.846021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd2a31-7ae9-4c9a-afa7-bae82440162a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:29.846721 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd2a31-7ae9-4c9a-afa7-bae82440162a admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:29.847011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd2a31-7ae9-4c9a-afa7-bae82440162a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:29.847296 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd2a31-7ae9-4c9a-afa7-bae82440162a admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:29.848565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd2a31-7ae9-4c9a-afa7-bae82440162a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:29.850574 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd2a31-7ae9-4c9a-afa7-bae82440162a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:29.855752 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95005149-5619-4130-908d-be5eef8d2bbf None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:29.859739 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7829628-839b-4b57-9ede-f55b5c8cdaf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:29.860489 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7829628-839b-4b57-9ede-f55b5c8cdaf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:29.860798 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7829628-839b-4b57-9ede-f55b5c8cdaf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:29.861077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7829628-839b-4b57-9ede-f55b5c8cdaf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:29.864626 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 997/2038] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:29.873917 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd2a31-7ae9-4c9a-afa7-bae82440162a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:29.874817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7829628-839b-4b57-9ede-f55b5c8cdaf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:29.876387 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7829628-839b-4b57-9ede-f55b5c8cdaf1 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:29.889183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1042/2039] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:29.890061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7829628-839b-4b57-9ede-f55b5c8cdaf1 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:29.890711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd2a31-7ae9-4c9a-afa7-bae82440162a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:29.892510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d7829628-839b-4b57-9ede-f55b5c8cdaf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:29.896205 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6e5ee-1a53-4f7f-a1d7-2c3232b88152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:29.897140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6e5ee-1a53-4f7f-a1d7-2c3232b88152 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:29.897687 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6e5ee-1a53-4f7f-a1d7-2c3232b88152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:29.897976 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6e5ee-1a53-4f7f-a1d7-2c3232b88152 admin admin] PATH_INFO: `/v3/projects/9dc0dd8fe2b348c7bf4fc7c40fc6bd38/users/c83ad6705b9c4b069518abe597bab955/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:29.923915 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6e5ee-1a53-4f7f-a1d7-2c3232b88152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc0dd8fe2b348c7bf4fc7c40fc6bd38, user_id=c83ad6705b9c4b069518abe597bab955, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:29.931603 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7829628-839b-4b57-9ede-f55b5c8cdaf1 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:29.932890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6e5ee-1a53-4f7f-a1d7-2c3232b88152 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:29.937181 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e0eb2-e67f-44ac-9037-0a9f1400edaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:29.938279 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e0eb2-e67f-44ac-9037-0a9f1400edaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:29.938613 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e0eb2-e67f-44ac-9037-0a9f1400edaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:29.938836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e0eb2-e67f-44ac-9037-0a9f1400edaf admin admin] PATH_INFO: `/v3/projects/6d007a67e4794fa09719c18cafcec51c` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:29.940306 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e0eb2-e67f-44ac-9037-0a9f1400edaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d007a67e4794fa09719c18cafcec51c)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:29.944474 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e0eb2-e67f-44ac-9037-0a9f1400edaf admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:30.069212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 998/2040] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:29 2022] PUT /identity/v3/projects/9dc0dd8fe2b348c7bf4fc7c40fc6bd38/users/c83ad6705b9c4b069518abe597bab955/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:30.080486 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3c60d-7e75-4b42-86f0-83bdb56eb6c2 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:30.080857 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3c60d-7e75-4b42-86f0-83bdb56eb6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:30.081195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3c60d-7e75-4b42-86f0-83bdb56eb6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:30.132413 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d5e3c60d-7e75-4b42-86f0-83bdb56eb6c2 None None] MFA Rules not processed for user `c83ad6705b9c4b069518abe597bab955`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:30.133803 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d5e3c60d-7e75-4b42-86f0-83bdb56eb6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:30.137132 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e08e0eb2-e67f-44ac-9037-0a9f1400edaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d007a67e4794fa09719c18cafcec51c', 'request_id': 'req-e08e0eb2-e67f-44ac-9037-0a9f1400edaf'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:30.149265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e08e0eb2-e67f-44ac-9037-0a9f1400edaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d007a67e4794fa09719c18cafcec51c', 'request_id': 'req-e08e0eb2-e67f-44ac-9037-0a9f1400edaf'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:30.174538 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e08e0eb2-e67f-44ac-9037-0a9f1400edaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d007a67e4794fa09719c18cafcec51c', 'request_id': 'req-e08e0eb2-e67f-44ac-9037-0a9f1400edaf'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:30.229907 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 999/2041] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:02:30.241690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3c60d-7e75-4b42-86f0-83bdb56eb6c2 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:30.244138 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d5e3c60d-7e75-4b42-86f0-83bdb56eb6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:30.263543 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e08e0eb2-e67f-44ac-9037-0a9f1400edaf admin admin] The token cache is being invalidate because project 6d007a67e4794fa09719c18cafcec51c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:02:30.265029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e08e0eb2-e67f-44ac-9037-0a9f1400edaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:30.265956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e08e0eb2-e67f-44ac-9037-0a9f1400edaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:30.268112 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1043/2042] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:02:29 2022] DELETE /identity/v3/projects/6d007a67e4794fa09719c18cafcec51c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:30.274522 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e0eb2-e67f-44ac-9037-0a9f1400edaf admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:30.276198 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e08e0eb2-e67f-44ac-9037-0a9f1400edaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:30.299340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:30.304778 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3c60d-7e75-4b42-86f0-83bdb56eb6c2 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:30.309790 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba5708-feb5-4f96-aed0-5958f46d2af3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e7c4b0bd50c474996a21b69bde4e227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:30.310511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba5708-feb5-4f96-aed0-5958f46d2af3 service glance] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:30.310876 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba5708-feb5-4f96-aed0-5958f46d2af3 service glance] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:30.311286 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba5708-feb5-4f96-aed0-5958f46d2af3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:30.313912 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-21ba5708-feb5-4f96-aed0-5958f46d2af3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:30.326200 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba5708-feb5-4f96-aed0-5958f46d2af3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:30.327567 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba5708-feb5-4f96-aed0-5958f46d2af3 service glance] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:30.338101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1000/2043] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:30 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:30.380895 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e0eb2-e67f-44ac-9037-0a9f1400edaf admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:30.386308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b51f8-224e-4d6d-af83-2524eea204fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:30.387216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b51f8-224e-4d6d-af83-2524eea204fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:30.387486 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b51f8-224e-4d6d-af83-2524eea204fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:30.387735 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b51f8-224e-4d6d-af83-2524eea204fa admin admin] PATH_INFO: `/v3/users/6fa8e09c6bbf45f2ae542af4c73c6538` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:30.389307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b51f8-224e-4d6d-af83-2524eea204fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fa8e09c6bbf45f2ae542af4c73c6538)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:30.391692 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b51f8-224e-4d6d-af83-2524eea204fa admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:30.430636 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba5708-feb5-4f96-aed0-5958f46d2af3 service glance] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:30.432647 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-21ba5708-feb5-4f96-aed0-5958f46d2af3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:30.455510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba5708-feb5-4f96-aed0-5958f46d2af3 service glance] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:30.460504 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadc9ba-76ce-4a9a-a906-1cfee1277f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:30.461515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadc9ba-76ce-4a9a-a906-1cfee1277f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:30.461866 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadc9ba-76ce-4a9a-a906-1cfee1277f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:30.462213 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadc9ba-76ce-4a9a-a906-1cfee1277f7d admin admin] PATH_INFO: `/v3/projects/ffce8bb2712b4d0293632d22284be991` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:30.463482 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baadc9ba-76ce-4a9a-a906-1cfee1277f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffce8bb2712b4d0293632d22284be991)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:30.465734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baadc9ba-76ce-4a9a-a906-1cfee1277f7d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:30.593484 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ad9b51f8-224e-4d6d-af83-2524eea204fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fa8e09c6bbf45f2ae542af4c73c6538'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:30.595140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-baadc9ba-76ce-4a9a-a906-1cfee1277f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffce8bb2712b4d0293632d22284be991', 'request_id': 'req-baadc9ba-76ce-4a9a-a906-1cfee1277f7d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:30.602741 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ad9b51f8-224e-4d6d-af83-2524eea204fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fa8e09c6bbf45f2ae542af4c73c6538'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:30.609120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ad9b51f8-224e-4d6d-af83-2524eea204fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fa8e09c6bbf45f2ae542af4c73c6538'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:30.609120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ad9b51f8-224e-4d6d-af83-2524eea204fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fa8e09c6bbf45f2ae542af4c73c6538'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:30.616383 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ad9b51f8-224e-4d6d-af83-2524eea204fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fa8e09c6bbf45f2ae542af4c73c6538'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:30.684306 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-baadc9ba-76ce-4a9a-a906-1cfee1277f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffce8bb2712b4d0293632d22284be991', 'request_id': 'req-baadc9ba-76ce-4a9a-a906-1cfee1277f7d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:30.691229 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-baadc9ba-76ce-4a9a-a906-1cfee1277f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffce8bb2712b4d0293632d22284be991', 'request_id': 'req-baadc9ba-76ce-4a9a-a906-1cfee1277f7d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:30.702122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:30.703663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-baadc9ba-76ce-4a9a-a906-1cfee1277f7d admin admin] The token cache is being invalidate because project ffce8bb2712b4d0293632d22284be991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:02:30.704013 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-baadc9ba-76ce-4a9a-a906-1cfee1277f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:30.704728 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-baadc9ba-76ce-4a9a-a906-1cfee1277f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:30.706409 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1001/2044] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:02:30 2022] DELETE /identity/v3/projects/ffce8bb2712b4d0293632d22284be991 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:30.707202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadc9ba-76ce-4a9a-a906-1cfee1277f7d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:30.709121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-baadc9ba-76ce-4a9a-a906-1cfee1277f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:30.775888 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1044/2045] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:02:30 2022] DELETE /identity/v3/users/6fa8e09c6bbf45f2ae542af4c73c6538 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:30.776794 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b51f8-224e-4d6d-af83-2524eea204fa admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:30.778159 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ad9b51f8-224e-4d6d-af83-2524eea204fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:30.780565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadc9ba-76ce-4a9a-a906-1cfee1277f7d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:30.868233 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b51f8-224e-4d6d-af83-2524eea204fa admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:30.871188 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2a6a8-7b1e-4f9e-af20-59859e425cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:30.872974 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2a6a8-7b1e-4f9e-af20-59859e425cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:30.873411 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2a6a8-7b1e-4f9e-af20-59859e425cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:30.874008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2a6a8-7b1e-4f9e-af20-59859e425cd3 admin admin] PATH_INFO: `/v3/users/2e41f84acfa4467b98ba6b038a209eda` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:30.874522 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf109c-61db-46c5-8ab8-67c6865608e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:30.875669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf109c-61db-46c5-8ab8-67c6865608e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:30.876061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf109c-61db-46c5-8ab8-67c6865608e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:30.876624 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2a6a8-7b1e-4f9e-af20-59859e425cd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e41f84acfa4467b98ba6b038a209eda)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:30.877213 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf109c-61db-46c5-8ab8-67c6865608e5 admin admin] PATH_INFO: `/v3/users/fa85cc6b7ffa4e55af83e51355ea6d19` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:30.878917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf109c-61db-46c5-8ab8-67c6865608e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa85cc6b7ffa4e55af83e51355ea6d19)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:30.879200 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2a6a8-7b1e-4f9e-af20-59859e425cd3 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:30.882225 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf109c-61db-46c5-8ab8-67c6865608e5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:31.169496 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b2cf109c-61db-46c5-8ab8-67c6865608e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa85cc6b7ffa4e55af83e51355ea6d19'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:31.178066 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ccd2a6a8-7b1e-4f9e-af20-59859e425cd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e41f84acfa4467b98ba6b038a209eda'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:31.180992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b2cf109c-61db-46c5-8ab8-67c6865608e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa85cc6b7ffa4e55af83e51355ea6d19'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:31.182866 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b2cf109c-61db-46c5-8ab8-67c6865608e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa85cc6b7ffa4e55af83e51355ea6d19'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:31.183533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b2cf109c-61db-46c5-8ab8-67c6865608e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa85cc6b7ffa4e55af83e51355ea6d19'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:31.191393 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ccd2a6a8-7b1e-4f9e-af20-59859e425cd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e41f84acfa4467b98ba6b038a209eda'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:31.193633 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ccd2a6a8-7b1e-4f9e-af20-59859e425cd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e41f84acfa4467b98ba6b038a209eda'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:31.194990 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ccd2a6a8-7b1e-4f9e-af20-59859e425cd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e41f84acfa4467b98ba6b038a209eda'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:31.203146 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b2cf109c-61db-46c5-8ab8-67c6865608e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa85cc6b7ffa4e55af83e51355ea6d19'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:31.209917 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ccd2a6a8-7b1e-4f9e-af20-59859e425cd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e41f84acfa4467b98ba6b038a209eda'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:31.215778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:31.268569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1045/2046] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:02:30 2022] DELETE /identity/v3/users/fa85cc6b7ffa4e55af83e51355ea6d19 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:31.391553 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1002/2047] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:02:30 2022] DELETE /identity/v3/users/2e41f84acfa4467b98ba6b038a209eda => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:31.396240 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ec842-5003-4361-aba8-5a9f31a8486a None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:31.396739 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ec842-5003-4361-aba8-5a9f31a8486a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:31.397250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ec842-5003-4361-aba8-5a9f31a8486a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:31.406558 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2a6a8-7b1e-4f9e-af20-59859e425cd3 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:31.408026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ccd2a6a8-7b1e-4f9e-af20-59859e425cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:31.431003 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-420ec842-5003-4361-aba8-5a9f31a8486a None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:31.432994 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-420ec842-5003-4361-aba8-5a9f31a8486a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:31.513228 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2a6a8-7b1e-4f9e-af20-59859e425cd3 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:31.518317 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127af2b8-f688-4448-a168-aa0e06741dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:31.519300 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127af2b8-f688-4448-a168-aa0e06741dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:31.520006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127af2b8-f688-4448-a168-aa0e06741dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:31.520006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127af2b8-f688-4448-a168-aa0e06741dc1 admin admin] PATH_INFO: `/v3/projects/ca02b8f08e874bb685db0a389352ae8d` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:31.521297 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127af2b8-f688-4448-a168-aa0e06741dc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca02b8f08e874bb685db0a389352ae8d)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:31.523064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1046/2048] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:31.526622 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127af2b8-f688-4448-a168-aa0e06741dc1 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:31.530823 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:31.533012 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ec842-5003-4361-aba8-5a9f31a8486a None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:31.534865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-420ec842-5003-4361-aba8-5a9f31a8486a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:31.592821 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ec842-5003-4361-aba8-5a9f31a8486a None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:31.596628 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372d6c0-3766-4e9f-800a-d4c36b0c3171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:31.597322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372d6c0-3766-4e9f-800a-d4c36b0c3171 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:31.597608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372d6c0-3766-4e9f-800a-d4c36b0c3171 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:31.598040 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372d6c0-3766-4e9f-800a-d4c36b0c3171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:31.608042 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372d6c0-3766-4e9f-800a-d4c36b0c3171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:31.609529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372d6c0-3766-4e9f-800a-d4c36b0c3171 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:31.625611 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1047/2049] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:02:31.697339 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-127af2b8-f688-4448-a168-aa0e06741dc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca02b8f08e874bb685db0a389352ae8d', 'request_id': 'req-127af2b8-f688-4448-a168-aa0e06741dc1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:31.866779 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-127af2b8-f688-4448-a168-aa0e06741dc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca02b8f08e874bb685db0a389352ae8d', 'request_id': 'req-127af2b8-f688-4448-a168-aa0e06741dc1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:31.873523 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-127af2b8-f688-4448-a168-aa0e06741dc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca02b8f08e874bb685db0a389352ae8d', 'request_id': 'req-127af2b8-f688-4448-a168-aa0e06741dc1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:31.884057 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-127af2b8-f688-4448-a168-aa0e06741dc1 admin admin] The token cache is being invalidate because project ca02b8f08e874bb685db0a389352ae8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:02:31.884364 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-127af2b8-f688-4448-a168-aa0e06741dc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:31.885110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-127af2b8-f688-4448-a168-aa0e06741dc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:31.886729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1003/2050] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:02:31 2022] DELETE /identity/v3/projects/ca02b8f08e874bb685db0a389352ae8d => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:02:31.891762 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad09964-dcc5-40f2-b778-c3bc340e39af None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:31.892059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad09964-dcc5-40f2-b778-c3bc340e39af None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:31.892339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad09964-dcc5-40f2-b778-c3bc340e39af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:31.910161 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-0ad09964-dcc5-40f2-b778-c3bc340e39af None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:31.911920 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0ad09964-dcc5-40f2-b778-c3bc340e39af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:31.981040 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1048/2051] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:31.985368 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e6684-7d5f-4991-8d99-524d1f34098e None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:31.985672 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e6684-7d5f-4991-8d99-524d1f34098e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:31.985959 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e6684-7d5f-4991-8d99-524d1f34098e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:32.009097 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-5d7e6684-7d5f-4991-8d99-524d1f34098e None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:32.010370 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5d7e6684-7d5f-4991-8d99-524d1f34098e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:32.023686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1004/2052] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:32.033062 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad09964-dcc5-40f2-b778-c3bc340e39af None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:32.046917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad09964-dcc5-40f2-b778-c3bc340e39af None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:32.052958 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00eb922-a6af-46da-bc99-4bd7a24575d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:32.053647 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00eb922-a6af-46da-bc99-4bd7a24575d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:32.053936 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00eb922-a6af-46da-bc99-4bd7a24575d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:32.054239 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00eb922-a6af-46da-bc99-4bd7a24575d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:32.055273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00eb922-a6af-46da-bc99-4bd7a24575d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:02:32.055593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00eb922-a6af-46da-bc99-4bd7a24575d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:32.057721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00eb922-a6af-46da-bc99-4bd7a24575d8 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:32.075314 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1049/2053] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:02:32.077391 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e6684-7d5f-4991-8d99-524d1f34098e None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:32.089845 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e6684-7d5f-4991-8d99-524d1f34098e None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:32.096709 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af180672-8698-4050-a7f4-ea81f5e0151f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:32.097388 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af180672-8698-4050-a7f4-ea81f5e0151f admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:32.098502 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af180672-8698-4050-a7f4-ea81f5e0151f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:32.098900 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af180672-8698-4050-a7f4-ea81f5e0151f admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:32.101005 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af180672-8698-4050-a7f4-ea81f5e0151f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:32.103711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af180672-8698-4050-a7f4-ea81f5e0151f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:32.140251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00eb922-a6af-46da-bc99-4bd7a24575d8 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:32.141227 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b00eb922-a6af-46da-bc99-4bd7a24575d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:32.170484 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00eb922-a6af-46da-bc99-4bd7a24575d8 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:32.175641 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac644ea9-1339-465a-b941-3166aacde1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:32.176626 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac644ea9-1339-465a-b941-3166aacde1f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:32.176896 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac644ea9-1339-465a-b941-3166aacde1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:32.177169 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac644ea9-1339-465a-b941-3166aacde1f4 admin admin] PATH_INFO: `/v3/projects/e8205c9e823b438baf5e52df58453832` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:32.178554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac644ea9-1339-465a-b941-3166aacde1f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8205c9e823b438baf5e52df58453832)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:32.180536 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac644ea9-1339-465a-b941-3166aacde1f4 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:32.296646 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1005/2054] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:02:32 2022] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:32.301521 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af180672-8698-4050-a7f4-ea81f5e0151f admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:32.380730 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af180672-8698-4050-a7f4-ea81f5e0151f admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:32.386387 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb9a66-30cf-49b9-8f3b-a5a6c380041c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:32.388242 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb9a66-30cf-49b9-8f3b-a5a6c380041c admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:32.388242 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb9a66-30cf-49b9-8f3b-a5a6c380041c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:32.388540 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb9a66-30cf-49b9-8f3b-a5a6c380041c admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:32.396746 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb9a66-30cf-49b9-8f3b-a5a6c380041c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:32.396746 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb9a66-30cf-49b9-8f3b-a5a6c380041c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:32.408294 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ac644ea9-1339-465a-b941-3166aacde1f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8205c9e823b438baf5e52df58453832', 'request_id': 'req-ac644ea9-1339-465a-b941-3166aacde1f4'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:32.414944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ac644ea9-1339-465a-b941-3166aacde1f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8205c9e823b438baf5e52df58453832', 'request_id': 'req-ac644ea9-1339-465a-b941-3166aacde1f4'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:32.422497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ac644ea9-1339-465a-b941-3166aacde1f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8205c9e823b438baf5e52df58453832', 'request_id': 'req-ac644ea9-1339-465a-b941-3166aacde1f4'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:32.502669 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1006/2055] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:02:32 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:32.503546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb9a66-30cf-49b9-8f3b-a5a6c380041c admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:32.505722 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-dbfb9a66-30cf-49b9-8f3b-a5a6c380041c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:32.518033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb9a66-30cf-49b9-8f3b-a5a6c380041c admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:32.564436 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ac644ea9-1339-465a-b941-3166aacde1f4 admin admin] The token cache is being invalidate because project e8205c9e823b438baf5e52df58453832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:02:32.564878 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ac644ea9-1339-465a-b941-3166aacde1f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:32.565993 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ac644ea9-1339-465a-b941-3166aacde1f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:32.568657 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1050/2056] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:02:32 2022] DELETE /identity/v3/projects/e8205c9e823b438baf5e52df58453832 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:32.578285 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac644ea9-1339-465a-b941-3166aacde1f4 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:32.578285 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ac644ea9-1339-465a-b941-3166aacde1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:32.593387 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb640da-a915-4199-b794-aea4aaca402c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:32.594302 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb640da-a915-4199-b794-aea4aaca402c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:32.594598 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb640da-a915-4199-b794-aea4aaca402c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:32.594884 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb640da-a915-4199-b794-aea4aaca402c admin admin] PATH_INFO: `/v3/projects/f056fc876ece446da77fdd5feb4f0f99` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:32.596334 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb640da-a915-4199-b794-aea4aaca402c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f056fc876ece446da77fdd5feb4f0f99)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:32.598379 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb640da-a915-4199-b794-aea4aaca402c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:32.605399 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:32.665625 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac644ea9-1339-465a-b941-3166aacde1f4 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:32.672243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ec9ad-ad50-4bea-a5c3-30a5b5dc35f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:32.673970 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ec9ad-ad50-4bea-a5c3-30a5b5dc35f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:32.674308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ec9ad-ad50-4bea-a5c3-30a5b5dc35f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:32.674632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ec9ad-ad50-4bea-a5c3-30a5b5dc35f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:32.675402 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ec9ad-ad50-4bea-a5c3-30a5b5dc35f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:32.678046 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ec9ad-ad50-4bea-a5c3-30a5b5dc35f7 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:32.700295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1051/2057] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:32.703141 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb91ea-2162-4394-81ae-d175682774ba None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:32.704216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb91ea-2162-4394-81ae-d175682774ba None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:32.704216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb91ea-2162-4394-81ae-d175682774ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:32.731100 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a9cb91ea-2162-4394-81ae-d175682774ba None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:32.732461 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a9cb91ea-2162-4394-81ae-d175682774ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:32.744750 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1052/2058] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:32.746857 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb91ea-2162-4394-81ae-d175682774ba None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:32.761719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb91ea-2162-4394-81ae-d175682774ba None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:32.773102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-afb640da-a915-4199-b794-aea4aaca402c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f056fc876ece446da77fdd5feb4f0f99', 'request_id': 'req-afb640da-a915-4199-b794-aea4aaca402c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:32.832837 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d21bbe-2c75-40dd-9e44-158fb53bdccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:32.833541 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d21bbe-2c75-40dd-9e44-158fb53bdccd admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:32.833835 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d21bbe-2c75-40dd-9e44-158fb53bdccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:32.834116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d21bbe-2c75-40dd-9e44-158fb53bdccd admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:32.834855 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d21bbe-2c75-40dd-9e44-158fb53bdccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:32.836483 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d21bbe-2c75-40dd-9e44-158fb53bdccd admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:32.846637 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1053/2059] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:32.847895 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a61ae5-0317-40e0-bfeb-284b7f3b0861 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:32.848191 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a61ae5-0317-40e0-bfeb-284b7f3b0861 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:32.848477 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a61ae5-0317-40e0-bfeb-284b7f3b0861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:32.869259 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-38a61ae5-0317-40e0-bfeb-284b7f3b0861 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:32.869423 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-afb640da-a915-4199-b794-aea4aaca402c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f056fc876ece446da77fdd5feb4f0f99', 'request_id': 'req-afb640da-a915-4199-b794-aea4aaca402c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:32.870525 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-38a61ae5-0317-40e0-bfeb-284b7f3b0861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:32.877297 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-afb640da-a915-4199-b794-aea4aaca402c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f056fc876ece446da77fdd5feb4f0f99', 'request_id': 'req-afb640da-a915-4199-b794-aea4aaca402c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:32.881481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1054/2060] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:32.882758 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a61ae5-0317-40e0-bfeb-284b7f3b0861 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:32.889084 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-afb640da-a915-4199-b794-aea4aaca402c admin admin] The token cache is being invalidate because project f056fc876ece446da77fdd5feb4f0f99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:02:32.889383 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-afb640da-a915-4199-b794-aea4aaca402c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:32.890192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-afb640da-a915-4199-b794-aea4aaca402c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:32.891856 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1007/2061] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:02:32 2022] DELETE /identity/v3/projects/f056fc876ece446da77fdd5feb4f0f99 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:32.892888 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb640da-a915-4199-b794-aea4aaca402c admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:32.893018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a61ae5-0317-40e0-bfeb-284b7f3b0861 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:32.895034 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-afb640da-a915-4199-b794-aea4aaca402c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:32.899727 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54009353-e12d-48b4-af7e-015bea360b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:32.900656 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54009353-e12d-48b4-af7e-015bea360b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:32.900943 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54009353-e12d-48b4-af7e-015bea360b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:32.906222 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54009353-e12d-48b4-af7e-015bea360b3c admin admin] PATH_INFO: `/v3/projects/647b7611e9504d3e8816c73f13ff1504/users/bb4b6bcd3550433ba20d81cb937b9724/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:32.909132 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb640da-a915-4199-b794-aea4aaca402c admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:32.914153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42385670-3b9b-4ea0-9ab4-37fcfa4a2a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:32.914839 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42385670-3b9b-4ea0-9ab4-37fcfa4a2a4f admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:32.915129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42385670-3b9b-4ea0-9ab4-37fcfa4a2a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:32.915458 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42385670-3b9b-4ea0-9ab4-37fcfa4a2a4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:32.916467 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42385670-3b9b-4ea0-9ab4-37fcfa4a2a4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:02:32.916652 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42385670-3b9b-4ea0-9ab4-37fcfa4a2a4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:32.918408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42385670-3b9b-4ea0-9ab4-37fcfa4a2a4f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:32.919501 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54009353-e12d-48b4-af7e-015bea360b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=647b7611e9504d3e8816c73f13ff1504, user_id=bb4b6bcd3550433ba20d81cb937b9724, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:32.922586 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54009353-e12d-48b4-af7e-015bea360b3c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:32.932392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1008/2062] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:02:32.934439 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998730d-6a27-491f-a337-4d869aa714d8 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:32.934439 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998730d-6a27-491f-a337-4d869aa714d8 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:32.934439 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998730d-6a27-491f-a337-4d869aa714d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:32.952918 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2998730d-6a27-491f-a337-4d869aa714d8 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:32.954134 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2998730d-6a27-491f-a337-4d869aa714d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:32.962988 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1009/2063] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:32.963769 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998730d-6a27-491f-a337-4d869aa714d8 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:32.973411 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998730d-6a27-491f-a337-4d869aa714d8 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:32.978340 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa11d3-c308-412e-8172-8e2b777996e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:32.982930 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa11d3-c308-412e-8172-8e2b777996e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:32.982930 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa11d3-c308-412e-8172-8e2b777996e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:32.982930 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa11d3-c308-412e-8172-8e2b777996e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:32.982930 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa11d3-c308-412e-8172-8e2b777996e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:32.982930 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa11d3-c308-412e-8172-8e2b777996e0 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:33.015295 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:33.021344 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1055/2064] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:32 2022] PUT /identity/v3/projects/647b7611e9504d3e8816c73f13ff1504/users/bb4b6bcd3550433ba20d81cb937b9724/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:33.022752 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26440a6e-da39-4170-be39-faa54c6029fc None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:33.023107 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26440a6e-da39-4170-be39-faa54c6029fc None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:33.023453 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26440a6e-da39-4170-be39-faa54c6029fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:33.041341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-26440a6e-da39-4170-be39-faa54c6029fc None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:33.042554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-26440a6e-da39-4170-be39-faa54c6029fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:33.105527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1010/2065] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:02:32 2022] POST /identity/v3/projects => generated 363 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:33.105527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4451ba-24f8-48bb-8474-35a8edc2b2f7 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:33.105527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4451ba-24f8-48bb-8474-35a8edc2b2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:33.105527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4451ba-24f8-48bb-8474-35a8edc2b2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:33.109355 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1056/2066] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:33.109355 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26440a6e-da39-4170-be39-faa54c6029fc None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:33.119415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26440a6e-da39-4170-be39-faa54c6029fc None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:33.135777 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-0a4451ba-24f8-48bb-8474-35a8edc2b2f7 None None] MFA Rules not processed for user `bb4b6bcd3550433ba20d81cb937b9724`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:33.137046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0a4451ba-24f8-48bb-8474-35a8edc2b2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:33.177656 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b7473-9165-4ed3-9185-16133edb7660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:33.178239 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b7473-9165-4ed3-9185-16133edb7660 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:33.178550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b7473-9165-4ed3-9185-16133edb7660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:33.178833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b7473-9165-4ed3-9185-16133edb7660 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:33.179649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b7473-9165-4ed3-9185-16133edb7660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:33.181763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b7473-9165-4ed3-9185-16133edb7660 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:33.206011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1011/2067] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:33.206923 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4451ba-24f8-48bb-8474-35a8edc2b2f7 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:33.217922 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4451ba-24f8-48bb-8474-35a8edc2b2f7 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:33.223368 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf70208-1b61-421f-8fb9-405f206deb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:33.224278 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf70208-1b61-421f-8fb9-405f206deb6d admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:33.224568 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf70208-1b61-421f-8fb9-405f206deb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:33.224883 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf70208-1b61-421f-8fb9-405f206deb6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:33.225613 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf70208-1b61-421f-8fb9-405f206deb6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:02:33.225921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf70208-1b61-421f-8fb9-405f206deb6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:33.227800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf70208-1b61-421f-8fb9-405f206deb6d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:33.240984 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1012/2068] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:02:33.241847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf70208-1b61-421f-8fb9-405f206deb6d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:33.243830 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-caf70208-1b61-421f-8fb9-405f206deb6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:33.257147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf70208-1b61-421f-8fb9-405f206deb6d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:33.261737 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb9193-9de6-4698-bd3b-2dad172ba934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:33.262387 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb9193-9de6-4698-bd3b-2dad172ba934 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:33.264030 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb9193-9de6-4698-bd3b-2dad172ba934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:33.264030 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb9193-9de6-4698-bd3b-2dad172ba934 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:33.264030 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb9193-9de6-4698-bd3b-2dad172ba934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:33.265551 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb9193-9de6-4698-bd3b-2dad172ba934 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:33.293856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1057/2069] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:02:33 2022] POST /identity/v3/users => generated 282 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:33.293856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b7473-9165-4ed3-9185-16133edb7660 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:33.302152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b7473-9165-4ed3-9185-16133edb7660 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:33.307038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631d5ac-979e-4aed-9ae0-46696258960d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:33.307719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631d5ac-979e-4aed-9ae0-46696258960d admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:33.308052 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631d5ac-979e-4aed-9ae0-46696258960d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:33.308335 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631d5ac-979e-4aed-9ae0-46696258960d admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:33.309089 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631d5ac-979e-4aed-9ae0-46696258960d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:33.311057 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631d5ac-979e-4aed-9ae0-46696258960d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:33.409288 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1013/2070] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:02:33 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:33.409288 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb9193-9de6-4698-bd3b-2dad172ba934 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:33.460741 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1058/2071] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:02:33 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:33.460741 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631d5ac-979e-4aed-9ae0-46696258960d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:33.475556 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb9193-9de6-4698-bd3b-2dad172ba934 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:33.525113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631d5ac-979e-4aed-9ae0-46696258960d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:33.532302 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b7bc7-ef13-4145-b1b8-35bb29f98fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:33.533045 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b7bc7-ef13-4145-b1b8-35bb29f98fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:33.533331 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b7bc7-ef13-4145-b1b8-35bb29f98fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:33.533612 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b7bc7-ef13-4145-b1b8-35bb29f98fb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:33.534347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b7bc7-ef13-4145-b1b8-35bb29f98fb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:33.537085 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b7bc7-ef13-4145-b1b8-35bb29f98fb4 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:33.537268 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b1bc8-0243-44e3-b027-90c0c4b45f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:33.537984 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b1bc8-0243-44e3-b027-90c0c4b45f13 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:33.538266 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b1bc8-0243-44e3-b027-90c0c4b45f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:33.538540 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b1bc8-0243-44e3-b027-90c0c4b45f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:33.539591 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b1bc8-0243-44e3-b027-90c0c4b45f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:33.540959 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b1bc8-0243-44e3-b027-90c0c4b45f13 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:33.541729 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:33.551873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1014/2072] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:33.552787 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b1bc8-0243-44e3-b027-90c0c4b45f13 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:33.562338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b1bc8-0243-44e3-b027-90c0c4b45f13 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:33.566954 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bc2b8-d4a8-4558-9b36-4524ff8e35be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:33.567577 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bc2b8-d4a8-4558-9b36-4524ff8e35be admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:33.567857 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bc2b8-d4a8-4558-9b36-4524ff8e35be admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:33.568132 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bc2b8-d4a8-4558-9b36-4524ff8e35be admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:33.568841 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bc2b8-d4a8-4558-9b36-4524ff8e35be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:33.570713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bc2b8-d4a8-4558-9b36-4524ff8e35be admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:33.653753 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1059/2073] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:02:33 2022] POST /identity/v3/users => generated 296 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:33.653753 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b7bc7-ef13-4145-b1b8-35bb29f98fb4 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:33.663113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b7bc7-ef13-4145-b1b8-35bb29f98fb4 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:33.667853 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db84a5c-b14a-4068-8708-58ddc5d56bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:33.668531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db84a5c-b14a-4068-8708-58ddc5d56bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:33.668848 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db84a5c-b14a-4068-8708-58ddc5d56bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:33.669127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db84a5c-b14a-4068-8708-58ddc5d56bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:33.669862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db84a5c-b14a-4068-8708-58ddc5d56bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:33.671498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db84a5c-b14a-4068-8708-58ddc5d56bb4 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:33.682033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1015/2074] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:02:33 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:33.682033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bc2b8-d4a8-4558-9b36-4524ff8e35be admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:33.682851 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1060/2075] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:33.683666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db84a5c-b14a-4068-8708-58ddc5d56bb4 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:33.690151 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bc2b8-d4a8-4558-9b36-4524ff8e35be admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:33.693233 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db84a5c-b14a-4068-8708-58ddc5d56bb4 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:33.695328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcfe22-019e-4c85-8a27-6e007e3c7fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:33.695996 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcfe22-019e-4c85-8a27-6e007e3c7fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:33.696313 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcfe22-019e-4c85-8a27-6e007e3c7fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:33.696687 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcfe22-019e-4c85-8a27-6e007e3c7fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:33.697421 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcfe22-019e-4c85-8a27-6e007e3c7fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:33.697769 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb48eed-9842-4420-b04a-52a858016323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:33.698438 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb48eed-9842-4420-b04a-52a858016323 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:33.698729 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb48eed-9842-4420-b04a-52a858016323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:33.699029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb48eed-9842-4420-b04a-52a858016323 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:33.699131 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcfe22-019e-4c85-8a27-6e007e3c7fa6 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:33.699730 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb48eed-9842-4420-b04a-52a858016323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:33.701346 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb48eed-9842-4420-b04a-52a858016323 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:33.710476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1016/2076] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:33.711311 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcfe22-019e-4c85-8a27-6e007e3c7fa6 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:33.712631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1061/2077] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:33.714638 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb48eed-9842-4420-b04a-52a858016323 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:33.719207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:33.723623 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcfe22-019e-4c85-8a27-6e007e3c7fa6 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:33.727801 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb48eed-9842-4420-b04a-52a858016323 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:33.730763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714fa54-060f-4093-8588-82190a0d68cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:33.731859 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714fa54-060f-4093-8588-82190a0d68cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:33.732181 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714fa54-060f-4093-8588-82190a0d68cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:33.732465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714fa54-060f-4093-8588-82190a0d68cd admin admin] PATH_INFO: `/v3/projects/d9b907bc678c4ecc9e96ac55f6f61c0e/users/13792ca27a974c98a2eb712d6d0e3dab/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:33.733252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cee4c-5cd9-4cef-b77d-4d872d680d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:33.734167 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cee4c-5cd9-4cef-b77d-4d872d680d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:33.734445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cee4c-5cd9-4cef-b77d-4d872d680d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:33.734720 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cee4c-5cd9-4cef-b77d-4d872d680d4b admin admin] PATH_INFO: `/v3/projects/b776d51a0748476d8383a386b253c23e/users/efc02ae33708449587c1c5093da77d20/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:33.774698 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714fa54-060f-4093-8588-82190a0d68cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b907bc678c4ecc9e96ac55f6f61c0e, user_id=13792ca27a974c98a2eb712d6d0e3dab, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:33.776711 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cee4c-5cd9-4cef-b77d-4d872d680d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b776d51a0748476d8383a386b253c23e, user_id=efc02ae33708449587c1c5093da77d20, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:33.777489 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714fa54-060f-4093-8588-82190a0d68cd admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:33.779446 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cee4c-5cd9-4cef-b77d-4d872d680d4b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:33.815454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:33.868243 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1017/2078] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:33 2022] PUT /identity/v3/projects/d9b907bc678c4ecc9e96ac55f6f61c0e/users/13792ca27a974c98a2eb712d6d0e3dab/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:33.868635 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714fa54-060f-4093-8588-82190a0d68cd admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:33.887392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1062/2079] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:33 2022] PUT /identity/v3/projects/b776d51a0748476d8383a386b253c23e/users/efc02ae33708449587c1c5093da77d20/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:02:33.889006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d401b3a-6392-4a5f-916f-3a6185cefe5c None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:33.889431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d401b3a-6392-4a5f-916f-3a6185cefe5c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:33.889856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d401b3a-6392-4a5f-916f-3a6185cefe5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:33.938236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-9d401b3a-6392-4a5f-916f-3a6185cefe5c None None] MFA Rules not processed for user `13792ca27a974c98a2eb712d6d0e3dab`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:33.939241 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9d401b3a-6392-4a5f-916f-3a6185cefe5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:33.965747 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:33.979478 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714fa54-060f-4093-8588-82190a0d68cd admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:33.988429 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:34.023112 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1063/2080] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:33 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:34.023987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d401b3a-6392-4a5f-916f-3a6185cefe5c None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:34.077770 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec42a9-21a1-4176-b1a3-6aa735de2188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:34.078750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec42a9-21a1-4176-b1a3-6aa735de2188 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:34.079095 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec42a9-21a1-4176-b1a3-6aa735de2188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:34.079358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec42a9-21a1-4176-b1a3-6aa735de2188 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:34.080036 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec42a9-21a1-4176-b1a3-6aa735de2188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:34.081683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec42a9-21a1-4176-b1a3-6aa735de2188 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:34.094479 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1018/2081] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:34.095325 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec42a9-21a1-4176-b1a3-6aa735de2188 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:34.097064 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-deec42a9-21a1-4176-b1a3-6aa735de2188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:34.102599 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d401b3a-6392-4a5f-916f-3a6185cefe5c None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:34.110035 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938976c8-8574-4e28-adfa-7edd53559cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:34.114474 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938976c8-8574-4e28-adfa-7edd53559cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:34.114474 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938976c8-8574-4e28-adfa-7edd53559cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:34.114474 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938976c8-8574-4e28-adfa-7edd53559cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:34.114474 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938976c8-8574-4e28-adfa-7edd53559cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:34.120168 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938976c8-8574-4e28-adfa-7edd53559cc2 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:34.127962 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1064/2082] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:34.128916 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938976c8-8574-4e28-adfa-7edd53559cc2 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:34.138987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938976c8-8574-4e28-adfa-7edd53559cc2 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:34.144682 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d8a78-4ea6-42ff-ab51-9ed5dae503df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:34.145658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d8a78-4ea6-42ff-ab51-9ed5dae503df admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:34.145976 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d8a78-4ea6-42ff-ab51-9ed5dae503df admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:34.146258 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d8a78-4ea6-42ff-ab51-9ed5dae503df admin admin] PATH_INFO: `/v3/projects/4174c22f6eda4a5d934acb3203d4da8c/users/9090c1880c8147889cc8c878cf54149d/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:34.162264 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d8a78-4ea6-42ff-ab51-9ed5dae503df admin admin] RBAC: Authorizing `identity:create_grant(project_id=4174c22f6eda4a5d934acb3203d4da8c, user_id=9090c1880c8147889cc8c878cf54149d, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:34.165086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d8a78-4ea6-42ff-ab51-9ed5dae503df admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:34.187270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec42a9-21a1-4176-b1a3-6aa735de2188 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:34.191036 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c4c53-0a30-41fc-a03c-0454882f4e95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:34.191740 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c4c53-0a30-41fc-a03c-0454882f4e95 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:34.192028 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c4c53-0a30-41fc-a03c-0454882f4e95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:34.192307 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c4c53-0a30-41fc-a03c-0454882f4e95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:34.202415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c4c53-0a30-41fc-a03c-0454882f4e95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:34.203863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c4c53-0a30-41fc-a03c-0454882f4e95 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:34.213002 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1019/2083] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:34 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:34.214328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c4c53-0a30-41fc-a03c-0454882f4e95 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:34.225226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c4c53-0a30-41fc-a03c-0454882f4e95 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:34.233300 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c1af4-f955-4a2b-90b5-49bf3ffd9552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:34.234584 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c1af4-f955-4a2b-90b5-49bf3ffd9552 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:34.235013 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c1af4-f955-4a2b-90b5-49bf3ffd9552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:34.235275 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c1af4-f955-4a2b-90b5-49bf3ffd9552 admin admin] PATH_INFO: `/v3/projects/b776d51a0748476d8383a386b253c23e/users/efc02ae33708449587c1c5093da77d20/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:34.239561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c1af4-f955-4a2b-90b5-49bf3ffd9552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b776d51a0748476d8383a386b253c23e, user_id=efc02ae33708449587c1c5093da77d20, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:34.246196 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c1af4-f955-4a2b-90b5-49bf3ffd9552 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:34.257865 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1020/2084] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:34 2022] PUT /identity/v3/projects/b776d51a0748476d8383a386b253c23e/users/efc02ae33708449587c1c5093da77d20/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:34.278529 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76103bf-d782-43da-af9d-49921b761249 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:34.278529 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76103bf-d782-43da-af9d-49921b761249 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:34.278529 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76103bf-d782-43da-af9d-49921b761249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:34.279919 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1065/2085] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:34 2022] PUT /identity/v3/projects/4174c22f6eda4a5d934acb3203d4da8c/users/9090c1880c8147889cc8c878cf54149d/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:34.282690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcddb9c-24d2-4a2e-8c1f-9dddc79e4a1a None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:34.283145 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcddb9c-24d2-4a2e-8c1f-9dddc79e4a1a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:34.283595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcddb9c-24d2-4a2e-8c1f-9dddc79e4a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:34.287656 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:34.311230 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-a76103bf-d782-43da-af9d-49921b761249 None None] MFA Rules not processed for user `efc02ae33708449587c1c5093da77d20`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:34.313274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a76103bf-d782-43da-af9d-49921b761249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:34.322776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-9dcddb9c-24d2-4a2e-8c1f-9dddc79e4a1a None None] MFA Rules not processed for user `9090c1880c8147889cc8c878cf54149d`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:34.324268 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9dcddb9c-24d2-4a2e-8c1f-9dddc79e4a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:34.417237 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1066/2086] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:34.422275 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcddb9c-24d2-4a2e-8c1f-9dddc79e4a1a None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:34.440883 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1021/2087] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:34.452731 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:34.491603 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76103bf-d782-43da-af9d-49921b761249 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:34.495958 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a76103bf-d782-43da-af9d-49921b761249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:34.504671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcddb9c-24d2-4a2e-8c1f-9dddc79e4a1a None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:34.510063 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b1fd4-8f9c-484f-8b3f-81a14f3e6aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:34.510789 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b1fd4-8f9c-484f-8b3f-81a14f3e6aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:34.511119 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b1fd4-8f9c-484f-8b3f-81a14f3e6aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:34.511399 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b1fd4-8f9c-484f-8b3f-81a14f3e6aa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:34.512127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b1fd4-8f9c-484f-8b3f-81a14f3e6aa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:34.514113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b1fd4-8f9c-484f-8b3f-81a14f3e6aa6 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:34.562247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76103bf-d782-43da-af9d-49921b761249 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:34.566281 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0566f9-0e12-4b1d-b6bc-a252e5554495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:34.566962 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0566f9-0e12-4b1d-b6bc-a252e5554495 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:34.567249 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0566f9-0e12-4b1d-b6bc-a252e5554495 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:34.567523 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0566f9-0e12-4b1d-b6bc-a252e5554495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:34.578397 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0566f9-0e12-4b1d-b6bc-a252e5554495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:34.579876 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0566f9-0e12-4b1d-b6bc-a252e5554495 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:34.591971 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1022/2088] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:02:34.603485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1067/2089] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:02:34 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:34.608716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b1fd4-8f9c-484f-8b3f-81a14f3e6aa6 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:34.694210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b1fd4-8f9c-484f-8b3f-81a14f3e6aa6 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:34.699923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0388f-708a-4ac5-bd41-e744b890c122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:34.700382 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0388f-708a-4ac5-bd41-e744b890c122 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:34.700936 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0388f-708a-4ac5-bd41-e744b890c122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:34.701071 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0388f-708a-4ac5-bd41-e744b890c122 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:34.701867 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0388f-708a-4ac5-bd41-e744b890c122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:34.704228 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0388f-708a-4ac5-bd41-e744b890c122 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:34.806709 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1068/2090] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:02:34 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:34.813105 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0566f9-0e12-4b1d-b6bc-a252e5554495 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:34.824651 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0566f9-0e12-4b1d-b6bc-a252e5554495 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:34.830722 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c08507-e2e2-4278-a76a-aedf67d96005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:34.831654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c08507-e2e2-4278-a76a-aedf67d96005 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:34.832038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c08507-e2e2-4278-a76a-aedf67d96005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:34.833373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c08507-e2e2-4278-a76a-aedf67d96005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:34.834117 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c08507-e2e2-4278-a76a-aedf67d96005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:34.835742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c08507-e2e2-4278-a76a-aedf67d96005 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:34.849309 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1023/2091] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:34.850718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0388f-708a-4ac5-bd41-e744b890c122 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:34.861271 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0388f-708a-4ac5-bd41-e744b890c122 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:34.866706 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b1438-c9ec-47d3-96a5-cc295c6cd8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:34.867394 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b1438-c9ec-47d3-96a5-cc295c6cd8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:34.867680 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b1438-c9ec-47d3-96a5-cc295c6cd8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:34.868017 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b1438-c9ec-47d3-96a5-cc295c6cd8c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:34.868802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b1438-c9ec-47d3-96a5-cc295c6cd8c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:34.872191 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b1438-c9ec-47d3-96a5-cc295c6cd8c5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:34.885360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1069/2092] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:34.889869 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c08507-e2e2-4278-a76a-aedf67d96005 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:34.912208 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c08507-e2e2-4278-a76a-aedf67d96005 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:34.917440 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa3513-23e9-4f50-a875-54e973f68e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:34.918336 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa3513-23e9-4f50-a875-54e973f68e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:34.918622 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa3513-23e9-4f50-a875-54e973f68e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:34.918942 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa3513-23e9-4f50-a875-54e973f68e1e admin admin] PATH_INFO: `/v3/projects/538d59fd262a43eab671fc00527dc7f7/users/4ecf8cb558384c529ccac9802b251829/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:34.935557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa3513-23e9-4f50-a875-54e973f68e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=538d59fd262a43eab671fc00527dc7f7, user_id=4ecf8cb558384c529ccac9802b251829, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:34.938263 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa3513-23e9-4f50-a875-54e973f68e1e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:35.085746 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1024/2093] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:34 2022] PUT /identity/v3/projects/538d59fd262a43eab671fc00527dc7f7/users/4ecf8cb558384c529ccac9802b251829/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:02:35.097373 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cb6dd-1540-47b3-8c07-5534cf202294 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:35.097668 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cb6dd-1540-47b3-8c07-5534cf202294 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:35.098224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cb6dd-1540-47b3-8c07-5534cf202294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:35.128615 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-034cb6dd-1540-47b3-8c07-5534cf202294 None None] MFA Rules not processed for user `4ecf8cb558384c529ccac9802b251829`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:35.130430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-034cb6dd-1540-47b3-8c07-5534cf202294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:35.205964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1070/2094] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:35.210641 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa3513-23e9-4f50-a875-54e973f68e1e admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:35.280056 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa3513-23e9-4f50-a875-54e973f68e1e admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:35.288126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51494d-a254-4f80-98a3-5d13e20be6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:35.288126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51494d-a254-4f80-98a3-5d13e20be6ae admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:35.288126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51494d-a254-4f80-98a3-5d13e20be6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:35.288126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51494d-a254-4f80-98a3-5d13e20be6ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:35.288480 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51494d-a254-4f80-98a3-5d13e20be6ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:35.290000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51494d-a254-4f80-98a3-5d13e20be6ae admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:35.293668 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:35.419300 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1025/2095] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:02:35 2022] POST /identity/v3/projects => generated 383 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:35.423507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cb6dd-1540-47b3-8c07-5534cf202294 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:35.437573 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cb6dd-1540-47b3-8c07-5534cf202294 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:35.452288 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:35.508510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49582198-5f97-4cd2-af04-def4fae76f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:35.509218 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49582198-5f97-4cd2-af04-def4fae76f70 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:35.509490 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49582198-5f97-4cd2-af04-def4fae76f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:35.510112 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49582198-5f97-4cd2-af04-def4fae76f70 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:35.510617 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49582198-5f97-4cd2-af04-def4fae76f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:35.512551 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49582198-5f97-4cd2-af04-def4fae76f70 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:35.620276 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1071/2096] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:02:35 2022] POST /identity/v3/users => generated 298 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:35.624308 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51494d-a254-4f80-98a3-5d13e20be6ae admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:35.635262 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51494d-a254-4f80-98a3-5d13e20be6ae admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:35.639921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb6d11-ad4c-42d5-9e23-cb4d4da307ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:35.642066 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb6d11-ad4c-42d5-9e23-cb4d4da307ff admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:35.642066 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb6d11-ad4c-42d5-9e23-cb4d4da307ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:35.642066 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb6d11-ad4c-42d5-9e23-cb4d4da307ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:35.642066 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb6d11-ad4c-42d5-9e23-cb4d4da307ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:35.643772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb6d11-ad4c-42d5-9e23-cb4d4da307ff admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:35.658614 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1026/2097] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:02:35.660775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49582198-5f97-4cd2-af04-def4fae76f70 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:35.671691 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49582198-5f97-4cd2-af04-def4fae76f70 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:35.677131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dcfaf-3673-4fe9-a72e-217fbc4a3732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:35.678048 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dcfaf-3673-4fe9-a72e-217fbc4a3732 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:35.678333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dcfaf-3673-4fe9-a72e-217fbc4a3732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:35.678611 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dcfaf-3673-4fe9-a72e-217fbc4a3732 admin admin] PATH_INFO: `/v3/projects/9f39527720044243b399846c99dfcbb7/users/e50367aadd6f4429813e44b50eed2043/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:35.695010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838dcfaf-3673-4fe9-a72e-217fbc4a3732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f39527720044243b399846c99dfcbb7, user_id=e50367aadd6f4429813e44b50eed2043, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:35.697782 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838dcfaf-3673-4fe9-a72e-217fbc4a3732 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:35.799646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1072/2098] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:35 2022] PUT /identity/v3/projects/9f39527720044243b399846c99dfcbb7/users/e50367aadd6f4429813e44b50eed2043/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:02:35.804474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb6d11-ad4c-42d5-9e23-cb4d4da307ff admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:35.814713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb6d11-ad4c-42d5-9e23-cb4d4da307ff admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:35.886402 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dcfaf-3673-4fe9-a72e-217fbc4a3732 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:35.899391 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22698828-2bba-4888-a42c-b39cc66474ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:35.900358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22698828-2bba-4888-a42c-b39cc66474ad admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:35.900358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22698828-2bba-4888-a42c-b39cc66474ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:35.907297 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22698828-2bba-4888-a42c-b39cc66474ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:35.907297 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22698828-2bba-4888-a42c-b39cc66474ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:35.907297 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22698828-2bba-4888-a42c-b39cc66474ad admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:35.915177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1027/2099] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:35.919878 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22698828-2bba-4888-a42c-b39cc66474ad admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:35.930110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22698828-2bba-4888-a42c-b39cc66474ad admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:35.934823 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7e794-3f0f-479e-9f11-bc00049a80fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:35.935721 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7e794-3f0f-479e-9f11-bc00049a80fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:35.936047 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7e794-3f0f-479e-9f11-bc00049a80fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:35.936276 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7e794-3f0f-479e-9f11-bc00049a80fd admin admin] PATH_INFO: `/v3/projects/9f39527720044243b399846c99dfcbb7/users/e50367aadd6f4429813e44b50eed2043/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:35.938612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7e794-3f0f-479e-9f11-bc00049a80fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f39527720044243b399846c99dfcbb7, user_id=e50367aadd6f4429813e44b50eed2043, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:35.941318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7e794-3f0f-479e-9f11-bc00049a80fd admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:35.953465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1028/2100] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:35 2022] PUT /identity/v3/projects/9f39527720044243b399846c99dfcbb7/users/e50367aadd6f4429813e44b50eed2043/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:35.963346 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dcfaf-3673-4fe9-a72e-217fbc4a3732 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:35.964451 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89709a-0935-4bcd-bba3-a4b825552e0e None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:35.964779 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89709a-0935-4bcd-bba3-a4b825552e0e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:35.965061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89709a-0935-4bcd-bba3-a4b825552e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:36.025187 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ae89709a-0935-4bcd-bba3-a4b825552e0e None None] MFA Rules not processed for user `e50367aadd6f4429813e44b50eed2043`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:36.026776 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ae89709a-0935-4bcd-bba3-a4b825552e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:36.134949 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd7b04-953b-4f02-aaa4-0ddda00e52d2 tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc02ae33708449587c1c5093da77d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b776d51a0748476d8383a386b253c23e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:36.135974 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd7b04-953b-4f02-aaa4-0ddda00e52d2 tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:36.137376 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd7b04-953b-4f02-aaa4-0ddda00e52d2 tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:36.139210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd7b04-953b-4f02-aaa4-0ddda00e52d2 tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:36.144236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd7b04-953b-4f02-aaa4-0ddda00e52d2 tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:02:36.145127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd7b04-953b-4f02-aaa4-0ddda00e52d2 tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:36.147442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd7b04-953b-4f02-aaa4-0ddda00e52d2 tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:36.178461 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1029/2101] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:36.189615 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1073/2102] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:02:36.192277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89709a-0935-4bcd-bba3-a4b825552e0e None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:36.201605 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd7b04-953b-4f02-aaa4-0ddda00e52d2 tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:36.204002 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89709a-0935-4bcd-bba3-a4b825552e0e None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:36.210278 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404b3aa-45e0-4031-8ffd-d6ef0a60bde7 tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc02ae33708449587c1c5093da77d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b776d51a0748476d8383a386b253c23e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:36.210957 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404b3aa-45e0-4031-8ffd-d6ef0a60bde7 tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:36.211244 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404b3aa-45e0-4031-8ffd-d6ef0a60bde7 tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:36.211571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404b3aa-45e0-4031-8ffd-d6ef0a60bde7 tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:36.212294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404b3aa-45e0-4031-8ffd-d6ef0a60bde7 tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:36.215958 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404b3aa-45e0-4031-8ffd-d6ef0a60bde7 tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:36.245709 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:36.294231 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd7b04-953b-4f02-aaa4-0ddda00e52d2 tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:36.311450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1abd4-a2bc-49d5-b8a9-f00204904d9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:36.311450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1abd4-a2bc-49d5-b8a9-f00204904d9a service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:36.311450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1abd4-a2bc-49d5-b8a9-f00204904d9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:36.311450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1abd4-a2bc-49d5-b8a9-f00204904d9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:36.346427 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1030/2103] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:02:36 2022] POST /identity/v3/projects => generated 355 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:02:36.347638 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404b3aa-45e0-4031-8ffd-d6ef0a60bde7 tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:36.396540 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:36.405328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1abd4-a2bc-49d5-b8a9-f00204904d9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:36.405328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1abd4-a2bc-49d5-b8a9-f00204904d9a service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:36.417763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1074/2104] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:02:36.489348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404b3aa-45e0-4031-8ffd-d6ef0a60bde7 tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:36.498410 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0e5d9-9185-41ca-89a2-62f0a593b3fa tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc02ae33708449587c1c5093da77d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b776d51a0748476d8383a386b253c23e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:36.499973 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0e5d9-9185-41ca-89a2-62f0a593b3fa tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:36.500293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0e5d9-9185-41ca-89a2-62f0a593b3fa tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:36.500600 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0e5d9-9185-41ca-89a2-62f0a593b3fa tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:36.501393 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0e5d9-9185-41ca-89a2-62f0a593b3fa tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:02:36.501715 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0e5d9-9185-41ca-89a2-62f0a593b3fa tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:36.503420 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0e5d9-9185-41ca-89a2-62f0a593b3fa tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:36.539946 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1031/2105] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 13:02:37.219619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1abd4-a2bc-49d5-b8a9-f00204904d9a service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:37.233849 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1abd4-a2bc-49d5-b8a9-f00204904d9a service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:37.240219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b8c2c-a947-4aa6-bcda-0ccbb95c4bfe tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc02ae33708449587c1c5093da77d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b776d51a0748476d8383a386b253c23e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:37.241177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b8c2c-a947-4aa6-bcda-0ccbb95c4bfe tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:37.241459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b8c2c-a947-4aa6-bcda-0ccbb95c4bfe tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:37.241735 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b8c2c-a947-4aa6-bcda-0ccbb95c4bfe tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] PATH_INFO: `/v3/projects/a1284c25faf243809f7ed5e89c470bcf` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:37.243175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b8c2c-a947-4aa6-bcda-0ccbb95c4bfe tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a1284c25faf243809f7ed5e89c470bcf)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:37.245196 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b8c2c-a947-4aa6-bcda-0ccbb95c4bfe tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:37.378278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-677b8c2c-a947-4aa6-bcda-0ccbb95c4bfe tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1284c25faf243809f7ed5e89c470bcf', 'request_id': 'req-677b8c2c-a947-4aa6-bcda-0ccbb95c4bfe'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:37.390485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-677b8c2c-a947-4aa6-bcda-0ccbb95c4bfe tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1284c25faf243809f7ed5e89c470bcf', 'request_id': 'req-677b8c2c-a947-4aa6-bcda-0ccbb95c4bfe'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:37.397602 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-677b8c2c-a947-4aa6-bcda-0ccbb95c4bfe tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1284c25faf243809f7ed5e89c470bcf', 'request_id': 'req-677b8c2c-a947-4aa6-bcda-0ccbb95c4bfe'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:37.457869 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-677b8c2c-a947-4aa6-bcda-0ccbb95c4bfe tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] The token cache is being invalidate because project a1284c25faf243809f7ed5e89c470bcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:02:37.457869 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-677b8c2c-a947-4aa6-bcda-0ccbb95c4bfe tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:37.457869 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-677b8c2c-a947-4aa6-bcda-0ccbb95c4bfe tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:37.467213 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1075/2106] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:02:37 2022] DELETE /identity/v3/projects/a1284c25faf243809f7ed5e89c470bcf => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:38.337727 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0e5d9-9185-41ca-89a2-62f0a593b3fa tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:38.340051 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7ab0e5d9-9185-41ca-89a2-62f0a593b3fa tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:38.425450 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0e5d9-9185-41ca-89a2-62f0a593b3fa tempest-VolumeQuotaClassesTest-621183569 tempest-VolumeQuotaClassesTest-621183569-project-admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:38.509983 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c320d9-b0e4-4b35-b2ce-0cbfefe1aa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:38.510874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c320d9-b0e4-4b35-b2ce-0cbfefe1aa58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:38.511161 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c320d9-b0e4-4b35-b2ce-0cbfefe1aa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:38.511441 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c320d9-b0e4-4b35-b2ce-0cbfefe1aa58 admin admin] PATH_INFO: `/v3/users/bb4b6bcd3550433ba20d81cb937b9724` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:38.512787 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c320d9-b0e4-4b35-b2ce-0cbfefe1aa58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb4b6bcd3550433ba20d81cb937b9724)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:38.514848 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c320d9-b0e4-4b35-b2ce-0cbfefe1aa58 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:38.518476 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cf592-34f7-45d3-9ca9-ee90de2b75e6 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:38.518957 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cf592-34f7-45d3-9ca9-ee90de2b75e6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:38.519047 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cf592-34f7-45d3-9ca9-ee90de2b75e6 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:38.520482 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1076/2107] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jul 5 13:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 13:02:38.542951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e3779-7578-4a93-9ae5-b6daa9c20d10 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:38.543487 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e3779-7578-4a93-9ae5-b6daa9c20d10 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:38.543779 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e3779-7578-4a93-9ae5-b6daa9c20d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:38.564047 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-8c1e3779-7578-4a93-9ae5-b6daa9c20d10 None None] MFA Rules not processed for user `43b85b5c7b1e4d73b29fb96f4fa6db71`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:38.565379 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8c1e3779-7578-4a93-9ae5-b6daa9c20d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:38.620460 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:38.634163 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1077/2108] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jul 5 13:02:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:38.645213 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e3779-7578-4a93-9ae5-b6daa9c20d10 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:38.646584 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8c1e3779-7578-4a93-9ae5-b6daa9c20d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:38.663146 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e3779-7578-4a93-9ae5-b6daa9c20d10 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:38.669451 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e36dc1-391e-402d-9e09-a8d48e48404c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43b85b5c7b1e4d73b29fb96f4fa6db71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:38.673434 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e36dc1-391e-402d-9e09-a8d48e48404c service placement] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:38.673722 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e36dc1-391e-402d-9e09-a8d48e48404c service placement] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:38.673898 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e36dc1-391e-402d-9e09-a8d48e48404c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:38.685211 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e36dc1-391e-402d-9e09-a8d48e48404c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:38.687720 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e36dc1-391e-402d-9e09-a8d48e48404c service placement] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:38.710952 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1078/2109] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:02:38.710952 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e36dc1-391e-402d-9e09-a8d48e48404c service placement] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:38.710952 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-89e36dc1-391e-402d-9e09-a8d48e48404c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:38.729671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e36dc1-391e-402d-9e09-a8d48e48404c service placement] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:38.739499 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7afe4-6c77-423b-b71d-c06fdc1754e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:38.740868 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7afe4-6c77-423b-b71d-c06fdc1754e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:38.741284 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7afe4-6c77-423b-b71d-c06fdc1754e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:38.741952 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7afe4-6c77-423b-b71d-c06fdc1754e3 admin admin] PATH_INFO: `/v3/users/ac264b6684ae4c3f9fc8903163693d6f` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:38.748669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7afe4-6c77-423b-b71d-c06fdc1754e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac264b6684ae4c3f9fc8903163693d6f)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:38.748669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7afe4-6c77-423b-b71d-c06fdc1754e3 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:38.793080 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-96c320d9-b0e4-4b35-b2ce-0cbfefe1aa58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb4b6bcd3550433ba20d81cb937b9724'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:38.802201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-96c320d9-b0e4-4b35-b2ce-0cbfefe1aa58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb4b6bcd3550433ba20d81cb937b9724'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:38.803112 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-96c320d9-b0e4-4b35-b2ce-0cbfefe1aa58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb4b6bcd3550433ba20d81cb937b9724'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:38.803785 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-96c320d9-b0e4-4b35-b2ce-0cbfefe1aa58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb4b6bcd3550433ba20d81cb937b9724'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:38.811605 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:38.819466 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-96c320d9-b0e4-4b35-b2ce-0cbfefe1aa58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb4b6bcd3550433ba20d81cb937b9724'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:38.935173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1032/2110] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:02:38 2022] DELETE /identity/v3/users/bb4b6bcd3550433ba20d81cb937b9724 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:38.936053 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c320d9-b0e4-4b35-b2ce-0cbfefe1aa58 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:38.937634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-96c320d9-b0e4-4b35-b2ce-0cbfefe1aa58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:39.043002 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c320d9-b0e4-4b35-b2ce-0cbfefe1aa58 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:39.043002 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30312cc-79ac-4ac2-9c7a-bf8ec62bf0df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:39.043002 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30312cc-79ac-4ac2-9c7a-bf8ec62bf0df service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:39.043002 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30312cc-79ac-4ac2-9c7a-bf8ec62bf0df service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:39.043499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30312cc-79ac-4ac2-9c7a-bf8ec62bf0df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:39.043499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b30312cc-79ac-4ac2-9c7a-bf8ec62bf0df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:39.086944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-91a7afe4-6c77-423b-b71d-c06fdc1754e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac264b6684ae4c3f9fc8903163693d6f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:39.091246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30312cc-79ac-4ac2-9c7a-bf8ec62bf0df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:39.092732 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30312cc-79ac-4ac2-9c7a-bf8ec62bf0df service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:39.094835 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-91a7afe4-6c77-423b-b71d-c06fdc1754e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac264b6684ae4c3f9fc8903163693d6f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:39.095595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-91a7afe4-6c77-423b-b71d-c06fdc1754e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac264b6684ae4c3f9fc8903163693d6f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:39.096279 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-91a7afe4-6c77-423b-b71d-c06fdc1754e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac264b6684ae4c3f9fc8903163693d6f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:39.105442 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1033/2111] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:39.109249 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28338b9b-cd4e-4c31-be45-6a6a0c5a2f0e None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:39.109249 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28338b9b-cd4e-4c31-be45-6a6a0c5a2f0e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:39.109249 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28338b9b-cd4e-4c31-be45-6a6a0c5a2f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:39.113873 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-91a7afe4-6c77-423b-b71d-c06fdc1754e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac264b6684ae4c3f9fc8903163693d6f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:39.129462 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-28338b9b-cd4e-4c31-be45-6a6a0c5a2f0e None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:39.130713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-28338b9b-cd4e-4c31-be45-6a6a0c5a2f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:39.210001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1034/2112] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:39.223138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1079/2113] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:02:38 2022] DELETE /identity/v3/users/ac264b6684ae4c3f9fc8903163693d6f => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:39.224368 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28338b9b-cd4e-4c31-be45-6a6a0c5a2f0e None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:39.225813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-28338b9b-cd4e-4c31-be45-6a6a0c5a2f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:39.284758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:39.288474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28338b9b-cd4e-4c31-be45-6a6a0c5a2f0e None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:39.356109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f33a58-609e-4b16-9e08-21a6daac92be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:39.356839 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f33a58-609e-4b16-9e08-21a6daac92be service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:39.357117 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f33a58-609e-4b16-9e08-21a6daac92be service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:39.358157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f33a58-609e-4b16-9e08-21a6daac92be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:39.429501 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f33a58-609e-4b16-9e08-21a6daac92be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:39.431009 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f33a58-609e-4b16-9e08-21a6daac92be service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:39.440668 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1035/2114] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:39.480213 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7afe4-6c77-423b-b71d-c06fdc1754e3 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:39.487027 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-91a7afe4-6c77-423b-b71d-c06fdc1754e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:39.505999 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7afe4-6c77-423b-b71d-c06fdc1754e3 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:39.516485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca5bf7-d491-44f5-b44d-7105bd28408c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:39.518159 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca5bf7-d491-44f5-b44d-7105bd28408c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:39.518159 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca5bf7-d491-44f5-b44d-7105bd28408c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:39.518159 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca5bf7-d491-44f5-b44d-7105bd28408c admin admin] PATH_INFO: `/v3/projects/79d337ebe3a0475b9331780325e17451` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:39.520246 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca5bf7-d491-44f5-b44d-7105bd28408c admin admin] RBAC: Authorizing `identity:delete_project(project_id=79d337ebe3a0475b9331780325e17451)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:39.522619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca5bf7-d491-44f5-b44d-7105bd28408c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:39.644968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8fca5bf7-d491-44f5-b44d-7105bd28408c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79d337ebe3a0475b9331780325e17451', 'request_id': 'req-8fca5bf7-d491-44f5-b44d-7105bd28408c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:39.651612 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8fca5bf7-d491-44f5-b44d-7105bd28408c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79d337ebe3a0475b9331780325e17451', 'request_id': 'req-8fca5bf7-d491-44f5-b44d-7105bd28408c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:39.658838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8fca5bf7-d491-44f5-b44d-7105bd28408c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79d337ebe3a0475b9331780325e17451', 'request_id': 'req-8fca5bf7-d491-44f5-b44d-7105bd28408c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:39.759410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8fca5bf7-d491-44f5-b44d-7105bd28408c admin admin] The token cache is being invalidate because project 79d337ebe3a0475b9331780325e17451 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:02:39.759410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8fca5bf7-d491-44f5-b44d-7105bd28408c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:39.759410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8fca5bf7-d491-44f5-b44d-7105bd28408c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:39.759410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1080/2115] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:02:39 2022] DELETE /identity/v3/projects/79d337ebe3a0475b9331780325e17451 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:39.759805 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c38d0-d87b-43cc-a5b4-dfeb5b765cfa None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:39.759805 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c38d0-d87b-43cc-a5b4-dfeb5b765cfa None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:39.759805 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c38d0-d87b-43cc-a5b4-dfeb5b765cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:39.776712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f36c38d0-d87b-43cc-a5b4-dfeb5b765cfa None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:39.777962 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f36c38d0-d87b-43cc-a5b4-dfeb5b765cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:39.841616 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1036/2116] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:39.850537 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f11d3-945b-4c35-b79c-410dd29e3271 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:39.853140 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f11d3-945b-4c35-b79c-410dd29e3271 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:39.853140 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f11d3-945b-4c35-b79c-410dd29e3271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:39.877398 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-9e0f11d3-945b-4c35-b79c-410dd29e3271 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:39.879295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9e0f11d3-945b-4c35-b79c-410dd29e3271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:39.893778 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c38d0-d87b-43cc-a5b4-dfeb5b765cfa None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:39.898446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f36c38d0-d87b-43cc-a5b4-dfeb5b765cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:39.899541 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1081/2117] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:39.903484 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f11d3-945b-4c35-b79c-410dd29e3271 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:39.916539 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c38d0-d87b-43cc-a5b4-dfeb5b765cfa None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:39.919095 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f11d3-945b-4c35-b79c-410dd29e3271 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:39.925052 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c3996-783c-4446-93be-92e57f0fb97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:39.928109 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c3996-783c-4446-93be-92e57f0fb97a admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:39.928109 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c3996-783c-4446-93be-92e57f0fb97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:39.928109 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c3996-783c-4446-93be-92e57f0fb97a admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:39.928922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c3996-783c-4446-93be-92e57f0fb97a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:02:39.929461 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c3996-783c-4446-93be-92e57f0fb97a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:39.931231 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c3996-783c-4446-93be-92e57f0fb97a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:39.945770 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7f0b7-5707-4728-b6e3-4ad3f46e0e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:39.945939 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1082/2118] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 13:02:39.946988 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7f0b7-5707-4728-b6e3-4ad3f46e0e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:39.948503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7f0b7-5707-4728-b6e3-4ad3f46e0e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:39.948808 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7f0b7-5707-4728-b6e3-4ad3f46e0e81 admin admin] PATH_INFO: `/v3/projects/647b7611e9504d3e8816c73f13ff1504` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:39.950322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c3996-783c-4446-93be-92e57f0fb97a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:39.951762 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7f0b7-5707-4728-b6e3-4ad3f46e0e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=647b7611e9504d3e8816c73f13ff1504)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:39.954048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7f0b7-5707-4728-b6e3-4ad3f46e0e81 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:39.966129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c3996-783c-4446-93be-92e57f0fb97a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:39.971431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb5d6e-9bca-45d8-a421-2680d05ff92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:39.972106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb5d6e-9bca-45d8-a421-2680d05ff92a admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:39.973158 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb5d6e-9bca-45d8-a421-2680d05ff92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:39.973445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb5d6e-9bca-45d8-a421-2680d05ff92a admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:39.974152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb5d6e-9bca-45d8-a421-2680d05ff92a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:39.976126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb5d6e-9bca-45d8-a421-2680d05ff92a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:39.997734 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:40.094870 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1083/2119] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:02:39 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:40.095437 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:40.095682 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb5d6e-9bca-45d8-a421-2680d05ff92a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:40.105257 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-66a7f0b7-5707-4728-b6e3-4ad3f46e0e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '647b7611e9504d3e8816c73f13ff1504', 'request_id': 'req-66a7f0b7-5707-4728-b6e3-4ad3f46e0e81'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:40.161069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb5d6e-9bca-45d8-a421-2680d05ff92a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:40.166357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5670e9b-b871-404e-b182-ba2aaea99bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:40.167792 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5670e9b-b871-404e-b182-ba2aaea99bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:40.168009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5670e9b-b871-404e-b182-ba2aaea99bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:40.168275 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5670e9b-b871-404e-b182-ba2aaea99bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:40.169252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5670e9b-b871-404e-b182-ba2aaea99bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:40.176805 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5670e9b-b871-404e-b182-ba2aaea99bc1 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:40.221148 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-66a7f0b7-5707-4728-b6e3-4ad3f46e0e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '647b7611e9504d3e8816c73f13ff1504', 'request_id': 'req-66a7f0b7-5707-4728-b6e3-4ad3f46e0e81'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:40.229808 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-66a7f0b7-5707-4728-b6e3-4ad3f46e0e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '647b7611e9504d3e8816c73f13ff1504', 'request_id': 'req-66a7f0b7-5707-4728-b6e3-4ad3f46e0e81'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:40.241428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-66a7f0b7-5707-4728-b6e3-4ad3f46e0e81 admin admin] The token cache is being invalidate because project 647b7611e9504d3e8816c73f13ff1504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:02:40.241858 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-66a7f0b7-5707-4728-b6e3-4ad3f46e0e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:40.242519 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-66a7f0b7-5707-4728-b6e3-4ad3f46e0e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:40.244073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1037/2120] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:02:39 2022] DELETE /identity/v3/projects/647b7611e9504d3e8816c73f13ff1504 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:40.247825 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7f0b7-5707-4728-b6e3-4ad3f46e0e81 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:40.249113 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-66a7f0b7-5707-4728-b6e3-4ad3f46e0e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:40.261563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1084/2121] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:02:40 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:40.271282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5670e9b-b871-404e-b182-ba2aaea99bc1 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:40.273297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b5670e9b-b871-404e-b182-ba2aaea99bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:40.286333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5670e9b-b871-404e-b182-ba2aaea99bc1 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:40.291505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b0727-44c4-436b-b71b-b462356ce91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:40.292203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b0727-44c4-436b-b71b-b462356ce91d admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:40.292717 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b0727-44c4-436b-b71b-b462356ce91d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:40.292997 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b0727-44c4-436b-b71b-b462356ce91d admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:40.293731 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b0727-44c4-436b-b71b-b462356ce91d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:40.296863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b0727-44c4-436b-b71b-b462356ce91d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:40.308139 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1085/2122] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:02:40.312086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b0727-44c4-436b-b71b-b462356ce91d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:40.320718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7f0b7-5707-4728-b6e3-4ad3f46e0e81 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:40.322204 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b0727-44c4-436b-b71b-b462356ce91d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:40.325457 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df4873-f1dc-4f68-8e8a-c2e34ad9114f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:40.326377 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df4873-f1dc-4f68-8e8a-c2e34ad9114f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:40.326656 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df4873-f1dc-4f68-8e8a-c2e34ad9114f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:40.326929 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df4873-f1dc-4f68-8e8a-c2e34ad9114f admin admin] PATH_INFO: `/v3/users/efc02ae33708449587c1c5093da77d20` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:40.327150 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c9b6c-036a-44a0-ac56-4071050070a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:40.327825 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c9b6c-036a-44a0-ac56-4071050070a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:40.328095 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c9b6c-036a-44a0-ac56-4071050070a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:40.328333 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df4873-f1dc-4f68-8e8a-c2e34ad9114f admin admin] RBAC: Authorizing `identity:delete_user(user_id=efc02ae33708449587c1c5093da77d20)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:40.328435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c9b6c-036a-44a0-ac56-4071050070a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:40.329156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c9b6c-036a-44a0-ac56-4071050070a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:40.330344 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df4873-f1dc-4f68-8e8a-c2e34ad9114f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:40.330759 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c9b6c-036a-44a0-ac56-4071050070a8 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:40.344615 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1086/2123] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:02:40.346825 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c9b6c-036a-44a0-ac56-4071050070a8 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:40.359102 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c9b6c-036a-44a0-ac56-4071050070a8 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:40.363785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765e0eb-f3db-4300-bae5-1f16d7f729b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:40.364710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765e0eb-f3db-4300-bae5-1f16d7f729b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:40.364994 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765e0eb-f3db-4300-bae5-1f16d7f729b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:40.365269 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765e0eb-f3db-4300-bae5-1f16d7f729b5 admin admin] PATH_INFO: `/v3/projects/51236faf04834910866632e8704e0b57/users/337c273f4f1f43a89ec8b02f6bd4617a/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:40.380525 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765e0eb-f3db-4300-bae5-1f16d7f729b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51236faf04834910866632e8704e0b57, user_id=337c273f4f1f43a89ec8b02f6bd4617a, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:40.383258 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765e0eb-f3db-4300-bae5-1f16d7f729b5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:40.479798 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1087/2124] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:40 2022] PUT /identity/v3/projects/51236faf04834910866632e8704e0b57/users/337c273f4f1f43a89ec8b02f6bd4617a/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:02:40.490219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb7910-1a87-4a20-b945-9cc162e31145 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:40.490510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb7910-1a87-4a20-b945-9cc162e31145 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:40.490815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb7910-1a87-4a20-b945-9cc162e31145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:40.516368 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-38df4873-f1dc-4f68-8e8a-c2e34ad9114f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efc02ae33708449587c1c5093da77d20'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:40.518095 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-97bb7910-1a87-4a20-b945-9cc162e31145 None None] MFA Rules not processed for user `337c273f4f1f43a89ec8b02f6bd4617a`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:40.519363 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-97bb7910-1a87-4a20-b945-9cc162e31145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:40.525007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-38df4873-f1dc-4f68-8e8a-c2e34ad9114f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efc02ae33708449587c1c5093da77d20'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:40.525811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-38df4873-f1dc-4f68-8e8a-c2e34ad9114f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efc02ae33708449587c1c5093da77d20'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:40.526487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-38df4873-f1dc-4f68-8e8a-c2e34ad9114f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efc02ae33708449587c1c5093da77d20'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:40.540057 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-38df4873-f1dc-4f68-8e8a-c2e34ad9114f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efc02ae33708449587c1c5093da77d20'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:40.587987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1088/2125] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:02:40.592515 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb7910-1a87-4a20-b945-9cc162e31145 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:40.593870 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-97bb7910-1a87-4a20-b945-9cc162e31145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:40.633445 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1038/2126] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:02:40 2022] DELETE /identity/v3/users/efc02ae33708449587c1c5093da77d20 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:02:40.661077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb7910-1a87-4a20-b945-9cc162e31145 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:40.730087 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4addd53-4004-4478-9ce9-0731cbabbdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:40.730752 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4addd53-4004-4478-9ce9-0731cbabbdda admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:40.731038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4addd53-4004-4478-9ce9-0731cbabbdda admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:40.731308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4addd53-4004-4478-9ce9-0731cbabbdda admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:40.732163 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4addd53-4004-4478-9ce9-0731cbabbdda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:40.734674 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4addd53-4004-4478-9ce9-0731cbabbdda admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:40.839222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df4873-f1dc-4f68-8e8a-c2e34ad9114f admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:40.840645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-38df4873-f1dc-4f68-8e8a-c2e34ad9114f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:40.874966 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1089/2127] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:02:40 2022] POST /identity/v3/projects => generated 369 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:02:40.879728 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4addd53-4004-4478-9ce9-0731cbabbdda admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:40.905107 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:40.927435 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df4873-f1dc-4f68-8e8a-c2e34ad9114f admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:40.963200 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4addd53-4004-4478-9ce9-0731cbabbdda admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:40.973381 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae644079-5c46-4798-ba92-745311e7731a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:40.974080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae644079-5c46-4798-ba92-745311e7731a admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:40.974369 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae644079-5c46-4798-ba92-745311e7731a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:40.974651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae644079-5c46-4798-ba92-745311e7731a admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:40.975361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae644079-5c46-4798-ba92-745311e7731a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:40.977622 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae644079-5c46-4798-ba92-745311e7731a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:40.993484 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfdb94-93f0-472b-b47d-6c3c400a8d61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:40.994150 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfdb94-93f0-472b-b47d-6c3c400a8d61 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:40.994435 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfdb94-93f0-472b-b47d-6c3c400a8d61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:40.994722 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfdb94-93f0-472b-b47d-6c3c400a8d61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:40.996542 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-18bfdb94-93f0-472b-b47d-6c3c400a8d61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:41.020959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:41.062204 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bfdb94-93f0-472b-b47d-6c3c400a8d61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:41.064436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bfdb94-93f0-472b-b47d-6c3c400a8d61 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:41.072806 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1090/2128] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:02:40 2022] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:41.077201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1039/2129] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:02:41.077323 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae644079-5c46-4798-ba92-745311e7731a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:41.089195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae644079-5c46-4798-ba92-745311e7731a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:41.096072 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc2f15-989d-4978-9b13-ad9d75b9d09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:41.096874 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc2f15-989d-4978-9b13-ad9d75b9d09a admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:41.097942 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc2f15-989d-4978-9b13-ad9d75b9d09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:41.098106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc2f15-989d-4978-9b13-ad9d75b9d09a admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:41.099083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc2f15-989d-4978-9b13-ad9d75b9d09a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:41.100955 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc2f15-989d-4978-9b13-ad9d75b9d09a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:41.116430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1091/2130] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:41.120143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfdb94-93f0-472b-b47d-6c3c400a8d61 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:41.131055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfdb94-93f0-472b-b47d-6c3c400a8d61 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:41.135922 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33dee7-0c1e-4712-8b70-57f8f76335e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:41.136955 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33dee7-0c1e-4712-8b70-57f8f76335e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:41.137311 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33dee7-0c1e-4712-8b70-57f8f76335e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:41.137662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33dee7-0c1e-4712-8b70-57f8f76335e4 admin admin] PATH_INFO: `/v3/projects/48cf4f93644e44deb0df7592ff007e63/users/8231904d9f2d4eb796ced86b093cc5dd/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:41.153669 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33dee7-0c1e-4712-8b70-57f8f76335e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48cf4f93644e44deb0df7592ff007e63, user_id=8231904d9f2d4eb796ced86b093cc5dd, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:41.156659 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33dee7-0c1e-4712-8b70-57f8f76335e4 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:41.175308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc2f15-989d-4978-9b13-ad9d75b9d09a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:41.176260 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-34cc2f15-989d-4978-9b13-ad9d75b9d09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:41.197679 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc2f15-989d-4978-9b13-ad9d75b9d09a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:41.203168 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa3cf7-6a4e-49e3-b5c6-ba923d4dd432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:41.204050 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa3cf7-6a4e-49e3-b5c6-ba923d4dd432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:41.204347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa3cf7-6a4e-49e3-b5c6-ba923d4dd432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:41.204696 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa3cf7-6a4e-49e3-b5c6-ba923d4dd432 admin admin] PATH_INFO: `/v3/projects/b776d51a0748476d8383a386b253c23e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:41.205975 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa3cf7-6a4e-49e3-b5c6-ba923d4dd432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b776d51a0748476d8383a386b253c23e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:41.208558 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa3cf7-6a4e-49e3-b5c6-ba923d4dd432 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:41.244710 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1040/2131] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:41 2022] PUT /identity/v3/projects/48cf4f93644e44deb0df7592ff007e63/users/8231904d9f2d4eb796ced86b093cc5dd/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:02:41.248298 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33dee7-0c1e-4712-8b70-57f8f76335e4 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:41.321053 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33dee7-0c1e-4712-8b70-57f8f76335e4 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:41.326740 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0edd6-6d3c-4c68-beaf-f78e74f5d8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:41.327679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0edd6-6d3c-4c68-beaf-f78e74f5d8ae admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:41.333544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0edd6-6d3c-4c68-beaf-f78e74f5d8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:41.333544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0edd6-6d3c-4c68-beaf-f78e74f5d8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:41.333761 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0edd6-6d3c-4c68-beaf-f78e74f5d8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:41.335536 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0edd6-6d3c-4c68-beaf-f78e74f5d8ae admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:41.350810 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1041/2132] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:02:41.356022 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0edd6-6d3c-4c68-beaf-f78e74f5d8ae admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:41.361014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3bfa3cf7-6a4e-49e3-b5c6-ba923d4dd432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b776d51a0748476d8383a386b253c23e', 'request_id': 'req-3bfa3cf7-6a4e-49e3-b5c6-ba923d4dd432'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:41.371430 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0edd6-6d3c-4c68-beaf-f78e74f5d8ae admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:41.371715 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3bfa3cf7-6a4e-49e3-b5c6-ba923d4dd432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b776d51a0748476d8383a386b253c23e', 'request_id': 'req-3bfa3cf7-6a4e-49e3-b5c6-ba923d4dd432'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:41.383902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3bfa3cf7-6a4e-49e3-b5c6-ba923d4dd432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b776d51a0748476d8383a386b253c23e', 'request_id': 'req-3bfa3cf7-6a4e-49e3-b5c6-ba923d4dd432'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:41.444174 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc628bf7-c597-4764-a188-8388384b8c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:41.445105 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc628bf7-c597-4764-a188-8388384b8c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:41.445389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc628bf7-c597-4764-a188-8388384b8c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:41.445662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc628bf7-c597-4764-a188-8388384b8c42 admin admin] PATH_INFO: `/v3/projects/48cf4f93644e44deb0df7592ff007e63/users/8231904d9f2d4eb796ced86b093cc5dd/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:41.447630 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc628bf7-c597-4764-a188-8388384b8c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48cf4f93644e44deb0df7592ff007e63, user_id=8231904d9f2d4eb796ced86b093cc5dd, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:41.450339 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc628bf7-c597-4764-a188-8388384b8c42 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:41.464282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3bfa3cf7-6a4e-49e3-b5c6-ba923d4dd432 admin admin] The token cache is being invalidate because project b776d51a0748476d8383a386b253c23e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:02:41.467068 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1042/2133] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:41 2022] PUT /identity/v3/projects/48cf4f93644e44deb0df7592ff007e63/users/8231904d9f2d4eb796ced86b093cc5dd/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:41.473271 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3bfa3cf7-6a4e-49e3-b5c6-ba923d4dd432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:41.474205 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3bfa3cf7-6a4e-49e3-b5c6-ba923d4dd432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:41.475193 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2ca7b-4085-4a55-97e6-cd639fb2abbc None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:41.475489 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2ca7b-4085-4a55-97e6-cd639fb2abbc None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:41.475773 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2ca7b-4085-4a55-97e6-cd639fb2abbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:41.476201 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1092/2134] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:02:41 2022] DELETE /identity/v3/projects/b776d51a0748476d8383a386b253c23e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:02:41.481106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28311e9c-057d-46b5-b37e-5aac6354933b None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:41.481393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28311e9c-057d-46b5-b37e-5aac6354933b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:41.481677 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28311e9c-057d-46b5-b37e-5aac6354933b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:41.500809 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-28311e9c-057d-46b5-b37e-5aac6354933b None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:41.502152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-28311e9c-057d-46b5-b37e-5aac6354933b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:41.506172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d2c2ca7b-4085-4a55-97e6-cd639fb2abbc None None] MFA Rules not processed for user `8231904d9f2d4eb796ced86b093cc5dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:41.507372 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d2c2ca7b-4085-4a55-97e6-cd639fb2abbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:41.532257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:41.566720 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1093/2135] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:02:41.575748 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd617664-ab98-4c71-af10-c3f8230477e5 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:41.576299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd617664-ab98-4c71-af10-c3f8230477e5 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:41.576945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd617664-ab98-4c71-af10-c3f8230477e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:41.581539 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1043/2136] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:41 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:41.593323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2ca7b-4085-4a55-97e6-cd639fb2abbc None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:41.594691 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d2c2ca7b-4085-4a55-97e6-cd639fb2abbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:41.596149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-cd617664-ab98-4c71-af10-c3f8230477e5 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:41.597960 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-cd617664-ab98-4c71-af10-c3f8230477e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:41.606075 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1094/2137] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:02:41.610606 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd617664-ab98-4c71-af10-c3f8230477e5 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:41.621398 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd617664-ab98-4c71-af10-c3f8230477e5 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:41.626164 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53e3be-87fd-4172-a93e-2cb62a2b9a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:41.626847 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53e3be-87fd-4172-a93e-2cb62a2b9a1a admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:41.627119 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53e3be-87fd-4172-a93e-2cb62a2b9a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:41.627400 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53e3be-87fd-4172-a93e-2cb62a2b9a1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:41.628133 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53e3be-87fd-4172-a93e-2cb62a2b9a1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:02:41.628459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53e3be-87fd-4172-a93e-2cb62a2b9a1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:41.630275 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53e3be-87fd-4172-a93e-2cb62a2b9a1a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:41.642514 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1095/2138] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 13:02:41.646973 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53e3be-87fd-4172-a93e-2cb62a2b9a1a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:41.650980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:41.655853 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2ca7b-4085-4a55-97e6-cd639fb2abbc None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:41.657124 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53e3be-87fd-4172-a93e-2cb62a2b9a1a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:41.660809 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d253c-9c2d-423d-b779-ff9b8ba7b908 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:41.666054 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d253c-9c2d-423d-b779-ff9b8ba7b908 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:41.666054 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d253c-9c2d-423d-b779-ff9b8ba7b908 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:41.666054 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d253c-9c2d-423d-b779-ff9b8ba7b908 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:41.666359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08aaee-1ddc-4153-a39c-674776f2bc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:41.666359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08aaee-1ddc-4153-a39c-674776f2bc5c admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:41.666359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08aaee-1ddc-4153-a39c-674776f2bc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:41.666359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08aaee-1ddc-4153-a39c-674776f2bc5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:41.666713 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08aaee-1ddc-4153-a39c-674776f2bc5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:41.666713 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08aaee-1ddc-4153-a39c-674776f2bc5c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:41.673741 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d253c-9c2d-423d-b779-ff9b8ba7b908 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:41.675184 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d253c-9c2d-423d-b779-ff9b8ba7b908 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:41.686045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1044/2139] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:41 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:02:41.788271 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1096/2140] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:02:41 2022] POST /identity/v3/projects => generated 367 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:41.792522 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d253c-9c2d-423d-b779-ff9b8ba7b908 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:41.803656 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d253c-9c2d-423d-b779-ff9b8ba7b908 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:41.883200 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed995f5-3cca-441c-8edd-61d9ac13782a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:41.884002 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed995f5-3cca-441c-8edd-61d9ac13782a admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:41.884361 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed995f5-3cca-441c-8edd-61d9ac13782a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:41.884559 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed995f5-3cca-441c-8edd-61d9ac13782a admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:41.885325 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed995f5-3cca-441c-8edd-61d9ac13782a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:41.887278 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed995f5-3cca-441c-8edd-61d9ac13782a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:41.936954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08aaee-1ddc-4153-a39c-674776f2bc5c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:41.939035 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-fd08aaee-1ddc-4153-a39c-674776f2bc5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:42.004491 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08aaee-1ddc-4153-a39c-674776f2bc5c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:42.008860 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefa17e-9202-475e-b2c9-17d33e73eda7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:42.009520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefa17e-9202-475e-b2c9-17d33e73eda7 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:42.009809 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefa17e-9202-475e-b2c9-17d33e73eda7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:42.010100 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefa17e-9202-475e-b2c9-17d33e73eda7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:42.011106 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1045/2141] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:02:41 2022] POST /identity/v3/users => generated 284 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:42.011958 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9cefa17e-9202-475e-b2c9-17d33e73eda7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:42.018886 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed995f5-3cca-441c-8edd-61d9ac13782a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:42.029438 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed995f5-3cca-441c-8edd-61d9ac13782a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:42.034257 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0365e0-e08f-4be7-a84e-4cb4d99fde45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:42.035527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0365e0-e08f-4be7-a84e-4cb4d99fde45 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:42.035826 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0365e0-e08f-4be7-a84e-4cb4d99fde45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:42.036234 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0365e0-e08f-4be7-a84e-4cb4d99fde45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:42.037000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0365e0-e08f-4be7-a84e-4cb4d99fde45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:42.038977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0365e0-e08f-4be7-a84e-4cb4d99fde45 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:42.054127 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1046/2142] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:42.055654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0365e0-e08f-4be7-a84e-4cb4d99fde45 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:42.067293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0365e0-e08f-4be7-a84e-4cb4d99fde45 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:42.072776 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175168de-dc13-49c9-8d9d-8c8354a6e0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:42.073476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175168de-dc13-49c9-8d9d-8c8354a6e0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:42.073812 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175168de-dc13-49c9-8d9d-8c8354a6e0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:42.074096 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175168de-dc13-49c9-8d9d-8c8354a6e0a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:42.074867 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175168de-dc13-49c9-8d9d-8c8354a6e0a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:42.076498 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175168de-dc13-49c9-8d9d-8c8354a6e0a8 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:42.085258 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefa17e-9202-475e-b2c9-17d33e73eda7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:42.086701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefa17e-9202-475e-b2c9-17d33e73eda7 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:42.088210 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1047/2143] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:42.092258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175168de-dc13-49c9-8d9d-8c8354a6e0a8 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:42.098011 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1097/2144] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:02:42.103141 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175168de-dc13-49c9-8d9d-8c8354a6e0a8 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:42.108107 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f36b2-f1c3-414c-8b94-0fe632df080c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:42.109029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f36b2-f1c3-414c-8b94-0fe632df080c admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:42.109311 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f36b2-f1c3-414c-8b94-0fe632df080c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:42.109590 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f36b2-f1c3-414c-8b94-0fe632df080c admin admin] PATH_INFO: `/v3/projects/01318f20bd1e4dcf9d4fc5c8a4d34a68/users/ea0add3a744a4dffb3797835bbe9acf7/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:42.127296 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f36b2-f1c3-414c-8b94-0fe632df080c admin admin] RBAC: Authorizing `identity:create_grant(project_id=01318f20bd1e4dcf9d4fc5c8a4d34a68, user_id=ea0add3a744a4dffb3797835bbe9acf7, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:42.130049 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f36b2-f1c3-414c-8b94-0fe632df080c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:42.210527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1048/2145] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:42 2022] PUT /identity/v3/projects/01318f20bd1e4dcf9d4fc5c8a4d34a68/users/ea0add3a744a4dffb3797835bbe9acf7/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:02:42.220992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8daa1e-415c-4a20-8c33-4b6e3fb1c170 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:42.227097 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8daa1e-415c-4a20-8c33-4b6e3fb1c170 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:42.227097 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8daa1e-415c-4a20-8c33-4b6e3fb1c170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:42.248253 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-0f8daa1e-415c-4a20-8c33-4b6e3fb1c170 None None] MFA Rules not processed for user `ea0add3a744a4dffb3797835bbe9acf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:42.249617 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0f8daa1e-415c-4a20-8c33-4b6e3fb1c170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:42.317285 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1098/2146] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:42.321925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f36b2-f1c3-414c-8b94-0fe632df080c admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:42.387272 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f36b2-f1c3-414c-8b94-0fe632df080c admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:42.392267 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6510a-8313-44c7-a966-1edf0e0fb31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:42.392978 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6510a-8313-44c7-a966-1edf0e0fb31a admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:42.393268 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6510a-8313-44c7-a966-1edf0e0fb31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:42.398931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6510a-8313-44c7-a966-1edf0e0fb31a admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:42.398931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6510a-8313-44c7-a966-1edf0e0fb31a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:42.398931 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6510a-8313-44c7-a966-1edf0e0fb31a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:42.505914 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1049/2147] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:02:42 2022] POST /identity/v3/projects => generated 367 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:42.510348 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8daa1e-415c-4a20-8c33-4b6e3fb1c170 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:42.529173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8daa1e-415c-4a20-8c33-4b6e3fb1c170 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:42.602462 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79e63d-796d-4695-9327-4cff33fa4e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:42.603209 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79e63d-796d-4695-9327-4cff33fa4e30 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:42.603420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79e63d-796d-4695-9327-4cff33fa4e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:42.603698 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79e63d-796d-4695-9327-4cff33fa4e30 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:42.604428 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79e63d-796d-4695-9327-4cff33fa4e30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:42.606460 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79e63d-796d-4695-9327-4cff33fa4e30 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:42.718066 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1099/2148] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:02:42 2022] POST /identity/v3/users => generated 290 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:42.722307 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6510a-8313-44c7-a966-1edf0e0fb31a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:42.732938 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6510a-8313-44c7-a966-1edf0e0fb31a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:42.737647 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e5cea-e3f5-40d1-b514-5a2e336cecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:42.738927 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e5cea-e3f5-40d1-b514-5a2e336cecfb admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:42.739215 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e5cea-e3f5-40d1-b514-5a2e336cecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:42.739493 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e5cea-e3f5-40d1-b514-5a2e336cecfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:42.740220 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e5cea-e3f5-40d1-b514-5a2e336cecfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:42.741864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e5cea-e3f5-40d1-b514-5a2e336cecfb admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:42.753131 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1050/2149] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:42.758163 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79e63d-796d-4695-9327-4cff33fa4e30 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:42.769197 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79e63d-796d-4695-9327-4cff33fa4e30 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:42.774316 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74344f2e-b55c-47c9-bf29-5c7d178864c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:42.775245 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74344f2e-b55c-47c9-bf29-5c7d178864c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:42.775531 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74344f2e-b55c-47c9-bf29-5c7d178864c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:42.775812 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74344f2e-b55c-47c9-bf29-5c7d178864c2 admin admin] PATH_INFO: `/v3/projects/0327bc773f8b46d8ba9cc6bf918bcaba/users/1bedc05b02a149559c4065316e390dad/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:42.786896 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:42.791127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74344f2e-b55c-47c9-bf29-5c7d178864c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0327bc773f8b46d8ba9cc6bf918bcaba, user_id=1bedc05b02a149559c4065316e390dad, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:42.793978 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74344f2e-b55c-47c9-bf29-5c7d178864c2 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:42.918809 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1100/2150] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:42 2022] PUT /identity/v3/projects/0327bc773f8b46d8ba9cc6bf918bcaba/users/1bedc05b02a149559c4065316e390dad/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:42.923337 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e5cea-e3f5-40d1-b514-5a2e336cecfb admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:42.933920 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e5cea-e3f5-40d1-b514-5a2e336cecfb admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:43.002328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9297e30-8cd1-4a9c-9c5d-e0e4693392e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:43.003007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9297e30-8cd1-4a9c-9c5d-e0e4693392e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:43.003294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9297e30-8cd1-4a9c-9c5d-e0e4693392e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:43.003598 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9297e30-8cd1-4a9c-9c5d-e0e4693392e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:43.004334 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9297e30-8cd1-4a9c-9c5d-e0e4693392e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:43.005973 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9297e30-8cd1-4a9c-9c5d-e0e4693392e4 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:43.015295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:43.018774 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1051/2151] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:43.021247 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74344f2e-b55c-47c9-bf29-5c7d178864c2 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:43.032042 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74344f2e-b55c-47c9-bf29-5c7d178864c2 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:43.039597 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed72b9-97ad-42d6-858f-3b92a6a034c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:43.040649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed72b9-97ad-42d6-858f-3b92a6a034c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:43.040951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed72b9-97ad-42d6-858f-3b92a6a034c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:43.041373 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed72b9-97ad-42d6-858f-3b92a6a034c9 admin admin] PATH_INFO: `/v3/projects/0327bc773f8b46d8ba9cc6bf918bcaba/users/1bedc05b02a149559c4065316e390dad/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:43.043513 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed72b9-97ad-42d6-858f-3b92a6a034c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0327bc773f8b46d8ba9cc6bf918bcaba, user_id=1bedc05b02a149559c4065316e390dad, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:43.046292 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed72b9-97ad-42d6-858f-3b92a6a034c9 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:43.062405 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1101/2152] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:43 2022] PUT /identity/v3/projects/0327bc773f8b46d8ba9cc6bf918bcaba/users/1bedc05b02a149559c4065316e390dad/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:02:43.073509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7a52f-e6f1-44c2-a10f-9a26a080b210 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:43.073874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7a52f-e6f1-44c2-a10f-9a26a080b210 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:43.074244 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7a52f-e6f1-44c2-a10f-9a26a080b210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:43.104174 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e5e7a52f-e6f1-44c2-a10f-9a26a080b210 None None] MFA Rules not processed for user `1bedc05b02a149559c4065316e390dad`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:43.105780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e5e7a52f-e6f1-44c2-a10f-9a26a080b210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:43.186721 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1052/2153] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:43 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:43.197773 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed72b9-97ad-42d6-858f-3b92a6a034c9 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:43.256126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed72b9-97ad-42d6-858f-3b92a6a034c9 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:43.259825 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38a756-4769-4933-a4bd-912b6c0275ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:43.260473 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38a756-4769-4933-a4bd-912b6c0275ef service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:43.260787 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38a756-4769-4933-a4bd-912b6c0275ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:43.261068 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38a756-4769-4933-a4bd-912b6c0275ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:43.270129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38a756-4769-4933-a4bd-912b6c0275ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:43.271608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38a756-4769-4933-a4bd-912b6c0275ef service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:43.281832 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1102/2154] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:43 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:43.654117 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7a52f-e6f1-44c2-a10f-9a26a080b210 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:43.665051 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7a52f-e6f1-44c2-a10f-9a26a080b210 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:43.668817 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b640b-ed44-4f9e-87b1-da69bd73706d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:43.669476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b640b-ed44-4f9e-87b1-da69bd73706d service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:43.669765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b640b-ed44-4f9e-87b1-da69bd73706d service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:43.670043 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b640b-ed44-4f9e-87b1-da69bd73706d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:43.678020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:43.736920 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b640b-ed44-4f9e-87b1-da69bd73706d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:43.738565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b640b-ed44-4f9e-87b1-da69bd73706d service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:43.749283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1053/2155] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:44.295521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:48.409605 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38a756-4769-4933-a4bd-912b6c0275ef service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:48.411096 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2c38a756-4769-4933-a4bd-912b6c0275ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:48.474882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38a756-4769-4933-a4bd-912b6c0275ef service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:48.479597 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296649eb-cff2-4f6a-b9fd-ee461e19b46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:48.480456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296649eb-cff2-4f6a-b9fd-ee461e19b46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:48.480767 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296649eb-cff2-4f6a-b9fd-ee461e19b46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:48.481040 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296649eb-cff2-4f6a-b9fd-ee461e19b46b admin admin] PATH_INFO: `/v3/users/9090c1880c8147889cc8c878cf54149d` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:48.482201 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296649eb-cff2-4f6a-b9fd-ee461e19b46b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9090c1880c8147889cc8c878cf54149d)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:48.484120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296649eb-cff2-4f6a-b9fd-ee461e19b46b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:48.748366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-296649eb-cff2-4f6a-b9fd-ee461e19b46b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9090c1880c8147889cc8c878cf54149d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:48.756195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-296649eb-cff2-4f6a-b9fd-ee461e19b46b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9090c1880c8147889cc8c878cf54149d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:48.756937 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-296649eb-cff2-4f6a-b9fd-ee461e19b46b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9090c1880c8147889cc8c878cf54149d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:48.757573 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-296649eb-cff2-4f6a-b9fd-ee461e19b46b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9090c1880c8147889cc8c878cf54149d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:48.770934 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-296649eb-cff2-4f6a-b9fd-ee461e19b46b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9090c1880c8147889cc8c878cf54149d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:48.862731 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1103/2156] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:02:48 2022] DELETE /identity/v3/users/9090c1880c8147889cc8c878cf54149d => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:48.867061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b17845-73ca-48cb-8948-30e98a946a54 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:48.867555 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b17845-73ca-48cb-8948-30e98a946a54 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:48.867649 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b17845-73ca-48cb-8948-30e98a946a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:48.886011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-35b17845-73ca-48cb-8948-30e98a946a54 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:48.887321 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-35b17845-73ca-48cb-8948-30e98a946a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:48.966070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1054/2157] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:48.975912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296649eb-cff2-4f6a-b9fd-ee461e19b46b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:48.977645 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-296649eb-cff2-4f6a-b9fd-ee461e19b46b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:49.021544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:49.034558 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296649eb-cff2-4f6a-b9fd-ee461e19b46b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:49.038264 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe099c-51fd-4545-8f45-e54ba410d767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:49.039955 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe099c-51fd-4545-8f45-e54ba410d767 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:49.039955 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe099c-51fd-4545-8f45-e54ba410d767 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:49.039955 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe099c-51fd-4545-8f45-e54ba410d767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:49.057460 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe099c-51fd-4545-8f45-e54ba410d767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:49.058938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe099c-51fd-4545-8f45-e54ba410d767 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:49.073826 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1104/2158] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:49.548247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b17845-73ca-48cb-8948-30e98a946a54 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:49.550587 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-35b17845-73ca-48cb-8948-30e98a946a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:49.565147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b17845-73ca-48cb-8948-30e98a946a54 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:49.570742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a875eca-659a-4f95-99eb-e02517ea0e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:49.571694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a875eca-659a-4f95-99eb-e02517ea0e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:49.572075 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a875eca-659a-4f95-99eb-e02517ea0e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:49.572415 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a875eca-659a-4f95-99eb-e02517ea0e73 admin admin] PATH_INFO: `/v3/projects/4174c22f6eda4a5d934acb3203d4da8c` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:49.573678 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a875eca-659a-4f95-99eb-e02517ea0e73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4174c22f6eda4a5d934acb3203d4da8c)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:49.575684 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a875eca-659a-4f95-99eb-e02517ea0e73 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:49.593852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:49.736181 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0a875eca-659a-4f95-99eb-e02517ea0e73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4174c22f6eda4a5d934acb3203d4da8c', 'request_id': 'req-0a875eca-659a-4f95-99eb-e02517ea0e73'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:49.820069 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0a875eca-659a-4f95-99eb-e02517ea0e73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4174c22f6eda4a5d934acb3203d4da8c', 'request_id': 'req-0a875eca-659a-4f95-99eb-e02517ea0e73'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:49.827899 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0a875eca-659a-4f95-99eb-e02517ea0e73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4174c22f6eda4a5d934acb3203d4da8c', 'request_id': 'req-0a875eca-659a-4f95-99eb-e02517ea0e73'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:49.840180 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0a875eca-659a-4f95-99eb-e02517ea0e73 admin admin] The token cache is being invalidate because project 4174c22f6eda4a5d934acb3203d4da8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:02:49.840478 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0a875eca-659a-4f95-99eb-e02517ea0e73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:49.841297 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0a875eca-659a-4f95-99eb-e02517ea0e73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:49.842934 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1055/2159] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:02:49 2022] DELETE /identity/v3/projects/4174c22f6eda4a5d934acb3203d4da8c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:49.847439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe099c-51fd-4545-8f45-e54ba410d767 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:49.858289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe099c-51fd-4545-8f45-e54ba410d767 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:49.915514 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77251d50-7d1e-45a0-8214-78964f443107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:49.916397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77251d50-7d1e-45a0-8214-78964f443107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:49.916716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77251d50-7d1e-45a0-8214-78964f443107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:49.916996 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77251d50-7d1e-45a0-8214-78964f443107 admin admin] PATH_INFO: `/v3/users/4ecf8cb558384c529ccac9802b251829` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:49.918181 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77251d50-7d1e-45a0-8214-78964f443107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ecf8cb558384c529ccac9802b251829)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:49.920496 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77251d50-7d1e-45a0-8214-78964f443107 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:50.156773 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-77251d50-7d1e-45a0-8214-78964f443107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ecf8cb558384c529ccac9802b251829'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:50.167445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-77251d50-7d1e-45a0-8214-78964f443107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ecf8cb558384c529ccac9802b251829'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:50.168392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-77251d50-7d1e-45a0-8214-78964f443107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ecf8cb558384c529ccac9802b251829'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:50.172428 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-77251d50-7d1e-45a0-8214-78964f443107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ecf8cb558384c529ccac9802b251829'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:50.181992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-77251d50-7d1e-45a0-8214-78964f443107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ecf8cb558384c529ccac9802b251829'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:50.282995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1105/2160] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:02:49 2022] DELETE /identity/v3/users/4ecf8cb558384c529ccac9802b251829 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:50.747943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a875eca-659a-4f95-99eb-e02517ea0e73 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:50.749407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0a875eca-659a-4f95-99eb-e02517ea0e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:50.769342 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a875eca-659a-4f95-99eb-e02517ea0e73 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:50.842537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736d3d6-afdc-455f-a224-f7584bdc9412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:50.843410 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736d3d6-afdc-455f-a224-f7584bdc9412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:50.843699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736d3d6-afdc-455f-a224-f7584bdc9412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:50.843989 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736d3d6-afdc-455f-a224-f7584bdc9412 admin admin] PATH_INFO: `/v3/projects/538d59fd262a43eab671fc00527dc7f7` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:50.846478 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736d3d6-afdc-455f-a224-f7584bdc9412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=538d59fd262a43eab671fc00527dc7f7)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:50.849529 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736d3d6-afdc-455f-a224-f7584bdc9412 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:51.017144 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6736d3d6-afdc-455f-a224-f7584bdc9412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538d59fd262a43eab671fc00527dc7f7', 'request_id': 'req-6736d3d6-afdc-455f-a224-f7584bdc9412'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:51.082984 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6736d3d6-afdc-455f-a224-f7584bdc9412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538d59fd262a43eab671fc00527dc7f7', 'request_id': 'req-6736d3d6-afdc-455f-a224-f7584bdc9412'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:51.089810 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6736d3d6-afdc-455f-a224-f7584bdc9412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538d59fd262a43eab671fc00527dc7f7', 'request_id': 'req-6736d3d6-afdc-455f-a224-f7584bdc9412'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:51.100402 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6736d3d6-afdc-455f-a224-f7584bdc9412 admin admin] The token cache is being invalidate because project 538d59fd262a43eab671fc00527dc7f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:02:51.100721 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6736d3d6-afdc-455f-a224-f7584bdc9412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:51.101393 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6736d3d6-afdc-455f-a224-f7584bdc9412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:51.103237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1056/2161] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:02:50 2022] DELETE /identity/v3/projects/538d59fd262a43eab671fc00527dc7f7 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:02:51.107407 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77251d50-7d1e-45a0-8214-78964f443107 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:51.108854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-77251d50-7d1e-45a0-8214-78964f443107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:51.122849 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77251d50-7d1e-45a0-8214-78964f443107 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:51.184293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8c02e-8b46-4eac-b297-624214e56b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:51.185423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8c02e-8b46-4eac-b297-624214e56b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:51.185836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8c02e-8b46-4eac-b297-624214e56b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:51.186218 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8c02e-8b46-4eac-b297-624214e56b63 admin admin] PATH_INFO: `/v3/users/e50367aadd6f4429813e44b50eed2043` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:51.187566 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8c02e-8b46-4eac-b297-624214e56b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e50367aadd6f4429813e44b50eed2043)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:51.189676 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8c02e-8b46-4eac-b297-624214e56b63 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:51.192055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:51.365388 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-7cd8c02e-8b46-4eac-b297-624214e56b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e50367aadd6f4429813e44b50eed2043'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:51.372505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-7cd8c02e-8b46-4eac-b297-624214e56b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e50367aadd6f4429813e44b50eed2043'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:51.373254 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-7cd8c02e-8b46-4eac-b297-624214e56b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e50367aadd6f4429813e44b50eed2043'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:51.373880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-7cd8c02e-8b46-4eac-b297-624214e56b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e50367aadd6f4429813e44b50eed2043'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:51.386267 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-7cd8c02e-8b46-4eac-b297-624214e56b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e50367aadd6f4429813e44b50eed2043'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:51.471515 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1106/2162] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:02:51 2022] DELETE /identity/v3/users/e50367aadd6f4429813e44b50eed2043 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:52.016082 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736d3d6-afdc-455f-a224-f7584bdc9412 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:52.017820 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6736d3d6-afdc-455f-a224-f7584bdc9412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:52.052566 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736d3d6-afdc-455f-a224-f7584bdc9412 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:52.102573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:52.120785 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c4629-4755-4740-b05e-c37782f71095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:52.121654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c4629-4755-4740-b05e-c37782f71095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:52.121939 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c4629-4755-4740-b05e-c37782f71095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:52.122223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c4629-4755-4740-b05e-c37782f71095 admin admin] PATH_INFO: `/v3/projects/9f39527720044243b399846c99dfcbb7` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:52.123448 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c4629-4755-4740-b05e-c37782f71095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f39527720044243b399846c99dfcbb7)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:52.125399 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c4629-4755-4740-b05e-c37782f71095 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:52.237656 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c77c4629-4755-4740-b05e-c37782f71095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f39527720044243b399846c99dfcbb7', 'request_id': 'req-c77c4629-4755-4740-b05e-c37782f71095'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:52.294406 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c77c4629-4755-4740-b05e-c37782f71095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f39527720044243b399846c99dfcbb7', 'request_id': 'req-c77c4629-4755-4740-b05e-c37782f71095'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:52.301278 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c77c4629-4755-4740-b05e-c37782f71095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f39527720044243b399846c99dfcbb7', 'request_id': 'req-c77c4629-4755-4740-b05e-c37782f71095'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:52.311754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c77c4629-4755-4740-b05e-c37782f71095 admin admin] The token cache is being invalidate because project 9f39527720044243b399846c99dfcbb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:02:52.312038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c77c4629-4755-4740-b05e-c37782f71095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:52.312711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c77c4629-4755-4740-b05e-c37782f71095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:52.314303 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1057/2163] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:02:52 2022] DELETE /identity/v3/projects/9f39527720044243b399846c99dfcbb7 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:52.319225 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c5458-2a7a-4ce5-b8f7-d7588db49265 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:52.319702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c5458-2a7a-4ce5-b8f7-d7588db49265 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:52.319790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c5458-2a7a-4ce5-b8f7-d7588db49265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:52.338773 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-276c5458-2a7a-4ce5-b8f7-d7588db49265 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:52.339944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-276c5458-2a7a-4ce5-b8f7-d7588db49265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:52.400904 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1107/2164] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:52.409695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d04d2-65e7-4847-8429-f3461d15523b None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:52.409990 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d04d2-65e7-4847-8429-f3461d15523b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:52.410271 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d04d2-65e7-4847-8429-f3461d15523b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:52.429114 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-a26d04d2-65e7-4847-8429-f3461d15523b None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:52.430322 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a26d04d2-65e7-4847-8429-f3461d15523b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:52.438172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1058/2165] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:52.442413 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c5458-2a7a-4ce5-b8f7-d7588db49265 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:52.452608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c5458-2a7a-4ce5-b8f7-d7588db49265 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:52.457110 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa0562-d2e3-45fc-9e0e-d5a0631bf259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:52.457751 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa0562-d2e3-45fc-9e0e-d5a0631bf259 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:52.459973 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa0562-d2e3-45fc-9e0e-d5a0631bf259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:52.459973 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa0562-d2e3-45fc-9e0e-d5a0631bf259 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:52.459973 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa0562-d2e3-45fc-9e0e-d5a0631bf259 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:02:52.459973 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa0562-d2e3-45fc-9e0e-d5a0631bf259 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:52.460995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa0562-d2e3-45fc-9e0e-d5a0631bf259 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:52.472317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1108/2166] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:02:52.476421 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d04d2-65e7-4847-8429-f3461d15523b None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:52.485947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d04d2-65e7-4847-8429-f3461d15523b None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:52.491268 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fd313-078f-4e0e-a4d7-332d7b5039d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:52.491922 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fd313-078f-4e0e-a4d7-332d7b5039d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:52.493200 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fd313-078f-4e0e-a4d7-332d7b5039d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:52.493200 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fd313-078f-4e0e-a4d7-332d7b5039d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:52.493454 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64fd313-078f-4e0e-a4d7-332d7b5039d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:52.495196 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64fd313-078f-4e0e-a4d7-332d7b5039d4 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:52.593025 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1059/2167] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:02:52 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:52.597170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa0562-d2e3-45fc-9e0e-d5a0631bf259 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:52.607497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa0562-d2e3-45fc-9e0e-d5a0631bf259 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:52.664431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78729e1e-f63d-4df0-b990-55c56f105c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:52.665136 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78729e1e-f63d-4df0-b990-55c56f105c79 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:52.665422 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78729e1e-f63d-4df0-b990-55c56f105c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:52.665700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78729e1e-f63d-4df0-b990-55c56f105c79 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:52.666401 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78729e1e-f63d-4df0-b990-55c56f105c79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:52.668340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78729e1e-f63d-4df0-b990-55c56f105c79 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:52.752114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:52.758675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1109/2168] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:02:52 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:52.763210 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fd313-078f-4e0e-a4d7-332d7b5039d4 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:52.774323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fd313-078f-4e0e-a4d7-332d7b5039d4 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:52.786804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6527c-91a9-40ee-b855-f0650a89e393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:52.788128 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6527c-91a9-40ee-b855-f0650a89e393 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:52.788416 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6527c-91a9-40ee-b855-f0650a89e393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:52.788738 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6527c-91a9-40ee-b855-f0650a89e393 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:52.789575 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6527c-91a9-40ee-b855-f0650a89e393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:52.791177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6527c-91a9-40ee-b855-f0650a89e393 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:52.802317 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1060/2169] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:02:52.808980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78729e1e-f63d-4df0-b990-55c56f105c79 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:52.819656 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78729e1e-f63d-4df0-b990-55c56f105c79 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:52.824608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5a1de-a6d7-4fca-9e15-144e0c27e924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:52.825516 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5a1de-a6d7-4fca-9e15-144e0c27e924 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:52.825976 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5a1de-a6d7-4fca-9e15-144e0c27e924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:52.826644 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5a1de-a6d7-4fca-9e15-144e0c27e924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:52.827437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5a1de-a6d7-4fca-9e15-144e0c27e924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:52.829116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5a1de-a6d7-4fca-9e15-144e0c27e924 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:52.839697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1110/2170] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:52.843855 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6527c-91a9-40ee-b855-f0650a89e393 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:52.854817 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6527c-91a9-40ee-b855-f0650a89e393 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:52.859539 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697566b-19f6-4fbf-b328-8efb28f63c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:52.860449 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697566b-19f6-4fbf-b328-8efb28f63c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:52.860751 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697566b-19f6-4fbf-b328-8efb28f63c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:52.863445 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697566b-19f6-4fbf-b328-8efb28f63c8c admin admin] PATH_INFO: `/v3/projects/380379df1d7e4ebe90c75bcefecbc787/users/e4a4bd26db664e44850f5ebccd838315/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:52.878049 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697566b-19f6-4fbf-b328-8efb28f63c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=380379df1d7e4ebe90c75bcefecbc787, user_id=e4a4bd26db664e44850f5ebccd838315, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:52.881077 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697566b-19f6-4fbf-b328-8efb28f63c8c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:53.006814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1061/2171] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:52 2022] PUT /identity/v3/projects/380379df1d7e4ebe90c75bcefecbc787/users/e4a4bd26db664e44850f5ebccd838315/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:53.012131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16997b-7ee3-42aa-8d16-d3bcaa91fea5 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:53.012565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16997b-7ee3-42aa-8d16-d3bcaa91fea5 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:53.012921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16997b-7ee3-42aa-8d16-d3bcaa91fea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:53.031468 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-5e16997b-7ee3-42aa-8d16-d3bcaa91fea5 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:53.032803 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5e16997b-7ee3-42aa-8d16-d3bcaa91fea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:53.097049 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1111/2172] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:53.106360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697566b-19f6-4fbf-b328-8efb28f63c8c admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:53.108636 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d697566b-19f6-4fbf-b328-8efb28f63c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:53.168969 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697566b-19f6-4fbf-b328-8efb28f63c8c admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:53.172768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d3deb-85be-40ad-b407-18090363c48f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:53.173482 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d3deb-85be-40ad-b407-18090363c48f service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:53.173754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d3deb-85be-40ad-b407-18090363c48f service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:53.174036 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d3deb-85be-40ad-b407-18090363c48f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:53.183291 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d3deb-85be-40ad-b407-18090363c48f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:53.184809 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d3deb-85be-40ad-b407-18090363c48f service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:53.194739 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1062/2173] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:54.283984 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16997b-7ee3-42aa-8d16-d3bcaa91fea5 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:54.285578 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5e16997b-7ee3-42aa-8d16-d3bcaa91fea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:54.304308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16997b-7ee3-42aa-8d16-d3bcaa91fea5 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:54.313319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fc73d-67dd-496d-9e2c-42120ba012cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:54.320762 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fc73d-67dd-496d-9e2c-42120ba012cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:54.320762 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fc73d-67dd-496d-9e2c-42120ba012cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:54.320762 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fc73d-67dd-496d-9e2c-42120ba012cb admin admin] PATH_INFO: `/v3/users/ea0add3a744a4dffb3797835bbe9acf7` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:54.322142 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fc73d-67dd-496d-9e2c-42120ba012cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea0add3a744a4dffb3797835bbe9acf7)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:54.324671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fc73d-67dd-496d-9e2c-42120ba012cb admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:54.549333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-409fc73d-67dd-496d-9e2c-42120ba012cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea0add3a744a4dffb3797835bbe9acf7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:54.565435 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8b8a0-9157-47fb-ad81-68d335753285 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:54.566367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8b8a0-9157-47fb-ad81-68d335753285 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:54.566649 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8b8a0-9157-47fb-ad81-68d335753285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:54.574006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:54.587522 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-409fc73d-67dd-496d-9e2c-42120ba012cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea0add3a744a4dffb3797835bbe9acf7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:54.588528 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-409fc73d-67dd-496d-9e2c-42120ba012cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea0add3a744a4dffb3797835bbe9acf7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:54.589178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-409fc73d-67dd-496d-9e2c-42120ba012cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea0add3a744a4dffb3797835bbe9acf7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:54.601361 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-34e8b8a0-9157-47fb-ad81-68d335753285 None None] MFA Rules not processed for user `e4a4bd26db664e44850f5ebccd838315`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:54.604202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-34e8b8a0-9157-47fb-ad81-68d335753285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:54.606962 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-409fc73d-67dd-496d-9e2c-42120ba012cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea0add3a744a4dffb3797835bbe9acf7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:54.680147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1063/2174] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:54.757939 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1112/2175] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:02:54 2022] DELETE /identity/v3/users/ea0add3a744a4dffb3797835bbe9acf7 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:02:54.762538 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb709a7-44a9-4569-9ca0-9a0a9b076d3f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:54.762835 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb709a7-44a9-4569-9ca0-9a0a9b076d3f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:54.763122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb709a7-44a9-4569-9ca0-9a0a9b076d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:54.782016 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-0fb709a7-44a9-4569-9ca0-9a0a9b076d3f None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:54.783459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0fb709a7-44a9-4569-9ca0-9a0a9b076d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:54.850068 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1064/2176] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:54.857245 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fc73d-67dd-496d-9e2c-42120ba012cb admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:54.858821 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-409fc73d-67dd-496d-9e2c-42120ba012cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:54.916372 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fc73d-67dd-496d-9e2c-42120ba012cb admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:54.919942 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90563d71-3d09-41a3-97c1-45bd41b00a0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:54.920669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90563d71-3d09-41a3-97c1-45bd41b00a0a service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:54.920923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90563d71-3d09-41a3-97c1-45bd41b00a0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:54.921205 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90563d71-3d09-41a3-97c1-45bd41b00a0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:54.930858 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90563d71-3d09-41a3-97c1-45bd41b00a0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:54.932297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90563d71-3d09-41a3-97c1-45bd41b00a0a service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:54.941717 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1113/2177] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:55.327675 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb709a7-44a9-4569-9ca0-9a0a9b076d3f None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:55.335374 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0fb709a7-44a9-4569-9ca0-9a0a9b076d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:55.398952 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb709a7-44a9-4569-9ca0-9a0a9b076d3f None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:55.402667 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298007af-266e-423a-acd4-2144b5e3df08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:55.403306 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298007af-266e-423a-acd4-2144b5e3df08 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:55.403645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298007af-266e-423a-acd4-2144b5e3df08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:55.403897 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298007af-266e-423a-acd4-2144b5e3df08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:55.451432 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90563d71-3d09-41a3-97c1-45bd41b00a0a service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:55.453196 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-90563d71-3d09-41a3-97c1-45bd41b00a0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:55.457973 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:55.467448 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:55.469228 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298007af-266e-423a-acd4-2144b5e3df08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:55.471201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298007af-266e-423a-acd4-2144b5e3df08 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:55.478573 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90563d71-3d09-41a3-97c1-45bd41b00a0a service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:55.485298 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e571471-ee18-44df-95b2-f825c194ced4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:55.486574 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e571471-ee18-44df-95b2-f825c194ced4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:55.487042 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e571471-ee18-44df-95b2-f825c194ced4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:55.487471 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e571471-ee18-44df-95b2-f825c194ced4 admin admin] PATH_INFO: `/v3/projects/01318f20bd1e4dcf9d4fc5c8a4d34a68` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:55.495359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1065/2178] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:55.500240 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e571471-ee18-44df-95b2-f825c194ced4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01318f20bd1e4dcf9d4fc5c8a4d34a68)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:55.502602 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e571471-ee18-44df-95b2-f825c194ced4 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:55.655733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1e571471-ee18-44df-95b2-f825c194ced4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01318f20bd1e4dcf9d4fc5c8a4d34a68', 'request_id': 'req-1e571471-ee18-44df-95b2-f825c194ced4'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:55.662463 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1e571471-ee18-44df-95b2-f825c194ced4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01318f20bd1e4dcf9d4fc5c8a4d34a68', 'request_id': 'req-1e571471-ee18-44df-95b2-f825c194ced4'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:55.669386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1e571471-ee18-44df-95b2-f825c194ced4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01318f20bd1e4dcf9d4fc5c8a4d34a68', 'request_id': 'req-1e571471-ee18-44df-95b2-f825c194ced4'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:55.751988 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1e571471-ee18-44df-95b2-f825c194ced4 admin admin] The token cache is being invalidate because project 01318f20bd1e4dcf9d4fc5c8a4d34a68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:02:55.752291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1e571471-ee18-44df-95b2-f825c194ced4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:55.752950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1e571471-ee18-44df-95b2-f825c194ced4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:55.754504 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1114/2179] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:02:55 2022] DELETE /identity/v3/projects/01318f20bd1e4dcf9d4fc5c8a4d34a68 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:55.758626 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298007af-266e-423a-acd4-2144b5e3df08 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:55.769360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298007af-266e-423a-acd4-2144b5e3df08 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:55.827083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e359909-e618-4e4e-ab9c-4ed16d5ce09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:55.827951 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e359909-e618-4e4e-ab9c-4ed16d5ce09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:55.828236 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e359909-e618-4e4e-ab9c-4ed16d5ce09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:55.828542 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e359909-e618-4e4e-ab9c-4ed16d5ce09a admin admin] PATH_INFO: `/v3/users/1bedc05b02a149559c4065316e390dad` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:55.829755 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e359909-e618-4e4e-ab9c-4ed16d5ce09a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bedc05b02a149559c4065316e390dad)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:55.831679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e359909-e618-4e4e-ab9c-4ed16d5ce09a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:56.057476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6e359909-e618-4e4e-ab9c-4ed16d5ce09a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bedc05b02a149559c4065316e390dad'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:56.064905 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6e359909-e618-4e4e-ab9c-4ed16d5ce09a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bedc05b02a149559c4065316e390dad'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:56.065614 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6e359909-e618-4e4e-ab9c-4ed16d5ce09a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bedc05b02a149559c4065316e390dad'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:56.066231 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6e359909-e618-4e4e-ab9c-4ed16d5ce09a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bedc05b02a149559c4065316e390dad'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:56.078640 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6e359909-e618-4e4e-ab9c-4ed16d5ce09a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bedc05b02a149559c4065316e390dad'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:56.191389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1066/2180] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:02:55 2022] DELETE /identity/v3/users/1bedc05b02a149559c4065316e390dad => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:56.680024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e571471-ee18-44df-95b2-f825c194ced4 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:56.681552 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1e571471-ee18-44df-95b2-f825c194ced4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:56.702225 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e571471-ee18-44df-95b2-f825c194ced4 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:56.770765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bb1bc-55a2-40bc-921d-649bf12f3b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:56.772255 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bb1bc-55a2-40bc-921d-649bf12f3b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:56.772474 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bb1bc-55a2-40bc-921d-649bf12f3b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:56.772793 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bb1bc-55a2-40bc-921d-649bf12f3b34 admin admin] PATH_INFO: `/v3/projects/0327bc773f8b46d8ba9cc6bf918bcaba` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:56.774096 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bb1bc-55a2-40bc-921d-649bf12f3b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0327bc773f8b46d8ba9cc6bf918bcaba)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:56.776054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bb1bc-55a2-40bc-921d-649bf12f3b34 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:56.981708 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f54bb1bc-55a2-40bc-921d-649bf12f3b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0327bc773f8b46d8ba9cc6bf918bcaba', 'request_id': 'req-f54bb1bc-55a2-40bc-921d-649bf12f3b34'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:56.987708 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f54bb1bc-55a2-40bc-921d-649bf12f3b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0327bc773f8b46d8ba9cc6bf918bcaba', 'request_id': 'req-f54bb1bc-55a2-40bc-921d-649bf12f3b34'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:56.997545 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f54bb1bc-55a2-40bc-921d-649bf12f3b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0327bc773f8b46d8ba9cc6bf918bcaba', 'request_id': 'req-f54bb1bc-55a2-40bc-921d-649bf12f3b34'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:57.096376 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f54bb1bc-55a2-40bc-921d-649bf12f3b34 admin admin] The token cache is being invalidate because project 0327bc773f8b46d8ba9cc6bf918bcaba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:02:57.096878 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f54bb1bc-55a2-40bc-921d-649bf12f3b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:57.113191 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f54bb1bc-55a2-40bc-921d-649bf12f3b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:57.115813 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1115/2181] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:02:56 2022] DELETE /identity/v3/projects/0327bc773f8b46d8ba9cc6bf918bcaba => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:57.120755 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910ab18-a213-4ba4-9d37-02c6770b460b None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:57.121224 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910ab18-a213-4ba4-9d37-02c6770b460b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:57.121447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910ab18-a213-4ba4-9d37-02c6770b460b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:57.146543 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-6910ab18-a213-4ba4-9d37-02c6770b460b None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:57.148140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6910ab18-a213-4ba4-9d37-02c6770b460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:57.218834 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1067/2182] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:57.227322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dbfb7-34dd-4520-8d9f-d0f7602da57f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:57.227746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dbfb7-34dd-4520-8d9f-d0f7602da57f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:57.228127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dbfb7-34dd-4520-8d9f-d0f7602da57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:57.258177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-1c2dbfb7-34dd-4520-8d9f-d0f7602da57f None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:57.262007 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1c2dbfb7-34dd-4520-8d9f-d0f7602da57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:57.288269 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1116/2183] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:57.292528 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910ab18-a213-4ba4-9d37-02c6770b460b None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:57.302846 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910ab18-a213-4ba4-9d37-02c6770b460b None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:57.307844 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940655a5-285c-4efa-87e1-34dbebd1e6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:57.308517 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940655a5-285c-4efa-87e1-34dbebd1e6cf admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:57.308882 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940655a5-285c-4efa-87e1-34dbebd1e6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:57.309171 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940655a5-285c-4efa-87e1-34dbebd1e6cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:57.310219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940655a5-285c-4efa-87e1-34dbebd1e6cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:02:57.310534 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940655a5-285c-4efa-87e1-34dbebd1e6cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:57.312152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940655a5-285c-4efa-87e1-34dbebd1e6cf admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:57.315358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:57.326194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1068/2184] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:02:57.331511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2dbfb7-34dd-4520-8d9f-d0f7602da57f None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:57.353312 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2dbfb7-34dd-4520-8d9f-d0f7602da57f None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:57.358318 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107619e-39fe-4717-ae24-f6552aa800cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:57.358987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107619e-39fe-4717-ae24-f6552aa800cd admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:57.359268 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107619e-39fe-4717-ae24-f6552aa800cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:57.359544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107619e-39fe-4717-ae24-f6552aa800cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:57.360295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107619e-39fe-4717-ae24-f6552aa800cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:57.362345 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107619e-39fe-4717-ae24-f6552aa800cd admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:57.367019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:57.408166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4b326-580a-4280-9b1a-fec9c399e4e3 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:57.408524 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4b326-580a-4280-9b1a-fec9c399e4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:57.408975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4b326-580a-4280-9b1a-fec9c399e4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:57.428843 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-47d4b326-580a-4280-9b1a-fec9c399e4e3 None None] MFA Rules not processed for user `e4a4bd26db664e44850f5ebccd838315`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:57.430149 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-47d4b326-580a-4280-9b1a-fec9c399e4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:57.482350 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1117/2185] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:02:57 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:02:57.493463 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107619e-39fe-4717-ae24-f6552aa800cd admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:57.528121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1069/2186] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:02:57.608889 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107619e-39fe-4717-ae24-f6552aa800cd admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:57.616018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ad6f7-c7f1-44a9-bcfd-3984cee522f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:57.616765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ad6f7-c7f1-44a9-bcfd-3984cee522f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:57.617059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ad6f7-c7f1-44a9-bcfd-3984cee522f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:57.617361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ad6f7-c7f1-44a9-bcfd-3984cee522f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:57.618072 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ad6f7-c7f1-44a9-bcfd-3984cee522f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:57.621053 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ad6f7-c7f1-44a9-bcfd-3984cee522f7 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:57.744099 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1118/2187] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:02:57 2022] POST /identity/v3/users => generated 287 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:02:57.745359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4b326-580a-4280-9b1a-fec9c399e4e3 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:57.760291 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4b326-580a-4280-9b1a-fec9c399e4e3 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:57.765583 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6deba0-a4b0-4572-bf2d-1197e9bad0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:57.766267 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6deba0-a4b0-4572-bf2d-1197e9bad0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:57.766572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6deba0-a4b0-4572-bf2d-1197e9bad0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:57.766917 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6deba0-a4b0-4572-bf2d-1197e9bad0c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:57.774411 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6deba0-a4b0-4572-bf2d-1197e9bad0c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:57.776267 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6deba0-a4b0-4572-bf2d-1197e9bad0c7 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:57.792902 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1070/2188] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:02:57.793667 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ad6f7-c7f1-44a9-bcfd-3984cee522f7 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:57.807077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ad6f7-c7f1-44a9-bcfd-3984cee522f7 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:57.811963 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec8483-5a94-42ee-aa94-9fe8dd341b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:57.812968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec8483-5a94-42ee-aa94-9fe8dd341b59 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:57.813257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec8483-5a94-42ee-aa94-9fe8dd341b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:57.813538 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec8483-5a94-42ee-aa94-9fe8dd341b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:57.814281 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec8483-5a94-42ee-aa94-9fe8dd341b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:57.815900 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec8483-5a94-42ee-aa94-9fe8dd341b59 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:57.830377 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1119/2189] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:02:57.831570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6deba0-a4b0-4572-bf2d-1197e9bad0c7 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:57.848032 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6deba0-a4b0-4572-bf2d-1197e9bad0c7 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:57.853275 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b1789-8e0f-4f99-b077-370d9efaae25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:57.854182 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b1789-8e0f-4f99-b077-370d9efaae25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:57.854694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b1789-8e0f-4f99-b077-370d9efaae25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:57.855167 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b1789-8e0f-4f99-b077-370d9efaae25 admin admin] PATH_INFO: `/v3/projects/05f70d1fa35745a6b354f6e7865becaa/users/deecf6a816214046b38d0d73ac06bc41/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:57.875235 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b1789-8e0f-4f99-b077-370d9efaae25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f70d1fa35745a6b354f6e7865becaa, user_id=deecf6a816214046b38d0d73ac06bc41, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:57.878167 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b1789-8e0f-4f99-b077-370d9efaae25 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:58.009629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1071/2190] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:02:57 2022] PUT /identity/v3/projects/05f70d1fa35745a6b354f6e7865becaa/users/deecf6a816214046b38d0d73ac06bc41/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:58.019464 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83249f12-fcbf-4e53-b0be-97aae306ffc3 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:58.019804 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83249f12-fcbf-4e53-b0be-97aae306ffc3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:58.020084 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83249f12-fcbf-4e53-b0be-97aae306ffc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:58.047181 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-83249f12-fcbf-4e53-b0be-97aae306ffc3 None None] MFA Rules not processed for user `deecf6a816214046b38d0d73ac06bc41`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:58.048384 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-83249f12-fcbf-4e53-b0be-97aae306ffc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:58.111468 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1120/2191] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:02:58.782534 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b1789-8e0f-4f99-b077-370d9efaae25 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:58.784216 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-026b1789-8e0f-4f99-b077-370d9efaae25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:58.842335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b1789-8e0f-4f99-b077-370d9efaae25 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:58.845945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7719c33-ee4d-4237-ad6e-e0acbdb9334b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:58.846588 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7719c33-ee4d-4237-ad6e-e0acbdb9334b service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:58.846878 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7719c33-ee4d-4237-ad6e-e0acbdb9334b service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:58.847161 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7719c33-ee4d-4237-ad6e-e0acbdb9334b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:58.856413 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7719c33-ee4d-4237-ad6e-e0acbdb9334b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:58.857889 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7719c33-ee4d-4237-ad6e-e0acbdb9334b service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:58.867132 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1072/2192] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:02:58.886496 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83249f12-fcbf-4e53-b0be-97aae306ffc3 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:58.984331 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:02:58.984331 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83249f12-fcbf-4e53-b0be-97aae306ffc3 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:58.992392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2f160-ca7c-4337-b596-d92b45b3c683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:58.993907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2f160-ca7c-4337-b596-d92b45b3c683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:58.994423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2f160-ca7c-4337-b596-d92b45b3c683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:58.995343 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2f160-ca7c-4337-b596-d92b45b3c683 admin admin] PATH_INFO: `/v3/users/deecf6a816214046b38d0d73ac06bc41` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:58.997026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2f160-ca7c-4337-b596-d92b45b3c683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deecf6a816214046b38d0d73ac06bc41)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:58.999702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2f160-ca7c-4337-b596-d92b45b3c683 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:59.245123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-52c2f160-ca7c-4337-b596-d92b45b3c683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deecf6a816214046b38d0d73ac06bc41'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:59.253337 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-52c2f160-ca7c-4337-b596-d92b45b3c683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deecf6a816214046b38d0d73ac06bc41'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:59.254120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-52c2f160-ca7c-4337-b596-d92b45b3c683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deecf6a816214046b38d0d73ac06bc41'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:59.254812 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-52c2f160-ca7c-4337-b596-d92b45b3c683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deecf6a816214046b38d0d73ac06bc41'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:59.269318 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-52c2f160-ca7c-4337-b596-d92b45b3c683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deecf6a816214046b38d0d73ac06bc41'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:02:59.363919 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1121/2193] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:02:58 2022] DELETE /identity/v3/users/deecf6a816214046b38d0d73ac06bc41 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:02:59.369061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850ac54-282f-4c88-9108-be111a243ba7 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:59.369464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850ac54-282f-4c88-9108-be111a243ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:59.369932 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850ac54-282f-4c88-9108-be111a243ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:59.389613 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-4850ac54-282f-4c88-9108-be111a243ba7 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:02:59.390991 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4850ac54-282f-4c88-9108-be111a243ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:59.462333 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1073/2194] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:02:59.479582 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2f160-ca7c-4337-b596-d92b45b3c683 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:02:59.482052 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-52c2f160-ca7c-4337-b596-d92b45b3c683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:02:59.580047 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2f160-ca7c-4337-b596-d92b45b3c683 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:02:59.580047 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4bf331-d737-4648-9ea1-a53c25271e7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:02:59.580461 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bf331-d737-4648-9ea1-a53c25271e7b service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:02:59.581048 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bf331-d737-4648-9ea1-a53c25271e7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:02:59.581335 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bf331-d737-4648-9ea1-a53c25271e7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:02:59.592915 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4bf331-d737-4648-9ea1-a53c25271e7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:02:59.594381 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4bf331-d737-4648-9ea1-a53c25271e7b service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:02:59.605039 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1122/2195] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:02:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:03:00.090756 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850ac54-282f-4c88-9108-be111a243ba7 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:00.092181 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4850ac54-282f-4c88-9108-be111a243ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:00.104883 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850ac54-282f-4c88-9108-be111a243ba7 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:00.109618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa0ca9-fddd-435f-afc4-9db68c6e67b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:00.110594 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa0ca9-fddd-435f-afc4-9db68c6e67b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:00.110879 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa0ca9-fddd-435f-afc4-9db68c6e67b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:00.111210 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa0ca9-fddd-435f-afc4-9db68c6e67b6 admin admin] PATH_INFO: `/v3/projects/05f70d1fa35745a6b354f6e7865becaa` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:00.112465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa0ca9-fddd-435f-afc4-9db68c6e67b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f70d1fa35745a6b354f6e7865becaa)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:00.114432 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa0ca9-fddd-435f-afc4-9db68c6e67b6 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:00.117852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:00.234293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-91fa0ca9-fddd-435f-afc4-9db68c6e67b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f70d1fa35745a6b354f6e7865becaa', 'request_id': 'req-91fa0ca9-fddd-435f-afc4-9db68c6e67b6'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:00.282911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-91fa0ca9-fddd-435f-afc4-9db68c6e67b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f70d1fa35745a6b354f6e7865becaa', 'request_id': 'req-91fa0ca9-fddd-435f-afc4-9db68c6e67b6'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:00.289871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-91fa0ca9-fddd-435f-afc4-9db68c6e67b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f70d1fa35745a6b354f6e7865becaa', 'request_id': 'req-91fa0ca9-fddd-435f-afc4-9db68c6e67b6'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:00.300684 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-91fa0ca9-fddd-435f-afc4-9db68c6e67b6 admin admin] The token cache is being invalidate because project 05f70d1fa35745a6b354f6e7865becaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:03:00.300976 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-91fa0ca9-fddd-435f-afc4-9db68c6e67b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:00.301751 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-91fa0ca9-fddd-435f-afc4-9db68c6e67b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:00.303229 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1074/2196] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:03:00 2022] DELETE /identity/v3/projects/05f70d1fa35745a6b354f6e7865becaa => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:03:00.308307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe3e2b-82aa-4baa-852c-98ad4b519bec None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:00.308830 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe3e2b-82aa-4baa-852c-98ad4b519bec None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:00.308918 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe3e2b-82aa-4baa-852c-98ad4b519bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:00.327113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-2ebe3e2b-82aa-4baa-852c-98ad4b519bec None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:00.328339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2ebe3e2b-82aa-4baa-852c-98ad4b519bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:00.392795 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1123/2197] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:00.402049 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eacef3-6525-4262-a7f0-967502cb9f45 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:00.402568 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eacef3-6525-4262-a7f0-967502cb9f45 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:00.402858 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eacef3-6525-4262-a7f0-967502cb9f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:00.423540 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-04eacef3-6525-4262-a7f0-967502cb9f45 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:00.436884 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-04eacef3-6525-4262-a7f0-967502cb9f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:00.448124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1075/2198] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:00.452373 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe3e2b-82aa-4baa-852c-98ad4b519bec None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:00.462733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe3e2b-82aa-4baa-852c-98ad4b519bec None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:00.467309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801fc3d-d3cc-4a50-b4d5-62f3ba6e745b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:00.467966 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801fc3d-d3cc-4a50-b4d5-62f3ba6e745b admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:00.468317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801fc3d-d3cc-4a50-b4d5-62f3ba6e745b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:00.468533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801fc3d-d3cc-4a50-b4d5-62f3ba6e745b admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:00.469303 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801fc3d-d3cc-4a50-b4d5-62f3ba6e745b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:03:00.469613 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801fc3d-d3cc-4a50-b4d5-62f3ba6e745b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:00.471229 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801fc3d-d3cc-4a50-b4d5-62f3ba6e745b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:00.483021 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1124/2199] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:03:00.487265 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eacef3-6525-4262-a7f0-967502cb9f45 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:00.497532 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eacef3-6525-4262-a7f0-967502cb9f45 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:00.502282 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfbc81-6658-406b-8657-c22762a479e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:00.502928 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfbc81-6658-406b-8657-c22762a479e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:00.503209 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfbc81-6658-406b-8657-c22762a479e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:00.503482 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfbc81-6658-406b-8657-c22762a479e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:00.504178 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfbc81-6658-406b-8657-c22762a479e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:00.506781 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfbc81-6658-406b-8657-c22762a479e1 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:00.616416 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1076/2200] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:03:00 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:03:00.621676 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801fc3d-d3cc-4a50-b4d5-62f3ba6e745b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:00.628499 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:00.632473 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801fc3d-d3cc-4a50-b4d5-62f3ba6e745b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:00.694743 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1951b8-db0a-4273-a2c0-8e6316c79fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:00.695585 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1951b8-db0a-4273-a2c0-8e6316c79fba admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:00.696247 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1951b8-db0a-4273-a2c0-8e6316c79fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:00.696742 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1951b8-db0a-4273-a2c0-8e6316c79fba admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:00.697435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1951b8-db0a-4273-a2c0-8e6316c79fba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:00.699459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1951b8-db0a-4273-a2c0-8e6316c79fba admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:00.809207 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1125/2201] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:03:00 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:03:00.813549 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfbc81-6658-406b-8657-c22762a479e1 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:00.824035 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfbc81-6658-406b-8657-c22762a479e1 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:00.828606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2442e73-9669-469d-84e3-618cf24c2433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:00.829319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2442e73-9669-469d-84e3-618cf24c2433 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:00.829636 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2442e73-9669-469d-84e3-618cf24c2433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:00.829925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2442e73-9669-469d-84e3-618cf24c2433 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:00.830795 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2442e73-9669-469d-84e3-618cf24c2433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:00.834687 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2442e73-9669-469d-84e3-618cf24c2433 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:00.844078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1077/2202] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:03:00.848031 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1951b8-db0a-4273-a2c0-8e6316c79fba admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:00.860648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1951b8-db0a-4273-a2c0-8e6316c79fba admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:00.864544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a414a-765e-4b78-af41-403a93388548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:00.865802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a414a-765e-4b78-af41-403a93388548 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:00.866085 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a414a-765e-4b78-af41-403a93388548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:00.866363 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a414a-765e-4b78-af41-403a93388548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:00.867095 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a414a-765e-4b78-af41-403a93388548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:00.868751 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a414a-765e-4b78-af41-403a93388548 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:00.878769 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1126/2203] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:03:00.883466 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2442e73-9669-469d-84e3-618cf24c2433 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:00.894000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2442e73-9669-469d-84e3-618cf24c2433 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:00.898671 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98482160-cdd1-407b-bc7d-9fe59ca1bb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:00.899608 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98482160-cdd1-407b-bc7d-9fe59ca1bb1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:00.899897 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98482160-cdd1-407b-bc7d-9fe59ca1bb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:00.900200 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98482160-cdd1-407b-bc7d-9fe59ca1bb1f admin admin] PATH_INFO: `/v3/projects/915f9b8a873e4b26b855577d0f6ddb3d/users/4170a22825f8448ebe486c28606ab001/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:00.915674 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98482160-cdd1-407b-bc7d-9fe59ca1bb1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=915f9b8a873e4b26b855577d0f6ddb3d, user_id=4170a22825f8448ebe486c28606ab001, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:00.918399 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98482160-cdd1-407b-bc7d-9fe59ca1bb1f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:01.003837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1078/2204] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:03:00 2022] PUT /identity/v3/projects/915f9b8a873e4b26b855577d0f6ddb3d/users/4170a22825f8448ebe486c28606ab001/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:03:01.015994 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22989f-a131-4b5c-886e-b9ad21f9a009 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:01.016294 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22989f-a131-4b5c-886e-b9ad21f9a009 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:01.016574 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22989f-a131-4b5c-886e-b9ad21f9a009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:01.043940 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-aa22989f-a131-4b5c-886e-b9ad21f9a009 None None] MFA Rules not processed for user `4170a22825f8448ebe486c28606ab001`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:01.045497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-aa22989f-a131-4b5c-886e-b9ad21f9a009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:01.117307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1127/2205] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:01.128914 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98482160-cdd1-407b-bc7d-9fe59ca1bb1f admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:01.130824 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-98482160-cdd1-407b-bc7d-9fe59ca1bb1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:01.191580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98482160-cdd1-407b-bc7d-9fe59ca1bb1f admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:01.195468 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb05bd0-9d75-48d1-8abc-f8400113a909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:01.196123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb05bd0-9d75-48d1-8abc-f8400113a909 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:01.196414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb05bd0-9d75-48d1-8abc-f8400113a909 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:01.196734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb05bd0-9d75-48d1-8abc-f8400113a909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:01.205364 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb05bd0-9d75-48d1-8abc-f8400113a909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:01.206957 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb05bd0-9d75-48d1-8abc-f8400113a909 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:01.221548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1079/2206] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:03:05.495983 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22989f-a131-4b5c-886e-b9ad21f9a009 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:05.581539 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22989f-a131-4b5c-886e-b9ad21f9a009 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:05.588367 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f9f6c-d90a-4376-a9af-8e332dc743db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:05.589876 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f9f6c-d90a-4376-a9af-8e332dc743db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:05.590134 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f9f6c-d90a-4376-a9af-8e332dc743db admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:05.590491 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f9f6c-d90a-4376-a9af-8e332dc743db admin admin] PATH_INFO: `/v3/users/4170a22825f8448ebe486c28606ab001` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:05.592818 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f9f6c-d90a-4376-a9af-8e332dc743db admin admin] RBAC: Authorizing `identity:delete_user(user_id=4170a22825f8448ebe486c28606ab001)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:05.595206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f9f6c-d90a-4376-a9af-8e332dc743db admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:05.621090 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:05.805596 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f23f9f6c-d90a-4376-a9af-8e332dc743db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4170a22825f8448ebe486c28606ab001'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:05.817087 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f23f9f6c-d90a-4376-a9af-8e332dc743db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4170a22825f8448ebe486c28606ab001'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:05.818306 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f23f9f6c-d90a-4376-a9af-8e332dc743db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4170a22825f8448ebe486c28606ab001'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:05.819028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f23f9f6c-d90a-4376-a9af-8e332dc743db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4170a22825f8448ebe486c28606ab001'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:05.839541 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f23f9f6c-d90a-4376-a9af-8e332dc743db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4170a22825f8448ebe486c28606ab001'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:05.999098 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1128/2207] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:03:05 2022] DELETE /identity/v3/users/4170a22825f8448ebe486c28606ab001 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:03:06.003687 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96386cef-0580-4828-a60e-4d9d1204098c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:06.006847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96386cef-0580-4828-a60e-4d9d1204098c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:06.006847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96386cef-0580-4828-a60e-4d9d1204098c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:06.024750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-96386cef-0580-4828-a60e-4d9d1204098c None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:06.026487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-96386cef-0580-4828-a60e-4d9d1204098c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:06.060236 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:06.107391 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1080/2208] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:06.119164 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f9f6c-d90a-4376-a9af-8e332dc743db admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:06.119523 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f23f9f6c-d90a-4376-a9af-8e332dc743db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:06.211430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f9f6c-d90a-4376-a9af-8e332dc743db admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:06.216472 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6ddbd-fe12-4a22-a1e1-5423a1abe9d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:06.217174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6ddbd-fe12-4a22-a1e1-5423a1abe9d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:06.217457 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6ddbd-fe12-4a22-a1e1-5423a1abe9d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:06.217737 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6ddbd-fe12-4a22-a1e1-5423a1abe9d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:06.235385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6ddbd-fe12-4a22-a1e1-5423a1abe9d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:06.237015 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6ddbd-fe12-4a22-a1e1-5423a1abe9d7 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:06.248916 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1129/2209] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:03:06.823580 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96386cef-0580-4828-a60e-4d9d1204098c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:06.825272 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-96386cef-0580-4828-a60e-4d9d1204098c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:06.838770 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96386cef-0580-4828-a60e-4d9d1204098c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:06.844384 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31626dcd-9af0-458b-8307-d2142c39dcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:06.846231 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31626dcd-9af0-458b-8307-d2142c39dcc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:06.846518 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31626dcd-9af0-458b-8307-d2142c39dcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:06.847025 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31626dcd-9af0-458b-8307-d2142c39dcc8 admin admin] PATH_INFO: `/v3/projects/915f9b8a873e4b26b855577d0f6ddb3d` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:06.848695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31626dcd-9af0-458b-8307-d2142c39dcc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=915f9b8a873e4b26b855577d0f6ddb3d)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:06.856460 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31626dcd-9af0-458b-8307-d2142c39dcc8 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:06.970317 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-31626dcd-9af0-458b-8307-d2142c39dcc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '915f9b8a873e4b26b855577d0f6ddb3d', 'request_id': 'req-31626dcd-9af0-458b-8307-d2142c39dcc8'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:07.054213 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-31626dcd-9af0-458b-8307-d2142c39dcc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '915f9b8a873e4b26b855577d0f6ddb3d', 'request_id': 'req-31626dcd-9af0-458b-8307-d2142c39dcc8'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:07.061222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-31626dcd-9af0-458b-8307-d2142c39dcc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '915f9b8a873e4b26b855577d0f6ddb3d', 'request_id': 'req-31626dcd-9af0-458b-8307-d2142c39dcc8'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:07.072880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-31626dcd-9af0-458b-8307-d2142c39dcc8 admin admin] The token cache is being invalidate because project 915f9b8a873e4b26b855577d0f6ddb3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:03:07.073171 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-31626dcd-9af0-458b-8307-d2142c39dcc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:07.073817 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-31626dcd-9af0-458b-8307-d2142c39dcc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:07.075352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1081/2210] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:03:06 2022] DELETE /identity/v3/projects/915f9b8a873e4b26b855577d0f6ddb3d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:03:07.080466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29002e8-1dd5-4d3a-9f5a-d95f0abc423e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:07.080924 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29002e8-1dd5-4d3a-9f5a-d95f0abc423e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:07.081095 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29002e8-1dd5-4d3a-9f5a-d95f0abc423e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:07.099418 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a29002e8-1dd5-4d3a-9f5a-d95f0abc423e None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:07.100691 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a29002e8-1dd5-4d3a-9f5a-d95f0abc423e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:07.162049 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1130/2211] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:07.169524 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029cf18-08d6-41e3-82e6-c3637f5dc996 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:07.169831 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029cf18-08d6-41e3-82e6-c3637f5dc996 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:07.170116 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029cf18-08d6-41e3-82e6-c3637f5dc996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:07.192617 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-8029cf18-08d6-41e3-82e6-c3637f5dc996 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:07.194957 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8029cf18-08d6-41e3-82e6-c3637f5dc996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:07.207575 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1082/2212] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:07.211682 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29002e8-1dd5-4d3a-9f5a-d95f0abc423e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:07.221110 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29002e8-1dd5-4d3a-9f5a-d95f0abc423e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:07.236502 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972bc17-2f0b-4041-a4c4-d888f72300ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:07.240848 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972bc17-2f0b-4041-a4c4-d888f72300ec admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:07.240848 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972bc17-2f0b-4041-a4c4-d888f72300ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:07.240848 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972bc17-2f0b-4041-a4c4-d888f72300ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:07.240848 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972bc17-2f0b-4041-a4c4-d888f72300ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:03:07.240848 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972bc17-2f0b-4041-a4c4-d888f72300ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:07.242512 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972bc17-2f0b-4041-a4c4-d888f72300ec admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:07.258172 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1131/2213] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:03:07.262608 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029cf18-08d6-41e3-82e6-c3637f5dc996 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:07.279858 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029cf18-08d6-41e3-82e6-c3637f5dc996 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:07.288968 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f861b9-ba91-4eeb-936e-2c37cb566b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:07.289573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f861b9-ba91-4eeb-936e-2c37cb566b23 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:07.289861 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f861b9-ba91-4eeb-936e-2c37cb566b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:07.290142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f861b9-ba91-4eeb-936e-2c37cb566b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:07.290859 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f861b9-ba91-4eeb-936e-2c37cb566b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:07.292886 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f861b9-ba91-4eeb-936e-2c37cb566b23 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:07.376675 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1083/2214] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:03:07 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:03:07.384762 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972bc17-2f0b-4041-a4c4-d888f72300ec admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:07.395056 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972bc17-2f0b-4041-a4c4-d888f72300ec admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:07.418892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:07.459381 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5a588-5558-4fd9-84e2-595d0f456e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:07.460111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5a588-5558-4fd9-84e2-595d0f456e2e admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:07.460303 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5a588-5558-4fd9-84e2-595d0f456e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:07.460656 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5a588-5558-4fd9-84e2-595d0f456e2e admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:07.461426 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5a588-5558-4fd9-84e2-595d0f456e2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:07.467612 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5a588-5558-4fd9-84e2-595d0f456e2e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:07.578405 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1132/2215] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:03:07 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:03:07.580065 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f861b9-ba91-4eeb-936e-2c37cb566b23 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:07.592993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f861b9-ba91-4eeb-936e-2c37cb566b23 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:07.597864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce104d-0abe-4ed5-bc9c-ea69364be4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:07.598547 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce104d-0abe-4ed5-bc9c-ea69364be4ae admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:07.598821 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce104d-0abe-4ed5-bc9c-ea69364be4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:07.599100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce104d-0abe-4ed5-bc9c-ea69364be4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:07.600480 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce104d-0abe-4ed5-bc9c-ea69364be4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:07.602392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce104d-0abe-4ed5-bc9c-ea69364be4ae admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:07.613380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1084/2216] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:03:07.617376 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5a588-5558-4fd9-84e2-595d0f456e2e admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:07.627742 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5a588-5558-4fd9-84e2-595d0f456e2e admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:07.638051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bfb72-c401-497c-bd8b-7084e0769940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:07.638812 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bfb72-c401-497c-bd8b-7084e0769940 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:07.639080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bfb72-c401-497c-bd8b-7084e0769940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:07.639359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bfb72-c401-497c-bd8b-7084e0769940 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:07.640251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bfb72-c401-497c-bd8b-7084e0769940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:07.641929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bfb72-c401-497c-bd8b-7084e0769940 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:07.656632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1133/2217] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:03:07.658013 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce104d-0abe-4ed5-bc9c-ea69364be4ae admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:07.669290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce104d-0abe-4ed5-bc9c-ea69364be4ae admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:07.676082 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f74ad-a1e9-4b47-a02d-193561ee6239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:07.677044 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f74ad-a1e9-4b47-a02d-193561ee6239 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:07.677331 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f74ad-a1e9-4b47-a02d-193561ee6239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:07.677684 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f74ad-a1e9-4b47-a02d-193561ee6239 admin admin] PATH_INFO: `/v3/projects/79d255dc5ea548638603bdb7000f2013/users/f16fc36958cd4b168c15359b15b37d61/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:07.700357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f74ad-a1e9-4b47-a02d-193561ee6239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d255dc5ea548638603bdb7000f2013, user_id=f16fc36958cd4b168c15359b15b37d61, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:07.704500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f74ad-a1e9-4b47-a02d-193561ee6239 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:07.814989 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1085/2218] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:03:07 2022] PUT /identity/v3/projects/79d255dc5ea548638603bdb7000f2013/users/f16fc36958cd4b168c15359b15b37d61/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:03:07.883292 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed263e-f6f5-4eb1-a3f1-7e4cd6aa173f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:07.883585 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed263e-f6f5-4eb1-a3f1-7e4cd6aa173f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:07.883867 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed263e-f6f5-4eb1-a3f1-7e4cd6aa173f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:07.915774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-67ed263e-f6f5-4eb1-a3f1-7e4cd6aa173f None None] MFA Rules not processed for user `f16fc36958cd4b168c15359b15b37d61`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:07.917449 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-67ed263e-f6f5-4eb1-a3f1-7e4cd6aa173f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:07.992248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1134/2219] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:08.003826 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f74ad-a1e9-4b47-a02d-193561ee6239 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:08.005628 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-221f74ad-a1e9-4b47-a02d-193561ee6239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:08.112325 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f74ad-a1e9-4b47-a02d-193561ee6239 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:08.117845 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14922f09-419b-4bb9-a010-1081f9eea657 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:08.119145 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14922f09-419b-4bb9-a010-1081f9eea657 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:08.119438 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14922f09-419b-4bb9-a010-1081f9eea657 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:08.119723 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14922f09-419b-4bb9-a010-1081f9eea657 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:08.129477 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:08.134181 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14922f09-419b-4bb9-a010-1081f9eea657 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:08.135856 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14922f09-419b-4bb9-a010-1081f9eea657 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:08.147117 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1086/2220] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:03:09.126160 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed263e-f6f5-4eb1-a3f1-7e4cd6aa173f None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:09.128027 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-67ed263e-f6f5-4eb1-a3f1-7e4cd6aa173f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:09.203213 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed263e-f6f5-4eb1-a3f1-7e4cd6aa173f None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:09.208495 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8d116-a293-4d78-ac60-79015e61ba7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:09.210287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8d116-a293-4d78-ac60-79015e61ba7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:09.210571 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8d116-a293-4d78-ac60-79015e61ba7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:09.210850 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8d116-a293-4d78-ac60-79015e61ba7b admin admin] PATH_INFO: `/v3/users/c83ad6705b9c4b069518abe597bab955` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:09.212091 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8d116-a293-4d78-ac60-79015e61ba7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c83ad6705b9c4b069518abe597bab955)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:09.214123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8d116-a293-4d78-ac60-79015e61ba7b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:09.410168 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:09.439694 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-11d8d116-a293-4d78-ac60-79015e61ba7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c83ad6705b9c4b069518abe597bab955'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:09.447270 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-11d8d116-a293-4d78-ac60-79015e61ba7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c83ad6705b9c4b069518abe597bab955'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:09.447931 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-11d8d116-a293-4d78-ac60-79015e61ba7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c83ad6705b9c4b069518abe597bab955'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:09.448635 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-11d8d116-a293-4d78-ac60-79015e61ba7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c83ad6705b9c4b069518abe597bab955'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:09.461879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-11d8d116-a293-4d78-ac60-79015e61ba7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c83ad6705b9c4b069518abe597bab955'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:09.522944 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1135/2221] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:03:09 2022] DELETE /identity/v3/users/c83ad6705b9c4b069518abe597bab955 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:03:09.527573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8d9bb-0649-4252-acd9-6d17f7f427ec None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:09.528047 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8d9bb-0649-4252-acd9-6d17f7f427ec None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:09.528157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8d9bb-0649-4252-acd9-6d17f7f427ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:09.562411 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d2b8d9bb-0649-4252-acd9-6d17f7f427ec None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:09.564179 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d2b8d9bb-0649-4252-acd9-6d17f7f427ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:09.666236 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1087/2222] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:03:09.674711 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8d116-a293-4d78-ac60-79015e61ba7b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:09.676385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-11d8d116-a293-4d78-ac60-79015e61ba7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:09.808309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8d116-a293-4d78-ac60-79015e61ba7b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:09.812530 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbcbac-9b51-4475-a585-0eb3f1e46cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:09.813230 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbcbac-9b51-4475-a585-0eb3f1e46cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:09.813579 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbcbac-9b51-4475-a585-0eb3f1e46cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:09.813860 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbcbac-9b51-4475-a585-0eb3f1e46cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:09.824238 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbcbac-9b51-4475-a585-0eb3f1e46cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:09.825732 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbcbac-9b51-4475-a585-0eb3f1e46cd2 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:09.836579 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1136/2223] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:03:10.481061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8d9bb-0649-4252-acd9-6d17f7f427ec None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:10.482135 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d2b8d9bb-0649-4252-acd9-6d17f7f427ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:10.504426 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8d9bb-0649-4252-acd9-6d17f7f427ec None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:10.511011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c303d-9630-4ca9-92cc-11c930673dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:10.512127 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c303d-9630-4ca9-92cc-11c930673dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:10.512477 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c303d-9630-4ca9-92cc-11c930673dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:10.517006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c303d-9630-4ca9-92cc-11c930673dd6 admin admin] PATH_INFO: `/v3/projects/9dc0dd8fe2b348c7bf4fc7c40fc6bd38` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:10.518317 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c303d-9630-4ca9-92cc-11c930673dd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dc0dd8fe2b348c7bf4fc7c40fc6bd38)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:10.520410 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c303d-9630-4ca9-92cc-11c930673dd6 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:10.650315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-413c303d-9630-4ca9-92cc-11c930673dd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dc0dd8fe2b348c7bf4fc7c40fc6bd38', 'request_id': 'req-413c303d-9630-4ca9-92cc-11c930673dd6'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:10.699806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-413c303d-9630-4ca9-92cc-11c930673dd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dc0dd8fe2b348c7bf4fc7c40fc6bd38', 'request_id': 'req-413c303d-9630-4ca9-92cc-11c930673dd6'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:10.707048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-413c303d-9630-4ca9-92cc-11c930673dd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dc0dd8fe2b348c7bf4fc7c40fc6bd38', 'request_id': 'req-413c303d-9630-4ca9-92cc-11c930673dd6'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:10.719280 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-413c303d-9630-4ca9-92cc-11c930673dd6 admin admin] The token cache is being invalidate because project 9dc0dd8fe2b348c7bf4fc7c40fc6bd38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:03:10.719571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-413c303d-9630-4ca9-92cc-11c930673dd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:10.720230 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-413c303d-9630-4ca9-92cc-11c930673dd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:10.722243 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1088/2224] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:03:10 2022] DELETE /identity/v3/projects/9dc0dd8fe2b348c7bf4fc7c40fc6bd38 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:03:10.728163 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab98972-6712-4820-bef9-46c50ccedb75 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:10.728683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab98972-6712-4820-bef9-46c50ccedb75 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:10.728788 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab98972-6712-4820-bef9-46c50ccedb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:10.747010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-eab98972-6712-4820-bef9-46c50ccedb75 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:10.748453 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-eab98972-6712-4820-bef9-46c50ccedb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:10.829891 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1137/2225] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:10.838335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fb66b-0c99-41f9-92c9-5eb6f8020515 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:10.838792 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fb66b-0c99-41f9-92c9-5eb6f8020515 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:10.839075 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fb66b-0c99-41f9-92c9-5eb6f8020515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:10.858480 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-969fb66b-0c99-41f9-92c9-5eb6f8020515 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:10.859679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-969fb66b-0c99-41f9-92c9-5eb6f8020515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:10.867775 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1089/2226] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:10.872224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab98972-6712-4820-bef9-46c50ccedb75 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:10.882448 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab98972-6712-4820-bef9-46c50ccedb75 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:10.886977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb108e-e4fd-4fb2-a3ff-1d920adc6e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:10.887638 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb108e-e4fd-4fb2-a3ff-1d920adc6e73 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:10.887923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb108e-e4fd-4fb2-a3ff-1d920adc6e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:10.888203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb108e-e4fd-4fb2-a3ff-1d920adc6e73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:10.888975 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb108e-e4fd-4fb2-a3ff-1d920adc6e73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:03:10.889467 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb108e-e4fd-4fb2-a3ff-1d920adc6e73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:10.892274 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb108e-e4fd-4fb2-a3ff-1d920adc6e73 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:10.905470 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1138/2227] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:03:10.910026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fb66b-0c99-41f9-92c9-5eb6f8020515 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:10.919591 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fb66b-0c99-41f9-92c9-5eb6f8020515 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:10.924406 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83988edc-206a-4d64-9237-889a8bea7b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:10.925095 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83988edc-206a-4d64-9237-889a8bea7b74 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:10.925380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83988edc-206a-4d64-9237-889a8bea7b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:10.925656 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83988edc-206a-4d64-9237-889a8bea7b74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:10.926385 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83988edc-206a-4d64-9237-889a8bea7b74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:10.928319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83988edc-206a-4d64-9237-889a8bea7b74 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:11.016984 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1090/2228] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:03:10 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:03:11.021554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb108e-e4fd-4fb2-a3ff-1d920adc6e73 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:11.031936 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb108e-e4fd-4fb2-a3ff-1d920adc6e73 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:11.094080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad4011-46e4-4b71-84d1-b22577819176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:11.094934 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad4011-46e4-4b71-84d1-b22577819176 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:11.095289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad4011-46e4-4b71-84d1-b22577819176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:11.095581 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad4011-46e4-4b71-84d1-b22577819176 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:11.096314 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad4011-46e4-4b71-84d1-b22577819176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:11.098517 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad4011-46e4-4b71-84d1-b22577819176 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:11.251902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1139/2229] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:03:11 2022] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:03:11.253199 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83988edc-206a-4d64-9237-889a8bea7b74 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:11.264438 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83988edc-206a-4d64-9237-889a8bea7b74 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:11.269258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f210578-d81b-4926-b979-8fe4bc6aec01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:11.269843 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f210578-d81b-4926-b979-8fe4bc6aec01 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:11.270131 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f210578-d81b-4926-b979-8fe4bc6aec01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:11.270408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f210578-d81b-4926-b979-8fe4bc6aec01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:11.271138 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f210578-d81b-4926-b979-8fe4bc6aec01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:11.272779 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f210578-d81b-4926-b979-8fe4bc6aec01 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:11.283810 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1091/2230] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:03:11.287851 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad4011-46e4-4b71-84d1-b22577819176 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:11.298149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad4011-46e4-4b71-84d1-b22577819176 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:11.300816 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:11.304917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e98f9-9a92-4874-8005-527bd36ec7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:11.308377 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e98f9-9a92-4874-8005-527bd36ec7ff admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:11.308377 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e98f9-9a92-4874-8005-527bd36ec7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:11.308377 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e98f9-9a92-4874-8005-527bd36ec7ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:11.308377 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e98f9-9a92-4874-8005-527bd36ec7ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:11.308760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e98f9-9a92-4874-8005-527bd36ec7ff admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:11.319009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1140/2231] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:03:11.323075 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f210578-d81b-4926-b979-8fe4bc6aec01 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:11.333477 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f210578-d81b-4926-b979-8fe4bc6aec01 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:11.337977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44be810-efa3-4d33-9e4c-0ce3e7e91286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:11.338841 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44be810-efa3-4d33-9e4c-0ce3e7e91286 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:11.339112 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44be810-efa3-4d33-9e4c-0ce3e7e91286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:11.339393 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44be810-efa3-4d33-9e4c-0ce3e7e91286 admin admin] PATH_INFO: `/v3/projects/ec699c3dd1ab470c8cc0685e6e9f766a/users/4cf000835f1f48cca0a46b233e52c8b9/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:11.354406 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44be810-efa3-4d33-9e4c-0ce3e7e91286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec699c3dd1ab470c8cc0685e6e9f766a, user_id=4cf000835f1f48cca0a46b233e52c8b9, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:11.357216 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44be810-efa3-4d33-9e4c-0ce3e7e91286 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:11.437014 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1092/2232] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:03:11 2022] PUT /identity/v3/projects/ec699c3dd1ab470c8cc0685e6e9f766a/users/4cf000835f1f48cca0a46b233e52c8b9/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:03:11.442185 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409c8d9-b614-42ca-bb34-72f5a706039b None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:11.442483 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409c8d9-b614-42ca-bb34-72f5a706039b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:11.442770 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409c8d9-b614-42ca-bb34-72f5a706039b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:11.460501 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a409c8d9-b614-42ca-bb34-72f5a706039b None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:11.461755 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a409c8d9-b614-42ca-bb34-72f5a706039b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:11.519376 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1141/2233] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:11.529131 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44be810-efa3-4d33-9e4c-0ce3e7e91286 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:11.531018 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c44be810-efa3-4d33-9e4c-0ce3e7e91286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:11.546076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:11.587995 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44be810-efa3-4d33-9e4c-0ce3e7e91286 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:11.592970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47bd8d-f14a-42fc-a3b3-6e780486803d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:11.593622 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47bd8d-f14a-42fc-a3b3-6e780486803d service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:11.593909 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47bd8d-f14a-42fc-a3b3-6e780486803d service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:11.594185 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47bd8d-f14a-42fc-a3b3-6e780486803d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:11.604492 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47bd8d-f14a-42fc-a3b3-6e780486803d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:11.605966 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47bd8d-f14a-42fc-a3b3-6e780486803d service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:11.616134 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1093/2234] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:03:18.374889 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e42e0-597c-437c-8236-a6b743169c4f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:18.375407 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e42e0-597c-437c-8236-a6b743169c4f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:18.375502 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e42e0-597c-437c-8236-a6b743169c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:18.410644 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-9d2e42e0-597c-437c-8236-a6b743169c4f None None] MFA Rules not processed for user `4cf000835f1f48cca0a46b233e52c8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:18.412829 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9d2e42e0-597c-437c-8236-a6b743169c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:18.512415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1142/2235] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:18.513699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47bd8d-f14a-42fc-a3b3-6e780486803d service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:18.524233 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47bd8d-f14a-42fc-a3b3-6e780486803d service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:18.533001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb63cd-c073-443e-b1e9-bf40c19b9063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:18.542287 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb63cd-c073-443e-b1e9-bf40c19b9063 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:18.542287 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb63cd-c073-443e-b1e9-bf40c19b9063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:18.542287 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb63cd-c073-443e-b1e9-bf40c19b9063 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:18.542287 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb63cd-c073-443e-b1e9-bf40c19b9063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:18.542287 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb63cd-c073-443e-b1e9-bf40c19b9063 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:18.626632 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1094/2236] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:03:18 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:03:18.630792 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e42e0-597c-437c-8236-a6b743169c4f None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:18.641712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e42e0-597c-437c-8236-a6b743169c4f None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:18.690657 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:18.703129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb48ef-7d1a-4c19-8d35-0661aae84d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:18.703819 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb48ef-7d1a-4c19-8d35-0661aae84d31 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:18.704107 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb48ef-7d1a-4c19-8d35-0661aae84d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:18.704391 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb48ef-7d1a-4c19-8d35-0661aae84d31 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:18.705143 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb48ef-7d1a-4c19-8d35-0661aae84d31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:18.707139 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb48ef-7d1a-4c19-8d35-0661aae84d31 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:19.076233 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1143/2237] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:03:18 2022] POST /identity/v3/users => generated 292 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:03:19.080458 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb63cd-c073-443e-b1e9-bf40c19b9063 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:19.093608 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb63cd-c073-443e-b1e9-bf40c19b9063 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:19.098590 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956e20b-2d6b-4bd8-a9a9-7168755b149c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:19.099317 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956e20b-2d6b-4bd8-a9a9-7168755b149c admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:19.099600 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956e20b-2d6b-4bd8-a9a9-7168755b149c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:19.099876 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956e20b-2d6b-4bd8-a9a9-7168755b149c admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:19.100654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956e20b-2d6b-4bd8-a9a9-7168755b149c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:19.102562 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956e20b-2d6b-4bd8-a9a9-7168755b149c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:19.119699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1095/2238] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:03:19.120747 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb48ef-7d1a-4c19-8d35-0661aae84d31 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:19.140014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb48ef-7d1a-4c19-8d35-0661aae84d31 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:19.154836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f52652-ce96-4ebe-b283-d5f11bf07dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:19.156041 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f52652-ce96-4ebe-b283-d5f11bf07dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:19.156330 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f52652-ce96-4ebe-b283-d5f11bf07dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:19.156713 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f52652-ce96-4ebe-b283-d5f11bf07dc6 admin admin] PATH_INFO: `/v3/projects/e2b4475abb414735b37f5d7ba42078b2/users/a99127a018ce4ba18a1546a0f056382e/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:19.176516 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f52652-ce96-4ebe-b283-d5f11bf07dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b4475abb414735b37f5d7ba42078b2, user_id=a99127a018ce4ba18a1546a0f056382e, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:19.179399 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f52652-ce96-4ebe-b283-d5f11bf07dc6 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:19.307489 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1144/2239] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:03:19 2022] PUT /identity/v3/projects/e2b4475abb414735b37f5d7ba42078b2/users/a99127a018ce4ba18a1546a0f056382e/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:03:19.312191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956e20b-2d6b-4bd8-a9a9-7168755b149c admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:19.331063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956e20b-2d6b-4bd8-a9a9-7168755b149c admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:19.432250 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ed5c4-08a9-4f41-9d50-f5280e1dbfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:19.433198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ed5c4-08a9-4f41-9d50-f5280e1dbfca admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:19.433752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ed5c4-08a9-4f41-9d50-f5280e1dbfca admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:19.434093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ed5c4-08a9-4f41-9d50-f5280e1dbfca admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:19.434960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ed5c4-08a9-4f41-9d50-f5280e1dbfca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:19.436692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ed5c4-08a9-4f41-9d50-f5280e1dbfca admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:19.448001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1096/2240] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:03:19.452310 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f52652-ce96-4ebe-b283-d5f11bf07dc6 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:19.463793 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f52652-ce96-4ebe-b283-d5f11bf07dc6 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:19.470451 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ceff3-54f9-458f-a0ec-d5e2458fb01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:19.471634 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ceff3-54f9-458f-a0ec-d5e2458fb01b admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:19.476767 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ceff3-54f9-458f-a0ec-d5e2458fb01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:19.476767 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ceff3-54f9-458f-a0ec-d5e2458fb01b admin admin] PATH_INFO: `/v3/projects/e2b4475abb414735b37f5d7ba42078b2/users/a99127a018ce4ba18a1546a0f056382e/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:19.476767 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ceff3-54f9-458f-a0ec-d5e2458fb01b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b4475abb414735b37f5d7ba42078b2, user_id=a99127a018ce4ba18a1546a0f056382e, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:19.477600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ceff3-54f9-458f-a0ec-d5e2458fb01b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:19.493450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1145/2241] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:03:19 2022] PUT /identity/v3/projects/e2b4475abb414735b37f5d7ba42078b2/users/a99127a018ce4ba18a1546a0f056382e/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:03:19.551134 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c4b3a-df1a-4bdc-bb9e-ac8814a2e8cd None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:19.551639 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c4b3a-df1a-4bdc-bb9e-ac8814a2e8cd None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:19.551731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c4b3a-df1a-4bdc-bb9e-ac8814a2e8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:19.574934 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-667c4b3a-df1a-4bdc-bb9e-ac8814a2e8cd None None] MFA Rules not processed for user `aa97e27060b3429bbad061a256db19f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:19.576164 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-667c4b3a-df1a-4bdc-bb9e-ac8814a2e8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:19.652644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1097/2242] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:03:26.613847 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79adde-44d6-4007-ab92-b6edf72961a8 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:26.614398 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79adde-44d6-4007-ab92-b6edf72961a8 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:26.618395 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79adde-44d6-4007-ab92-b6edf72961a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:26.659120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-ac79adde-44d6-4007-ab92-b6edf72961a8 None None] MFA Rules not processed for user `a99127a018ce4ba18a1546a0f056382e`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:26.660708 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ac79adde-44d6-4007-ab92-b6edf72961a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:26.767079 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1146/2243] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:26.783553 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c4b3a-df1a-4bdc-bb9e-ac8814a2e8cd None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:26.785068 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-667c4b3a-df1a-4bdc-bb9e-ac8814a2e8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:26.815611 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:26.910624 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c4b3a-df1a-4bdc-bb9e-ac8814a2e8cd None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:26.917239 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560808e3-5bf6-4e2d-88f4-9e4277b219db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:26.918035 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560808e3-5bf6-4e2d-88f4-9e4277b219db service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:26.918323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560808e3-5bf6-4e2d-88f4-9e4277b219db service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:26.918603 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560808e3-5bf6-4e2d-88f4-9e4277b219db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:26.978645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560808e3-5bf6-4e2d-88f4-9e4277b219db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:26.980242 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560808e3-5bf6-4e2d-88f4-9e4277b219db service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:26.989882 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1098/2244] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:03:29.766416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fc617-bc08-4089-b4bc-d837916e3dfe None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:29.766953 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fc617-bc08-4089-b4bc-d837916e3dfe None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:29.767049 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fc617-bc08-4089-b4bc-d837916e3dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:29.790859 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-ea2fc617-bc08-4089-b4bc-d837916e3dfe None None] MFA Rules not processed for user `4cf000835f1f48cca0a46b233e52c8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:29.792429 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ea2fc617-bc08-4089-b4bc-d837916e3dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:29.801723 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1147/2245] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:34.497183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560808e3-5bf6-4e2d-88f4-9e4277b219db service nova] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:34.499761 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-560808e3-5bf6-4e2d-88f4-9e4277b219db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:34.604435 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:34.615057 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560808e3-5bf6-4e2d-88f4-9e4277b219db service nova] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:34.621725 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc70fc-31e6-477c-b7d2-f3fc706f80fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:34.622768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc70fc-31e6-477c-b7d2-f3fc706f80fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:34.623123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc70fc-31e6-477c-b7d2-f3fc706f80fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:34.623480 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc70fc-31e6-477c-b7d2-f3fc706f80fd admin admin] PATH_INFO: `/v3/users/f16fc36958cd4b168c15359b15b37d61` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:34.624847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc70fc-31e6-477c-b7d2-f3fc706f80fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f16fc36958cd4b168c15359b15b37d61)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:34.626952 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc70fc-31e6-477c-b7d2-f3fc706f80fd admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:34.916092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed4c26-866a-49f5-985f-0954523d37d2 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:34.916631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed4c26-866a-49f5-985f-0954523d37d2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:34.916751 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed4c26-866a-49f5-985f-0954523d37d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:34.961690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f2dc70fc-31e6-477c-b7d2-f3fc706f80fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f16fc36958cd4b168c15359b15b37d61'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:34.964869 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-96ed4c26-866a-49f5-985f-0954523d37d2 None None] MFA Rules not processed for user `ab47c91ba7854bc09f656607dbb41cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:34.966218 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-96ed4c26-866a-49f5-985f-0954523d37d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:34.971044 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f2dc70fc-31e6-477c-b7d2-f3fc706f80fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f16fc36958cd4b168c15359b15b37d61'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:34.972196 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f2dc70fc-31e6-477c-b7d2-f3fc706f80fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f16fc36958cd4b168c15359b15b37d61'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:34.972932 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f2dc70fc-31e6-477c-b7d2-f3fc706f80fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f16fc36958cd4b168c15359b15b37d61'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:34.990683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f2dc70fc-31e6-477c-b7d2-f3fc706f80fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f16fc36958cd4b168c15359b15b37d61'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:35.005511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:35.027232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1148/2246] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jul 5 13:03:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:03:35.089247 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed4c26-866a-49f5-985f-0954523d37d2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:35.090936 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-96ed4c26-866a-49f5-985f-0954523d37d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:35.148917 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1099/2247] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:03:34 2022] DELETE /identity/v3/users/f16fc36958cd4b168c15359b15b37d61 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:03:35.150449 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8bd3f-a46a-4022-86fb-5e2997b90203 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:35.150968 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8bd3f-a46a-4022-86fb-5e2997b90203 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:35.151403 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8bd3f-a46a-4022-86fb-5e2997b90203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:35.182064 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-60c8bd3f-a46a-4022-86fb-5e2997b90203 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:35.183668 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-60c8bd3f-a46a-4022-86fb-5e2997b90203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:35.210543 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed4c26-866a-49f5-985f-0954523d37d2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:35.361024 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1100/2248] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:35.380348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8bd3f-a46a-4022-86fb-5e2997b90203 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:35.381936 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-60c8bd3f-a46a-4022-86fb-5e2997b90203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:35.409487 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f813e1-50d0-437f-a1fc-d9a4b24ec2f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fb7db02f8e945a7af39cb30c3d606f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:35.411479 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f813e1-50d0-437f-a1fc-d9a4b24ec2f6 service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:35.412104 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f813e1-50d0-437f-a1fc-d9a4b24ec2f6 service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:35.413627 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f813e1-50d0-437f-a1fc-d9a4b24ec2f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:35.587299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:35.610575 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f813e1-50d0-437f-a1fc-d9a4b24ec2f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:35.612567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f813e1-50d0-437f-a1fc-d9a4b24ec2f6 service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:35.624140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8bd3f-a46a-4022-86fb-5e2997b90203 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:35.633352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcd5ca-f79f-4ef0-9d9c-d81ecaf48195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:35.634531 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcd5ca-f79f-4ef0-9d9c-d81ecaf48195 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:35.635516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcd5ca-f79f-4ef0-9d9c-d81ecaf48195 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:35.635805 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcd5ca-f79f-4ef0-9d9c-d81ecaf48195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:35.639805 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1149/2249] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jul 5 13:03:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 13:03:35.710687 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edcd5ca-f79f-4ef0-9d9c-d81ecaf48195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:35.717494 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edcd5ca-f79f-4ef0-9d9c-d81ecaf48195 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:35.744249 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1101/2250] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:03:36.587679 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb3229-d705-4df5-8b04-61b0da47b495 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:36.588787 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb3229-d705-4df5-8b04-61b0da47b495 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:36.589411 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb3229-d705-4df5-8b04-61b0da47b495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:36.624971 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-00eb3229-d705-4df5-8b04-61b0da47b495 None None] MFA Rules not processed for user `e4a4bd26db664e44850f5ebccd838315`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:36.630174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-00eb3229-d705-4df5-8b04-61b0da47b495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:36.687137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:36.744048 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1150/2251] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:36.983960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcd5ca-f79f-4ef0-9d9c-d81ecaf48195 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:36.985875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0edcd5ca-f79f-4ef0-9d9c-d81ecaf48195 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:37.002698 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcd5ca-f79f-4ef0-9d9c-d81ecaf48195 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:37.008574 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277c05d-2c2d-4cf4-a00d-73d06a50e28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:37.009691 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277c05d-2c2d-4cf4-a00d-73d06a50e28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:37.009985 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277c05d-2c2d-4cf4-a00d-73d06a50e28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:37.010270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277c05d-2c2d-4cf4-a00d-73d06a50e28a admin admin] PATH_INFO: `/v3/projects/79d255dc5ea548638603bdb7000f2013` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:37.011610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277c05d-2c2d-4cf4-a00d-73d06a50e28a admin admin] RBAC: Authorizing `identity:delete_project(project_id=79d255dc5ea548638603bdb7000f2013)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:37.013620 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277c05d-2c2d-4cf4-a00d-73d06a50e28a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:37.303502 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c277c05d-2c2d-4cf4-a00d-73d06a50e28a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79d255dc5ea548638603bdb7000f2013', 'request_id': 'req-c277c05d-2c2d-4cf4-a00d-73d06a50e28a'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:37.436564 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c277c05d-2c2d-4cf4-a00d-73d06a50e28a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79d255dc5ea548638603bdb7000f2013', 'request_id': 'req-c277c05d-2c2d-4cf4-a00d-73d06a50e28a'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:37.449097 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c277c05d-2c2d-4cf4-a00d-73d06a50e28a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79d255dc5ea548638603bdb7000f2013', 'request_id': 'req-c277c05d-2c2d-4cf4-a00d-73d06a50e28a'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:37.467457 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c277c05d-2c2d-4cf4-a00d-73d06a50e28a admin admin] The token cache is being invalidate because project 79d255dc5ea548638603bdb7000f2013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:03:37.467991 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c277c05d-2c2d-4cf4-a00d-73d06a50e28a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:37.468884 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c277c05d-2c2d-4cf4-a00d-73d06a50e28a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:37.470973 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1102/2252] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:03:36 2022] DELETE /identity/v3/projects/79d255dc5ea548638603bdb7000f2013 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:03:38.388832 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb3229-d705-4df5-8b04-61b0da47b495 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:38.390848 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-00eb3229-d705-4df5-8b04-61b0da47b495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:38.418978 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb3229-d705-4df5-8b04-61b0da47b495 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:38.536680 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aeb47b-2e1d-49b4-bc65-1caf7edab18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:38.537649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aeb47b-2e1d-49b4-bc65-1caf7edab18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:38.537999 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aeb47b-2e1d-49b4-bc65-1caf7edab18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:38.538299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aeb47b-2e1d-49b4-bc65-1caf7edab18a admin admin] PATH_INFO: `/v3/users/13792ca27a974c98a2eb712d6d0e3dab` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:38.539519 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aeb47b-2e1d-49b4-bc65-1caf7edab18a admin admin] RBAC: Authorizing `identity:delete_user(user_id=13792ca27a974c98a2eb712d6d0e3dab)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:38.541943 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aeb47b-2e1d-49b4-bc65-1caf7edab18a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:38.811080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-45aeb47b-2e1d-49b4-bc65-1caf7edab18a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13792ca27a974c98a2eb712d6d0e3dab'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:38.825325 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-45aeb47b-2e1d-49b4-bc65-1caf7edab18a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13792ca27a974c98a2eb712d6d0e3dab'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:38.826458 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-45aeb47b-2e1d-49b4-bc65-1caf7edab18a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13792ca27a974c98a2eb712d6d0e3dab'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:38.826908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-45aeb47b-2e1d-49b4-bc65-1caf7edab18a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13792ca27a974c98a2eb712d6d0e3dab'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:38.847277 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-45aeb47b-2e1d-49b4-bc65-1caf7edab18a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13792ca27a974c98a2eb712d6d0e3dab'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:39.107470 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1151/2253] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:03:38 2022] DELETE /identity/v3/users/13792ca27a974c98a2eb712d6d0e3dab => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:03:39.112279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfab8e-2c00-464f-9288-b57a42bbb105 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:39.112942 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfab8e-2c00-464f-9288-b57a42bbb105 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:39.112942 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfab8e-2c00-464f-9288-b57a42bbb105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:39.211002 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d5bfab8e-2c00-464f-9288-b57a42bbb105 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:39.212647 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d5bfab8e-2c00-464f-9288-b57a42bbb105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:39.318163 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1103/2254] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:39.327558 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aeb47b-2e1d-49b4-bc65-1caf7edab18a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:39.329355 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-45aeb47b-2e1d-49b4-bc65-1caf7edab18a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:39.438577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aeb47b-2e1d-49b4-bc65-1caf7edab18a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:39.452640 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e42183-acb1-4b3d-8b1b-ccf9d13a14f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:39.456351 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e42183-acb1-4b3d-8b1b-ccf9d13a14f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:39.456674 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e42183-acb1-4b3d-8b1b-ccf9d13a14f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:39.456974 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e42183-acb1-4b3d-8b1b-ccf9d13a14f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:39.479135 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:39.488048 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e42183-acb1-4b3d-8b1b-ccf9d13a14f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:39.490485 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e42183-acb1-4b3d-8b1b-ccf9d13a14f1 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:39.502041 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1152/2255] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:03:40.438615 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfab8e-2c00-464f-9288-b57a42bbb105 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:40.441790 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d5bfab8e-2c00-464f-9288-b57a42bbb105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:40.506785 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfab8e-2c00-464f-9288-b57a42bbb105 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:40.514023 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594c90d-7375-446c-a7a4-81d1717e6ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:40.515441 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594c90d-7375-446c-a7a4-81d1717e6ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:40.515769 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594c90d-7375-446c-a7a4-81d1717e6ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:40.523163 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594c90d-7375-446c-a7a4-81d1717e6ff8 admin admin] PATH_INFO: `/v3/projects/d9b907bc678c4ecc9e96ac55f6f61c0e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:40.526599 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594c90d-7375-446c-a7a4-81d1717e6ff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9b907bc678c4ecc9e96ac55f6f61c0e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:40.528958 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594c90d-7375-446c-a7a4-81d1717e6ff8 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:40.683143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2594c90d-7375-446c-a7a4-81d1717e6ff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b907bc678c4ecc9e96ac55f6f61c0e', 'request_id': 'req-2594c90d-7375-446c-a7a4-81d1717e6ff8'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:40.776771 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2594c90d-7375-446c-a7a4-81d1717e6ff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b907bc678c4ecc9e96ac55f6f61c0e', 'request_id': 'req-2594c90d-7375-446c-a7a4-81d1717e6ff8'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:40.784006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2594c90d-7375-446c-a7a4-81d1717e6ff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b907bc678c4ecc9e96ac55f6f61c0e', 'request_id': 'req-2594c90d-7375-446c-a7a4-81d1717e6ff8'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:40.795871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:40.817689 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2594c90d-7375-446c-a7a4-81d1717e6ff8 admin admin] The token cache is being invalidate because project d9b907bc678c4ecc9e96ac55f6f61c0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:03:40.818179 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2594c90d-7375-446c-a7a4-81d1717e6ff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:40.819017 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2594c90d-7375-446c-a7a4-81d1717e6ff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:40.820810 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1104/2256] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:03:40 2022] DELETE /identity/v3/projects/d9b907bc678c4ecc9e96ac55f6f61c0e => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:03:40.825813 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3feeb-b1d0-4927-877e-89b5ff310537 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:40.826793 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3feeb-b1d0-4927-877e-89b5ff310537 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:40.827240 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3feeb-b1d0-4927-877e-89b5ff310537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:40.886954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-4cf3feeb-b1d0-4927-877e-89b5ff310537 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:40.888488 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4cf3feeb-b1d0-4927-877e-89b5ff310537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:40.978852 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1153/2257] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:40.986361 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d72f85-fbc2-48ba-ae0b-5043ca82217b None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:40.986883 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d72f85-fbc2-48ba-ae0b-5043ca82217b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:40.987992 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d72f85-fbc2-48ba-ae0b-5043ca82217b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:41.021088 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-10d72f85-fbc2-48ba-ae0b-5043ca82217b None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:41.024906 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-10d72f85-fbc2-48ba-ae0b-5043ca82217b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:41.034170 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1105/2258] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:41.038574 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3feeb-b1d0-4927-877e-89b5ff310537 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:41.053840 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3feeb-b1d0-4927-877e-89b5ff310537 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:41.059193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c094023-2781-498d-aefd-cb27dd90e04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:41.060720 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c094023-2781-498d-aefd-cb27dd90e04a admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:41.060720 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c094023-2781-498d-aefd-cb27dd90e04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:41.060720 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c094023-2781-498d-aefd-cb27dd90e04a admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:41.061601 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c094023-2781-498d-aefd-cb27dd90e04a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:03:41.064776 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c094023-2781-498d-aefd-cb27dd90e04a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:41.066718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c094023-2781-498d-aefd-cb27dd90e04a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:41.081724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1154/2259] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 13:03:41.085651 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d72f85-fbc2-48ba-ae0b-5043ca82217b None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:41.098271 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d72f85-fbc2-48ba-ae0b-5043ca82217b None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:41.104912 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee3dc8-1dfc-4211-8e2e-2dc670f27871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:41.105796 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee3dc8-1dfc-4211-8e2e-2dc670f27871 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:41.106271 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee3dc8-1dfc-4211-8e2e-2dc670f27871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:41.106714 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee3dc8-1dfc-4211-8e2e-2dc670f27871 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:41.107620 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee3dc8-1dfc-4211-8e2e-2dc670f27871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:41.110255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee3dc8-1dfc-4211-8e2e-2dc670f27871 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:41.232363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1106/2260] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:03:41 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:03:41.236810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c094023-2781-498d-aefd-cb27dd90e04a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:41.252933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c094023-2781-498d-aefd-cb27dd90e04a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:41.342970 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078cfa9-d155-4025-b26c-3d2538252434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:41.343824 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078cfa9-d155-4025-b26c-3d2538252434 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:41.344211 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078cfa9-d155-4025-b26c-3d2538252434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:41.344628 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078cfa9-d155-4025-b26c-3d2538252434 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:41.345459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078cfa9-d155-4025-b26c-3d2538252434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:41.347569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078cfa9-d155-4025-b26c-3d2538252434 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:41.433561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1155/2261] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:03:41 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:03:41.437396 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee3dc8-1dfc-4211-8e2e-2dc670f27871 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:41.451086 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee3dc8-1dfc-4211-8e2e-2dc670f27871 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:41.460874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8b6d9-3c4d-4786-bcca-fc9bcda0db18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:41.461834 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8b6d9-3c4d-4786-bcca-fc9bcda0db18 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:41.462906 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8b6d9-3c4d-4786-bcca-fc9bcda0db18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:41.463355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8b6d9-3c4d-4786-bcca-fc9bcda0db18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:41.464871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8b6d9-3c4d-4786-bcca-fc9bcda0db18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:41.466690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8b6d9-3c4d-4786-bcca-fc9bcda0db18 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:41.483135 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1107/2262] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:03:41.485750 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078cfa9-d155-4025-b26c-3d2538252434 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:41.509462 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078cfa9-d155-4025-b26c-3d2538252434 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:41.519718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b97059-fef5-42b9-b843-dc6f8f059375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:41.520692 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b97059-fef5-42b9-b843-dc6f8f059375 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:41.521102 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b97059-fef5-42b9-b843-dc6f8f059375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:41.521470 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b97059-fef5-42b9-b843-dc6f8f059375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:41.522294 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b97059-fef5-42b9-b843-dc6f8f059375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:41.525333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b97059-fef5-42b9-b843-dc6f8f059375 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:41.536746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1156/2263] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:03:41.541146 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8b6d9-3c4d-4786-bcca-fc9bcda0db18 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:41.555902 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8b6d9-3c4d-4786-bcca-fc9bcda0db18 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:41.560749 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c23621-ae09-4254-a5f3-d6ffd3a4201e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:41.561656 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c23621-ae09-4254-a5f3-d6ffd3a4201e admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:41.561942 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c23621-ae09-4254-a5f3-d6ffd3a4201e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:41.562221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c23621-ae09-4254-a5f3-d6ffd3a4201e admin admin] PATH_INFO: `/v3/projects/2db995cdb00b4a00b4d386119f7156ea/users/24806c72f67041cf821d5bec79786d04/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:41.581283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c23621-ae09-4254-a5f3-d6ffd3a4201e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db995cdb00b4a00b4d386119f7156ea, user_id=24806c72f67041cf821d5bec79786d04, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:41.584047 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c23621-ae09-4254-a5f3-d6ffd3a4201e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:41.683671 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1108/2264] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:03:41 2022] PUT /identity/v3/projects/2db995cdb00b4a00b4d386119f7156ea/users/24806c72f67041cf821d5bec79786d04/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:03:41.696007 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94604942-1c66-46d3-8145-cb842638ba91 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:41.696308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94604942-1c66-46d3-8145-cb842638ba91 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:41.696620 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94604942-1c66-46d3-8145-cb842638ba91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:41.742377 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-94604942-1c66-46d3-8145-cb842638ba91 None None] MFA Rules not processed for user `24806c72f67041cf821d5bec79786d04`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:41.746899 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-94604942-1c66-46d3-8145-cb842638ba91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:41.783051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:41.881569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1157/2265] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:41.889804 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c23621-ae09-4254-a5f3-d6ffd3a4201e admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:41.892232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-03c23621-ae09-4254-a5f3-d6ffd3a4201e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:42.006859 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c23621-ae09-4254-a5f3-d6ffd3a4201e admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:42.023614 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20da070-64f4-4722-9e8b-d9e728962b08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:42.024690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20da070-64f4-4722-9e8b-d9e728962b08 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:42.025635 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20da070-64f4-4722-9e8b-d9e728962b08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:42.027398 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20da070-64f4-4722-9e8b-d9e728962b08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:42.044513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20da070-64f4-4722-9e8b-d9e728962b08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:42.051318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20da070-64f4-4722-9e8b-d9e728962b08 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:42.074581 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1109/2266] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:03:44.273089 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79963c-299f-4201-8ee0-ba5cbbb6c80c None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:44.273679 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79963c-299f-4201-8ee0-ba5cbbb6c80c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:44.273679 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79963c-299f-4201-8ee0-ba5cbbb6c80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:44.307329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-9d79963c-299f-4201-8ee0-ba5cbbb6c80c None None] MFA Rules not processed for user `ad3f91c024f8415cac4784fec0689757`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:44.314994 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9d79963c-299f-4201-8ee0-ba5cbbb6c80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:44.428569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1158/2267] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:50.079985 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20da070-64f4-4722-9e8b-d9e728962b08 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:50.079985 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c20da070-64f4-4722-9e8b-d9e728962b08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:50.186233 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20da070-64f4-4722-9e8b-d9e728962b08 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:50.191506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d65a6-0fd4-4885-ad45-f12962362996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:50.192461 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d65a6-0fd4-4885-ad45-f12962362996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:50.192773 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d65a6-0fd4-4885-ad45-f12962362996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:50.193052 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d65a6-0fd4-4885-ad45-f12962362996 admin admin] PATH_INFO: `/v3/users/337c273f4f1f43a89ec8b02f6bd4617a` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:50.194825 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d65a6-0fd4-4885-ad45-f12962362996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=337c273f4f1f43a89ec8b02f6bd4617a)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:50.196825 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d65a6-0fd4-4885-ad45-f12962362996 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:50.436441 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:50.460766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e05d65a6-0fd4-4885-ad45-f12962362996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '337c273f4f1f43a89ec8b02f6bd4617a'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:50.476261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e05d65a6-0fd4-4885-ad45-f12962362996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '337c273f4f1f43a89ec8b02f6bd4617a'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:50.477149 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e05d65a6-0fd4-4885-ad45-f12962362996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '337c273f4f1f43a89ec8b02f6bd4617a'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:50.480429 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e05d65a6-0fd4-4885-ad45-f12962362996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '337c273f4f1f43a89ec8b02f6bd4617a'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:50.495762 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e05d65a6-0fd4-4885-ad45-f12962362996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '337c273f4f1f43a89ec8b02f6bd4617a'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:50.602349 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1110/2268] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:03:50 2022] DELETE /identity/v3/users/337c273f4f1f43a89ec8b02f6bd4617a => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:03:50.607699 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ba59e-6ee2-4efa-8cb5-a77d82e78e30 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:50.608248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ba59e-6ee2-4efa-8cb5-a77d82e78e30 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:50.608375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ba59e-6ee2-4efa-8cb5-a77d82e78e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:50.655126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-9b5ba59e-6ee2-4efa-8cb5-a77d82e78e30 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:50.655126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9b5ba59e-6ee2-4efa-8cb5-a77d82e78e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:50.748868 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1159/2269] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:50.770911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d65a6-0fd4-4885-ad45-f12962362996 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:50.772719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e05d65a6-0fd4-4885-ad45-f12962362996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:50.890756 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d65a6-0fd4-4885-ad45-f12962362996 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:50.893191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c0c39-71e1-446e-8352-1ba796215b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:50.894141 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c0c39-71e1-446e-8352-1ba796215b2a service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:50.894582 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c0c39-71e1-446e-8352-1ba796215b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:50.895566 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c0c39-71e1-446e-8352-1ba796215b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:50.906500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c0c39-71e1-446e-8352-1ba796215b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:50.909103 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c0c39-71e1-446e-8352-1ba796215b2a service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:50.920541 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1111/2270] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:03:52.383290 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ba59e-6ee2-4efa-8cb5-a77d82e78e30 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:52.384960 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9b5ba59e-6ee2-4efa-8cb5-a77d82e78e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:52.404120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ba59e-6ee2-4efa-8cb5-a77d82e78e30 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:52.415104 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160da30-830d-4d43-b0bf-59a863e949f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:52.422748 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160da30-830d-4d43-b0bf-59a863e949f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:52.423176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160da30-830d-4d43-b0bf-59a863e949f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:52.423604 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160da30-830d-4d43-b0bf-59a863e949f0 admin admin] PATH_INFO: `/v3/projects/51236faf04834910866632e8704e0b57` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:52.427359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160da30-830d-4d43-b0bf-59a863e949f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51236faf04834910866632e8704e0b57)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:52.430609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160da30-830d-4d43-b0bf-59a863e949f0 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:52.561364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2160da30-830d-4d43-b0bf-59a863e949f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51236faf04834910866632e8704e0b57', 'request_id': 'req-2160da30-830d-4d43-b0bf-59a863e949f0'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:52.569584 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2160da30-830d-4d43-b0bf-59a863e949f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51236faf04834910866632e8704e0b57', 'request_id': 'req-2160da30-830d-4d43-b0bf-59a863e949f0'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:52.583213 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2160da30-830d-4d43-b0bf-59a863e949f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51236faf04834910866632e8704e0b57', 'request_id': 'req-2160da30-830d-4d43-b0bf-59a863e949f0'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:52.590582 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:52.683072 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2160da30-830d-4d43-b0bf-59a863e949f0 admin admin] The token cache is being invalidate because project 51236faf04834910866632e8704e0b57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:03:52.683072 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2160da30-830d-4d43-b0bf-59a863e949f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:52.683072 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2160da30-830d-4d43-b0bf-59a863e949f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:52.683072 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1160/2271] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:03:52 2022] DELETE /identity/v3/projects/51236faf04834910866632e8704e0b57 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:03:52.683400 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c0c39-71e1-446e-8352-1ba796215b2a service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:52.697220 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c0c39-71e1-446e-8352-1ba796215b2a service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:52.785227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13759f6d-1293-4e56-bce6-e44acadf0186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:52.787149 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13759f6d-1293-4e56-bce6-e44acadf0186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:52.789734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13759f6d-1293-4e56-bce6-e44acadf0186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:52.790193 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13759f6d-1293-4e56-bce6-e44acadf0186 admin admin] PATH_INFO: `/v3/users/8231904d9f2d4eb796ced86b093cc5dd` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:52.792217 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13759f6d-1293-4e56-bce6-e44acadf0186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8231904d9f2d4eb796ced86b093cc5dd)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:52.798395 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13759f6d-1293-4e56-bce6-e44acadf0186 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:53.107238 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-13759f6d-1293-4e56-bce6-e44acadf0186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8231904d9f2d4eb796ced86b093cc5dd'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:53.139175 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-13759f6d-1293-4e56-bce6-e44acadf0186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8231904d9f2d4eb796ced86b093cc5dd'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:53.140350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-13759f6d-1293-4e56-bce6-e44acadf0186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8231904d9f2d4eb796ced86b093cc5dd'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:53.142149 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-13759f6d-1293-4e56-bce6-e44acadf0186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8231904d9f2d4eb796ced86b093cc5dd'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:53.145320 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:53.187300 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-13759f6d-1293-4e56-bce6-e44acadf0186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8231904d9f2d4eb796ced86b093cc5dd'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:53.255192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1112/2272] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:03:52 2022] DELETE /identity/v3/users/8231904d9f2d4eb796ced86b093cc5dd => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:03:53.915194 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160da30-830d-4d43-b0bf-59a863e949f0 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:53.917452 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2160da30-830d-4d43-b0bf-59a863e949f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:53.934586 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160da30-830d-4d43-b0bf-59a863e949f0 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:54.022865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8c552-49ed-4fc9-8840-4a3d8befd19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:54.023710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8c552-49ed-4fc9-8840-4a3d8befd19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:54.023988 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8c552-49ed-4fc9-8840-4a3d8befd19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:54.024279 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8c552-49ed-4fc9-8840-4a3d8befd19f admin admin] PATH_INFO: `/v3/projects/48cf4f93644e44deb0df7592ff007e63` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:54.025483 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8c552-49ed-4fc9-8840-4a3d8befd19f admin admin] RBAC: Authorizing `identity:delete_project(project_id=48cf4f93644e44deb0df7592ff007e63)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:54.027503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8c552-49ed-4fc9-8840-4a3d8befd19f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:54.168660 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c7e8c552-49ed-4fc9-8840-4a3d8befd19f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48cf4f93644e44deb0df7592ff007e63', 'request_id': 'req-c7e8c552-49ed-4fc9-8840-4a3d8befd19f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:54.178320 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c7e8c552-49ed-4fc9-8840-4a3d8befd19f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48cf4f93644e44deb0df7592ff007e63', 'request_id': 'req-c7e8c552-49ed-4fc9-8840-4a3d8befd19f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:54.182736 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c7e8c552-49ed-4fc9-8840-4a3d8befd19f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48cf4f93644e44deb0df7592ff007e63', 'request_id': 'req-c7e8c552-49ed-4fc9-8840-4a3d8befd19f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:54.276492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c7e8c552-49ed-4fc9-8840-4a3d8befd19f admin admin] The token cache is being invalidate because project 48cf4f93644e44deb0df7592ff007e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:03:54.276674 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c7e8c552-49ed-4fc9-8840-4a3d8befd19f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:54.277295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c7e8c552-49ed-4fc9-8840-4a3d8befd19f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:54.278827 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1161/2273] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:03:53 2022] DELETE /identity/v3/projects/48cf4f93644e44deb0df7592ff007e63 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:03:54.283926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b66d5-bc5b-4ae5-84d8-99d2309168a1 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:54.284393 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b66d5-bc5b-4ae5-84d8-99d2309168a1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:54.284511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b66d5-bc5b-4ae5-84d8-99d2309168a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:54.302229 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d79b66d5-bc5b-4ae5-84d8-99d2309168a1 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:54.303484 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d79b66d5-bc5b-4ae5-84d8-99d2309168a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:54.363078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1113/2274] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:54.372658 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10924206-b190-4e75-a0f8-ceaa5a4649b3 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:54.372946 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10924206-b190-4e75-a0f8-ceaa5a4649b3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:54.373225 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10924206-b190-4e75-a0f8-ceaa5a4649b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:54.392216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-10924206-b190-4e75-a0f8-ceaa5a4649b3 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:54.393502 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-10924206-b190-4e75-a0f8-ceaa5a4649b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:54.401916 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1162/2275] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:54.406339 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b66d5-bc5b-4ae5-84d8-99d2309168a1 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:54.416853 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b66d5-bc5b-4ae5-84d8-99d2309168a1 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:54.421706 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434c0b5-5a71-4679-96ec-e86be9eceaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:54.422443 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434c0b5-5a71-4679-96ec-e86be9eceaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:54.422750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434c0b5-5a71-4679-96ec-e86be9eceaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:54.423026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434c0b5-5a71-4679-96ec-e86be9eceaf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:54.423756 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434c0b5-5a71-4679-96ec-e86be9eceaf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:03:54.424064 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434c0b5-5a71-4679-96ec-e86be9eceaf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:54.425718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434c0b5-5a71-4679-96ec-e86be9eceaf4 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:54.438334 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1114/2276] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:03:54.443076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10924206-b190-4e75-a0f8-ceaa5a4649b3 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:54.452478 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10924206-b190-4e75-a0f8-ceaa5a4649b3 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:54.457153 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e32869-0481-4c10-b529-b69e44dfca05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:54.458386 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e32869-0481-4c10-b529-b69e44dfca05 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:54.458666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e32869-0481-4c10-b529-b69e44dfca05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:54.458941 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e32869-0481-4c10-b529-b69e44dfca05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:54.459637 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e32869-0481-4c10-b529-b69e44dfca05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:54.461578 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e32869-0481-4c10-b529-b69e44dfca05 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:54.548956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1163/2277] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:03:54 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:03:54.550878 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434c0b5-5a71-4679-96ec-e86be9eceaf4 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:54.561467 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434c0b5-5a71-4679-96ec-e86be9eceaf4 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:54.623126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911c685-30c5-4c14-8ac8-7c146880304a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:54.623803 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911c685-30c5-4c14-8ac8-7c146880304a admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:54.624094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911c685-30c5-4c14-8ac8-7c146880304a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:54.624374 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911c685-30c5-4c14-8ac8-7c146880304a admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:54.625128 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911c685-30c5-4c14-8ac8-7c146880304a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:54.627071 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911c685-30c5-4c14-8ac8-7c146880304a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:54.693965 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1115/2278] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:03:54 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:03:54.698293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e32869-0481-4c10-b529-b69e44dfca05 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:54.713149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e32869-0481-4c10-b529-b69e44dfca05 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:54.719158 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d76097-a35d-45c6-8e10-dc4fd6b639bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:54.720444 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d76097-a35d-45c6-8e10-dc4fd6b639bd admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:54.720947 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d76097-a35d-45c6-8e10-dc4fd6b639bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:54.721527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d76097-a35d-45c6-8e10-dc4fd6b639bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:54.724162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d76097-a35d-45c6-8e10-dc4fd6b639bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:54.726445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d76097-a35d-45c6-8e10-dc4fd6b639bd admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:54.741029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1164/2279] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:03:54.744057 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911c685-30c5-4c14-8ac8-7c146880304a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:54.768628 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911c685-30c5-4c14-8ac8-7c146880304a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:54.775523 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ab0e7-d0d9-44de-b5ef-51e8a492a929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:54.776906 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ab0e7-d0d9-44de-b5ef-51e8a492a929 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:54.777407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ab0e7-d0d9-44de-b5ef-51e8a492a929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:54.777904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ab0e7-d0d9-44de-b5ef-51e8a492a929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:54.779034 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ab0e7-d0d9-44de-b5ef-51e8a492a929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:54.781202 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ab0e7-d0d9-44de-b5ef-51e8a492a929 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:54.796800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1116/2280] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:03:54.798108 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d76097-a35d-45c6-8e10-dc4fd6b639bd admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:54.814473 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d76097-a35d-45c6-8e10-dc4fd6b639bd admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:54.828752 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4187cd-6aae-4689-a93b-b4902ef5631c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:54.833005 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4187cd-6aae-4689-a93b-b4902ef5631c admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:54.833005 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4187cd-6aae-4689-a93b-b4902ef5631c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:54.833005 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4187cd-6aae-4689-a93b-b4902ef5631c admin admin] PATH_INFO: `/v3/projects/ab5163e62ec54a6b98201cc6e2cadaca/users/5353022ba42e444da50adcea8cf225cc/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:54.855431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4187cd-6aae-4689-a93b-b4902ef5631c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab5163e62ec54a6b98201cc6e2cadaca, user_id=5353022ba42e444da50adcea8cf225cc, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:54.858566 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4187cd-6aae-4689-a93b-b4902ef5631c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:55.010007 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1165/2281] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:03:54 2022] PUT /identity/v3/projects/ab5163e62ec54a6b98201cc6e2cadaca/users/5353022ba42e444da50adcea8cf225cc/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:03:55.024046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702708e-a273-43d6-9211-3ee7387bb4aa None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:55.024439 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702708e-a273-43d6-9211-3ee7387bb4aa None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:55.024851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702708e-a273-43d6-9211-3ee7387bb4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:55.087976 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e702708e-a273-43d6-9211-3ee7387bb4aa None None] MFA Rules not processed for user `5353022ba42e444da50adcea8cf225cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:55.090033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e702708e-a273-43d6-9211-3ee7387bb4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:55.170236 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:55.223902 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1117/2282] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:55.229052 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4187cd-6aae-4689-a93b-b4902ef5631c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:55.255835 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:55.319271 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4187cd-6aae-4689-a93b-b4902ef5631c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:55.325726 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024356bc-553c-47be-9ab5-84f25a483814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:55.326440 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024356bc-553c-47be-9ab5-84f25a483814 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:55.326798 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024356bc-553c-47be-9ab5-84f25a483814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:55.327174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024356bc-553c-47be-9ab5-84f25a483814 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:55.328004 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024356bc-553c-47be-9ab5-84f25a483814 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:55.331064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024356bc-553c-47be-9ab5-84f25a483814 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:55.483790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1166/2283] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:03:55 2022] POST /identity/v3/projects => generated 381 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:03:55.487679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702708e-a273-43d6-9211-3ee7387bb4aa None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:55.498925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702708e-a273-43d6-9211-3ee7387bb4aa None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:55.555449 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a63b6b-da9e-4ab3-9615-bd28e5135dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:55.556130 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a63b6b-da9e-4ab3-9615-bd28e5135dca admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:55.556413 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a63b6b-da9e-4ab3-9615-bd28e5135dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:55.556716 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a63b6b-da9e-4ab3-9615-bd28e5135dca admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:55.557405 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a63b6b-da9e-4ab3-9615-bd28e5135dca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:55.559334 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a63b6b-da9e-4ab3-9615-bd28e5135dca admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:55.654012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1118/2284] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:03:55 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:03:55.657761 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024356bc-553c-47be-9ab5-84f25a483814 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:55.669031 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024356bc-553c-47be-9ab5-84f25a483814 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:55.675627 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e791b0b-9bc5-40af-bcde-8fb1943c235d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:55.677344 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e791b0b-9bc5-40af-bcde-8fb1943c235d admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:55.679146 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e791b0b-9bc5-40af-bcde-8fb1943c235d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:55.679429 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e791b0b-9bc5-40af-bcde-8fb1943c235d admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:55.680178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e791b0b-9bc5-40af-bcde-8fb1943c235d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:55.681843 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e791b0b-9bc5-40af-bcde-8fb1943c235d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:55.693953 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1167/2285] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:03:55.698215 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a63b6b-da9e-4ab3-9615-bd28e5135dca admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:55.709525 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a63b6b-da9e-4ab3-9615-bd28e5135dca admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:55.714526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583fe03-ec46-42b0-8d3f-43b288473b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:55.715489 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583fe03-ec46-42b0-8d3f-43b288473b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:55.715779 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583fe03-ec46-42b0-8d3f-43b288473b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:55.716067 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583fe03-ec46-42b0-8d3f-43b288473b27 admin admin] PATH_INFO: `/v3/projects/56b621ba510347f79c7791f1b3fa8add/users/54c84c2ce43940b291883c34bb53d964/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:55.731943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583fe03-ec46-42b0-8d3f-43b288473b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b621ba510347f79c7791f1b3fa8add, user_id=54c84c2ce43940b291883c34bb53d964, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:55.735189 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583fe03-ec46-42b0-8d3f-43b288473b27 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:55.843058 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1119/2286] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:03:55 2022] PUT /identity/v3/projects/56b621ba510347f79c7791f1b3fa8add/users/54c84c2ce43940b291883c34bb53d964/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:03:55.846888 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e791b0b-9bc5-40af-bcde-8fb1943c235d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:55.858120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e791b0b-9bc5-40af-bcde-8fb1943c235d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:55.926405 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28ff06-738e-44e3-8a40-9fbeda5aca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:55.927302 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28ff06-738e-44e3-8a40-9fbeda5aca64 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:55.931620 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28ff06-738e-44e3-8a40-9fbeda5aca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:55.931620 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28ff06-738e-44e3-8a40-9fbeda5aca64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:55.931620 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28ff06-738e-44e3-8a40-9fbeda5aca64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:55.931620 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28ff06-738e-44e3-8a40-9fbeda5aca64 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:55.943553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1168/2287] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:03:55.948061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583fe03-ec46-42b0-8d3f-43b288473b27 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:55.961768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583fe03-ec46-42b0-8d3f-43b288473b27 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:55.969670 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f2167-b3e2-4631-85d6-5200da80450b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:55.970600 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f2167-b3e2-4631-85d6-5200da80450b admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:55.970867 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f2167-b3e2-4631-85d6-5200da80450b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:55.971347 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f2167-b3e2-4631-85d6-5200da80450b admin admin] PATH_INFO: `/v3/projects/56b621ba510347f79c7791f1b3fa8add/users/54c84c2ce43940b291883c34bb53d964/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:55.974649 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f2167-b3e2-4631-85d6-5200da80450b admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b621ba510347f79c7791f1b3fa8add, user_id=54c84c2ce43940b291883c34bb53d964, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:55.981646 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f2167-b3e2-4631-85d6-5200da80450b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:55.998557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1120/2288] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:03:55 2022] PUT /identity/v3/projects/56b621ba510347f79c7791f1b3fa8add/users/54c84c2ce43940b291883c34bb53d964/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:03:56.009354 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eafb2a-a9c7-4d47-a0c6-b3c21720d7fc None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:56.009981 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eafb2a-a9c7-4d47-a0c6-b3c21720d7fc None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:56.010263 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eafb2a-a9c7-4d47-a0c6-b3c21720d7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:56.039468 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-25eafb2a-a9c7-4d47-a0c6-b3c21720d7fc None None] MFA Rules not processed for user `54c84c2ce43940b291883c34bb53d964`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:56.040938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-25eafb2a-a9c7-4d47-a0c6-b3c21720d7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:56.187515 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1169/2289] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:56.199500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f2167-b3e2-4631-85d6-5200da80450b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:56.201395 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-257f2167-b3e2-4631-85d6-5200da80450b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:56.301721 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f2167-b3e2-4631-85d6-5200da80450b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:56.305225 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04753b-2c8d-4283-8754-c101ee7eabc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:56.305881 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04753b-2c8d-4283-8754-c101ee7eabc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:56.306608 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04753b-2c8d-4283-8754-c101ee7eabc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:56.306608 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04753b-2c8d-4283-8754-c101ee7eabc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:56.318068 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04753b-2c8d-4283-8754-c101ee7eabc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:56.319528 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04753b-2c8d-4283-8754-c101ee7eabc8 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:56.338239 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1121/2290] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:56 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:03:56.779337 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eafb2a-a9c7-4d47-a0c6-b3c21720d7fc None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:56.781383 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-25eafb2a-a9c7-4d47-a0c6-b3c21720d7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:56.796352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eafb2a-a9c7-4d47-a0c6-b3c21720d7fc None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:56.801192 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9213d7-80d0-4417-8e44-cbccb856ee11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:56.801967 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9213d7-80d0-4417-8e44-cbccb856ee11 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:56.802418 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9213d7-80d0-4417-8e44-cbccb856ee11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:56.802894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9213d7-80d0-4417-8e44-cbccb856ee11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:56.817508 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:56.869393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9213d7-80d0-4417-8e44-cbccb856ee11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:56.870864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9213d7-80d0-4417-8e44-cbccb856ee11 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:56.880578 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1170/2291] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:03:57.563708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04753b-2c8d-4283-8754-c101ee7eabc8 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:57.566801 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9c04753b-2c8d-4283-8754-c101ee7eabc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:57.574970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:57.666285 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04753b-2c8d-4283-8754-c101ee7eabc8 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:57.672828 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590ac96-5db6-4575-bb25-8473c9f9e431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:57.674218 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590ac96-5db6-4575-bb25-8473c9f9e431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:57.674677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590ac96-5db6-4575-bb25-8473c9f9e431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:57.675155 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590ac96-5db6-4575-bb25-8473c9f9e431 admin admin] PATH_INFO: `/v3/users/24806c72f67041cf821d5bec79786d04` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:57.677038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590ac96-5db6-4575-bb25-8473c9f9e431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24806c72f67041cf821d5bec79786d04)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:57.686262 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590ac96-5db6-4575-bb25-8473c9f9e431 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:57.906333 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4590ac96-5db6-4575-bb25-8473c9f9e431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24806c72f67041cf821d5bec79786d04'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:57.913608 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4590ac96-5db6-4575-bb25-8473c9f9e431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24806c72f67041cf821d5bec79786d04'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:57.914322 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4590ac96-5db6-4575-bb25-8473c9f9e431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24806c72f67041cf821d5bec79786d04'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:57.914933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4590ac96-5db6-4575-bb25-8473c9f9e431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24806c72f67041cf821d5bec79786d04'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:57.927213 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4590ac96-5db6-4575-bb25-8473c9f9e431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24806c72f67041cf821d5bec79786d04'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:58.026299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1122/2292] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:03:57 2022] DELETE /identity/v3/users/24806c72f67041cf821d5bec79786d04 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:03:58.030824 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3482a-9c8c-42b8-9d96-00826771b851 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:58.031310 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3482a-9c8c-42b8-9d96-00826771b851 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:58.031404 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3482a-9c8c-42b8-9d96-00826771b851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:58.049467 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-97e3482a-9c8c-42b8-9d96-00826771b851 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:58.050681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-97e3482a-9c8c-42b8-9d96-00826771b851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:58.112916 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1171/2293] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:58.122750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590ac96-5db6-4575-bb25-8473c9f9e431 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:58.124426 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4590ac96-5db6-4575-bb25-8473c9f9e431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:58.190584 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590ac96-5db6-4575-bb25-8473c9f9e431 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:58.195075 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1851068-6c38-4ba1-9af4-9ba8772fc52b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:58.198638 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1851068-6c38-4ba1-9af4-9ba8772fc52b service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:58.198638 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1851068-6c38-4ba1-9af4-9ba8772fc52b service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:58.198638 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1851068-6c38-4ba1-9af4-9ba8772fc52b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:58.206538 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1851068-6c38-4ba1-9af4-9ba8772fc52b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:58.208011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1851068-6c38-4ba1-9af4-9ba8772fc52b service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:58.218358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1123/2294] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:03:58.798349 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffad0d-feb8-4b06-a443-0f0d6c540503 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:58.799098 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffad0d-feb8-4b06-a443-0f0d6c540503 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:58.799473 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffad0d-feb8-4b06-a443-0f0d6c540503 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:58.801712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1172/2295] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jul 5 13:03:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 13:03:58.808535 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022a20a-bcc4-474d-bfed-94596a0b1c52 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:58.812476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022a20a-bcc4-474d-bfed-94596a0b1c52 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:58.819616 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022a20a-bcc4-474d-bfed-94596a0b1c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:58.883563 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:58.914561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-a022a20a-bcc4-474d-bfed-94596a0b1c52 None None] MFA Rules not processed for user `cdf37a42279a466b85906b23751f9c22`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:58.914561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a022a20a-bcc4-474d-bfed-94596a0b1c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:59.054067 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1124/2296] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jul 5 13:03:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:59.068376 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffad0d-feb8-4b06-a443-0f0d6c540503 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:59.070338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-73ffad0d-feb8-4b06-a443-0f0d6c540503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:59.120867 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022a20a-bcc4-474d-bfed-94596a0b1c52 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:59.122720 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a022a20a-bcc4-474d-bfed-94596a0b1c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:59.159498 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022a20a-bcc4-474d-bfed-94596a0b1c52 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:59.169268 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72bbe5-7eb8-4c2e-af77-5b117a30a7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:59.170826 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffad0d-feb8-4b06-a443-0f0d6c540503 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:59.173594 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72bbe5-7eb8-4c2e-af77-5b117a30a7b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:59.174321 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72bbe5-7eb8-4c2e-af77-5b117a30a7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:59.174785 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72bbe5-7eb8-4c2e-af77-5b117a30a7b2 admin admin] PATH_INFO: `/v3/projects/2db995cdb00b4a00b4d386119f7156ea` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:59.175071 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bffb8-69fa-4b79-9744-f8f73b320186 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e7c4b0bd50c474996a21b69bde4e227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:59.175728 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bffb8-69fa-4b79-9744-f8f73b320186 service glance] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:59.176046 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bffb8-69fa-4b79-9744-f8f73b320186 service glance] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:59.176392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bffb8-69fa-4b79-9744-f8f73b320186 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:59.177215 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72bbe5-7eb8-4c2e-af77-5b117a30a7b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2db995cdb00b4a00b4d386119f7156ea)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:59.179989 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72bbe5-7eb8-4c2e-af77-5b117a30a7b2 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:59.187189 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bffb8-69fa-4b79-9744-f8f73b320186 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:59.188809 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bffb8-69fa-4b79-9744-f8f73b320186 service glance] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:59.208331 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1173/2297] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:03:59.301495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6c72bbe5-7eb8-4c2e-af77-5b117a30a7b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2db995cdb00b4a00b4d386119f7156ea', 'request_id': 'req-6c72bbe5-7eb8-4c2e-af77-5b117a30a7b2'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:59.379658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6c72bbe5-7eb8-4c2e-af77-5b117a30a7b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2db995cdb00b4a00b4d386119f7156ea', 'request_id': 'req-6c72bbe5-7eb8-4c2e-af77-5b117a30a7b2'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:59.393857 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6c72bbe5-7eb8-4c2e-af77-5b117a30a7b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2db995cdb00b4a00b4d386119f7156ea', 'request_id': 'req-6c72bbe5-7eb8-4c2e-af77-5b117a30a7b2'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:59.408329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6c72bbe5-7eb8-4c2e-af77-5b117a30a7b2 admin admin] The token cache is being invalidate because project 2db995cdb00b4a00b4d386119f7156ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:03:59.408662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6c72bbe5-7eb8-4c2e-af77-5b117a30a7b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:59.409364 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6c72bbe5-7eb8-4c2e-af77-5b117a30a7b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:03:59.411242 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1125/2298] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:03:59 2022] DELETE /identity/v3/projects/2db995cdb00b4a00b4d386119f7156ea => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:03:59.417061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7a215-b18c-49d3-b665-773a6df151e3 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:59.417582 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7a215-b18c-49d3-b665-773a6df151e3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:59.418947 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7a215-b18c-49d3-b665-773a6df151e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:59.439887 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-74f7a215-b18c-49d3-b665-773a6df151e3 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:59.441195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-74f7a215-b18c-49d3-b665-773a6df151e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:59.466788 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f3d63-1d14-4b1a-bc86-35605007be35 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:59.467066 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f3d63-1d14-4b1a-bc86-35605007be35 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:59.467355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f3d63-1d14-4b1a-bc86-35605007be35 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:59.475830 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1126/2299] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jul 5 13:03:59 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 13:03:59.494380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ccc76-4517-44d7-93eb-d2050e125c6f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:59.494713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ccc76-4517-44d7-93eb-d2050e125c6f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:59.495045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ccc76-4517-44d7-93eb-d2050e125c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:59.532553 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-a25ccc76-4517-44d7-93eb-d2050e125c6f None None] MFA Rules not processed for user `07ab8f60c4ff4969a277b33dca05e685`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:59.534659 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a25ccc76-4517-44d7-93eb-d2050e125c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:59.558824 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:03:59.573500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1174/2300] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:03:59.580947 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9a850-2fae-40cb-a9d7-fb3520feeae9 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:59.581452 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9a850-2fae-40cb-a9d7-fb3520feeae9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:59.581913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9a850-2fae-40cb-a9d7-fb3520feeae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:59.599185 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1127/2301] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jul 5 13:03:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:03:59.603082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-2ed9a850-2fae-40cb-a9d7-fb3520feeae9 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:59.604293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2ed9a850-2fae-40cb-a9d7-fb3520feeae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:59.612072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ccc76-4517-44d7-93eb-d2050e125c6f None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:59.612286 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1175/2302] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:03:59.613914 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a25ccc76-4517-44d7-93eb-d2050e125c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:59.618928 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9a850-2fae-40cb-a9d7-fb3520feeae9 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:59.624901 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ccc76-4517-44d7-93eb-d2050e125c6f None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:59.628612 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9a850-2fae-40cb-a9d7-fb3520feeae9 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:59.628761 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b678be9-f2e9-4ea8-b428-d5b5f13f1d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:59.629937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b678be9-f2e9-4ea8-b428-d5b5f13f1d21 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:59.630227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b678be9-f2e9-4ea8-b428-d5b5f13f1d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:59.630506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b678be9-f2e9-4ea8-b428-d5b5f13f1d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:59.635335 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a768289-ec8e-4f24-aef6-9c79e4a7a8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:59.639224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a768289-ec8e-4f24-aef6-9c79e4a7a8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:59.639224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a768289-ec8e-4f24-aef6-9c79e4a7a8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:59.639224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a768289-ec8e-4f24-aef6-9c79e4a7a8e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:59.639224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a768289-ec8e-4f24-aef6-9c79e4a7a8e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:03:59.639224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a768289-ec8e-4f24-aef6-9c79e4a7a8e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:59.639587 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b678be9-f2e9-4ea8-b428-d5b5f13f1d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:59.639663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a768289-ec8e-4f24-aef6-9c79e4a7a8e5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:59.640172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b678be9-f2e9-4ea8-b428-d5b5f13f1d21 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:59.649045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1128/2303] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:03:59.653457 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1176/2304] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 13:03:59.657973 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b678be9-f2e9-4ea8-b428-d5b5f13f1d21 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:59.669436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b678be9-f2e9-4ea8-b428-d5b5f13f1d21 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:59.674141 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd276fff-cd83-4e6f-b718-85073c923dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:59.674797 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd276fff-cd83-4e6f-b718-85073c923dad admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:59.675121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd276fff-cd83-4e6f-b718-85073c923dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:59.675401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd276fff-cd83-4e6f-b718-85073c923dad admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:59.676127 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd276fff-cd83-4e6f-b718-85073c923dad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:59.678098 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd276fff-cd83-4e6f-b718-85073c923dad admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:03:59.784906 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1129/2305] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:03:59 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:03:59.789180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a768289-ec8e-4f24-aef6-9c79e4a7a8e5 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:59.803721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a768289-ec8e-4f24-aef6-9c79e4a7a8e5 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:03:59.806351 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392eb38-ab37-46cf-8fd5-1934b4ef52e2 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:59.806815 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392eb38-ab37-46cf-8fd5-1934b4ef52e2 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:59.807269 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392eb38-ab37-46cf-8fd5-1934b4ef52e2 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:59.809794 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1130/2306] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jul 5 13:03:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 13:03:59.820651 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe675e3-9342-4d30-ae80-6a425f235cf4 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:59.821189 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe675e3-9342-4d30-ae80-6a425f235cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:59.821673 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe675e3-9342-4d30-ae80-6a425f235cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:59.857689 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-4fe675e3-9342-4d30-ae80-6a425f235cf4 None None] MFA Rules not processed for user `cdf37a42279a466b85906b23751f9c22`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:03:59.858967 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4fe675e3-9342-4d30-ae80-6a425f235cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:03:59.965786 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed7fd9-68bb-4a9a-a3f0-358fa2185af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:03:59.966917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed7fd9-68bb-4a9a-a3f0-358fa2185af9 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:03:59.966917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed7fd9-68bb-4a9a-a3f0-358fa2185af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:03:59.967104 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed7fd9-68bb-4a9a-a3f0-358fa2185af9 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:03:59.967828 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed7fd9-68bb-4a9a-a3f0-358fa2185af9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:03:59.972784 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1131/2307] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jul 5 13:03:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 05 13:03:59.979706 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe675e3-9342-4d30-ae80-6a425f235cf4 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:03:59.979894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed7fd9-68bb-4a9a-a3f0-358fa2185af9 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:00.042103 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe675e3-9342-4d30-ae80-6a425f235cf4 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:00.046214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15406679-2ef7-48de-be2a-838d48339db2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:00.046973 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15406679-2ef7-48de-be2a-838d48339db2 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:00.047353 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15406679-2ef7-48de-be2a-838d48339db2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:00.047878 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15406679-2ef7-48de-be2a-838d48339db2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:00.070975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15406679-2ef7-48de-be2a-838d48339db2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:00.072920 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15406679-2ef7-48de-be2a-838d48339db2 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:00.089654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1132/2308] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:03:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:04:00.157835 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1177/2309] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:03:59 2022] POST /identity/v3/users => generated 289 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:04:00.163913 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15406679-2ef7-48de-be2a-838d48339db2 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:00.187201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15406679-2ef7-48de-be2a-838d48339db2 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:00.194045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732186d-9764-4ba3-b4fa-9c9e85ab6eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:00.194732 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732186d-9764-4ba3-b4fa-9c9e85ab6eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:00.195075 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732186d-9764-4ba3-b4fa-9c9e85ab6eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:00.195361 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732186d-9764-4ba3-b4fa-9c9e85ab6eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:00.196305 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732186d-9764-4ba3-b4fa-9c9e85ab6eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:00.199691 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732186d-9764-4ba3-b4fa-9c9e85ab6eb8 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:00.256326 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1133/2310] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:04:00.258914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed7fd9-68bb-4a9a-a3f0-358fa2185af9 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:00.277595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed7fd9-68bb-4a9a-a3f0-358fa2185af9 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:00.288771 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f4499-e74e-4611-ab62-88291ad56d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:00.289477 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f4499-e74e-4611-ab62-88291ad56d2b admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:00.289769 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f4499-e74e-4611-ab62-88291ad56d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:00.290031 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f4499-e74e-4611-ab62-88291ad56d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:00.290789 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f4499-e74e-4611-ab62-88291ad56d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:00.293538 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:00.294987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f4499-e74e-4611-ab62-88291ad56d2b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:00.317154 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1178/2311] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:04:00.321014 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732186d-9764-4ba3-b4fa-9c9e85ab6eb8 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:00.336051 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732186d-9764-4ba3-b4fa-9c9e85ab6eb8 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:00.347939 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b61d7f-a7aa-4131-823c-b48de367b782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:00.349196 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b61d7f-a7aa-4131-823c-b48de367b782 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:00.349491 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b61d7f-a7aa-4131-823c-b48de367b782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:00.349760 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b61d7f-a7aa-4131-823c-b48de367b782 admin admin] PATH_INFO: `/v3/projects/277fa3c89dff47b88894b781ff69fb70/users/661062780f5c45d180a05e402fc7bc27/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:00.376069 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b61d7f-a7aa-4131-823c-b48de367b782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=277fa3c89dff47b88894b781ff69fb70, user_id=661062780f5c45d180a05e402fc7bc27, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:00.380552 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b61d7f-a7aa-4131-823c-b48de367b782 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:00.466451 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1134/2312] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:04:00 2022] PUT /identity/v3/projects/277fa3c89dff47b88894b781ff69fb70/users/661062780f5c45d180a05e402fc7bc27/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:04:00.471398 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63114a22-0446-48f9-bcd2-304374e1736a None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:00.472053 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63114a22-0446-48f9-bcd2-304374e1736a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:00.472492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63114a22-0446-48f9-bcd2-304374e1736a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:00.517520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-63114a22-0446-48f9-bcd2-304374e1736a None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:00.519238 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-63114a22-0446-48f9-bcd2-304374e1736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:00.622352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1179/2313] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:00.662225 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b61d7f-a7aa-4131-823c-b48de367b782 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:00.734557 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b61d7f-a7aa-4131-823c-b48de367b782 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:00.739824 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c394d-7b2a-4a81-96b2-6f0a64cc0227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:00.740809 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c394d-7b2a-4a81-96b2-6f0a64cc0227 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:00.741273 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c394d-7b2a-4a81-96b2-6f0a64cc0227 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:00.741697 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c394d-7b2a-4a81-96b2-6f0a64cc0227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:00.766612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c394d-7b2a-4a81-96b2-6f0a64cc0227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:00.768102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c394d-7b2a-4a81-96b2-6f0a64cc0227 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:00.780958 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1135/2314] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:04:01.499112 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:05.427157 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63114a22-0446-48f9-bcd2-304374e1736a None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:05.430388 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-63114a22-0446-48f9-bcd2-304374e1736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:05.542241 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:05.586119 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63114a22-0446-48f9-bcd2-304374e1736a None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:05.592696 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8538515-f95e-4bd1-a8e0-251b984b1c33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43b85b5c7b1e4d73b29fb96f4fa6db71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:05.593774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8538515-f95e-4bd1-a8e0-251b984b1c33 service placement] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:05.600149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8538515-f95e-4bd1-a8e0-251b984b1c33 service placement] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:05.600614 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8538515-f95e-4bd1-a8e0-251b984b1c33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:05.603169 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f8538515-f95e-4bd1-a8e0-251b984b1c33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:05.617023 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8538515-f95e-4bd1-a8e0-251b984b1c33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:05.618801 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8538515-f95e-4bd1-a8e0-251b984b1c33 service placement] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:05.643523 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1180/2315] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:04:07.887385 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91542d-6009-476a-8dac-631a50901537 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:07.887904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91542d-6009-476a-8dac-631a50901537 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:07.888182 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91542d-6009-476a-8dac-631a50901537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:07.922336 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-8b91542d-6009-476a-8dac-631a50901537 None None] MFA Rules not processed for user `661062780f5c45d180a05e402fc7bc27`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:07.923591 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8b91542d-6009-476a-8dac-631a50901537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:08.055894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1136/2316] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:04:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:08.058280 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8538515-f95e-4bd1-a8e0-251b984b1c33 service placement] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:08.080042 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8538515-f95e-4bd1-a8e0-251b984b1c33 service placement] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:08.086003 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd9fc3-4ca8-42cb-b1b8-51e822505182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:08.086356 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd9fc3-4ca8-42cb-b1b8-51e822505182 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:08.086793 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd9fc3-4ca8-42cb-b1b8-51e822505182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:08.087167 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd9fc3-4ca8-42cb-b1b8-51e822505182 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:08.087780 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd9fc3-4ca8-42cb-b1b8-51e822505182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:08.089805 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd9fc3-4ca8-42cb-b1b8-51e822505182 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:08.268025 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1181/2317] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:04:08 2022] POST /identity/v3/projects => generated 379 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:04:08.269230 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91542d-6009-476a-8dac-631a50901537 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:08.284087 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91542d-6009-476a-8dac-631a50901537 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:08.379696 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf2246-6920-4165-a0b1-f3f4a6702ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:08.382028 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf2246-6920-4165-a0b1-f3f4a6702ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:08.382916 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf2246-6920-4165-a0b1-f3f4a6702ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:08.383671 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf2246-6920-4165-a0b1-f3f4a6702ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:08.385018 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf2246-6920-4165-a0b1-f3f4a6702ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:08.390387 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf2246-6920-4165-a0b1-f3f4a6702ee8 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:08.479044 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1137/2318] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:04:08 2022] POST /identity/v3/users => generated 296 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:04:08.483244 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd9fc3-4ca8-42cb-b1b8-51e822505182 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:08.495210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd9fc3-4ca8-42cb-b1b8-51e822505182 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:08.500396 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a3ac5-2b14-49b5-bbbc-ce0cf37cb987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:08.501189 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a3ac5-2b14-49b5-bbbc-ce0cf37cb987 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:08.501687 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a3ac5-2b14-49b5-bbbc-ce0cf37cb987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:08.502044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a3ac5-2b14-49b5-bbbc-ce0cf37cb987 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:08.503164 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a3ac5-2b14-49b5-bbbc-ce0cf37cb987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:08.505029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a3ac5-2b14-49b5-bbbc-ce0cf37cb987 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:08.517179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1182/2319] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:04:08.521846 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf2246-6920-4165-a0b1-f3f4a6702ee8 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:08.533508 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf2246-6920-4165-a0b1-f3f4a6702ee8 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:08.542381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b93c3b-a2c4-45f8-bcf3-b0c8795350d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:08.544053 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b93c3b-a2c4-45f8-bcf3-b0c8795350d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:08.545081 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b93c3b-a2c4-45f8-bcf3-b0c8795350d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:08.545081 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b93c3b-a2c4-45f8-bcf3-b0c8795350d8 admin admin] PATH_INFO: `/v3/projects/738ac669e62342d6a9e5b11db0046cf0/users/9fec0c5afb3248d68f39cdd51c1656be/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:08.583719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b93c3b-a2c4-45f8-bcf3-b0c8795350d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=738ac669e62342d6a9e5b11db0046cf0, user_id=9fec0c5afb3248d68f39cdd51c1656be, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:08.587722 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b93c3b-a2c4-45f8-bcf3-b0c8795350d8 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:08.697496 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1138/2320] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:04:08 2022] PUT /identity/v3/projects/738ac669e62342d6a9e5b11db0046cf0/users/9fec0c5afb3248d68f39cdd51c1656be/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:04:08.701046 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a3ac5-2b14-49b5-bbbc-ce0cf37cb987 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:08.714062 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a3ac5-2b14-49b5-bbbc-ce0cf37cb987 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:08.795858 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950ffae-02eb-4d29-b338-95315a1a04ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:08.796555 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950ffae-02eb-4d29-b338-95315a1a04ef admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:08.797023 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950ffae-02eb-4d29-b338-95315a1a04ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:08.797315 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950ffae-02eb-4d29-b338-95315a1a04ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:08.798055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950ffae-02eb-4d29-b338-95315a1a04ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:08.800014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950ffae-02eb-4d29-b338-95315a1a04ef admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:08.811538 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1183/2321] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:04:08.815860 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b93c3b-a2c4-45f8-bcf3-b0c8795350d8 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:08.827537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b93c3b-a2c4-45f8-bcf3-b0c8795350d8 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:08.837599 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edbd04-fb32-4cce-9b54-86b15cd2bc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:08.838864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edbd04-fb32-4cce-9b54-86b15cd2bc3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:08.839211 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edbd04-fb32-4cce-9b54-86b15cd2bc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:08.839500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edbd04-fb32-4cce-9b54-86b15cd2bc3b admin admin] PATH_INFO: `/v3/projects/738ac669e62342d6a9e5b11db0046cf0/users/9fec0c5afb3248d68f39cdd51c1656be/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:08.841763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edbd04-fb32-4cce-9b54-86b15cd2bc3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=738ac669e62342d6a9e5b11db0046cf0, user_id=9fec0c5afb3248d68f39cdd51c1656be, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:08.844475 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edbd04-fb32-4cce-9b54-86b15cd2bc3b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:08.856483 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1139/2322] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:04:08 2022] PUT /identity/v3/projects/738ac669e62342d6a9e5b11db0046cf0/users/9fec0c5afb3248d68f39cdd51c1656be/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:04:09.299609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9095e3-f47c-4d5e-bf4f-4351f84bec66 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:09.300290 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9095e3-f47c-4d5e-bf4f-4351f84bec66 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:09.301338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9095e3-f47c-4d5e-bf4f-4351f84bec66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:09.373522 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-2f9095e3-f47c-4d5e-bf4f-4351f84bec66 None None] MFA Rules not processed for user `ab47c91ba7854bc09f656607dbb41cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:09.374787 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2f9095e3-f47c-4d5e-bf4f-4351f84bec66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:09.544046 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1184/2323] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jul 5 13:04:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:09.560976 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edbd04-fb32-4cce-9b54-86b15cd2bc3b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:09.570936 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-81edbd04-fb32-4cce-9b54-86b15cd2bc3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:09.604044 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:09.724555 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edbd04-fb32-4cce-9b54-86b15cd2bc3b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:09.732071 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809aba0-11f6-4d52-b48b-4b106ad2a5f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fb7db02f8e945a7af39cb30c3d606f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:09.734704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809aba0-11f6-4d52-b48b-4b106ad2a5f3 service swift] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:09.734704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809aba0-11f6-4d52-b48b-4b106ad2a5f3 service swift] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:09.734704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809aba0-11f6-4d52-b48b-4b106ad2a5f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:09.744160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809aba0-11f6-4d52-b48b-4b106ad2a5f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:09.745899 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809aba0-11f6-4d52-b48b-4b106ad2a5f3 service swift] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:09.748299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9095e3-f47c-4d5e-bf4f-4351f84bec66 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:09.749939 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2f9095e3-f47c-4d5e-bf4f-4351f84bec66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:09.757053 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:09.758361 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1140/2324] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jul 5 13:04:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:04:09.852988 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9095e3-f47c-4d5e-bf4f-4351f84bec66 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:09.859428 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf87a3e-1d37-4d1f-814f-e7ebfafa3c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:09.860492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf87a3e-1d37-4d1f-814f-e7ebfafa3c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:09.860814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf87a3e-1d37-4d1f-814f-e7ebfafa3c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:09.861096 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf87a3e-1d37-4d1f-814f-e7ebfafa3c1f admin admin] PATH_INFO: `/v3/users/5353022ba42e444da50adcea8cf225cc` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:09.862521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf87a3e-1d37-4d1f-814f-e7ebfafa3c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5353022ba42e444da50adcea8cf225cc)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:09.865990 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf87a3e-1d37-4d1f-814f-e7ebfafa3c1f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:10.137399 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2cf87a3e-1d37-4d1f-814f-e7ebfafa3c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5353022ba42e444da50adcea8cf225cc'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:10.159185 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2cf87a3e-1d37-4d1f-814f-e7ebfafa3c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5353022ba42e444da50adcea8cf225cc'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:10.161727 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2cf87a3e-1d37-4d1f-814f-e7ebfafa3c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5353022ba42e444da50adcea8cf225cc'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:10.165168 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2cf87a3e-1d37-4d1f-814f-e7ebfafa3c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5353022ba42e444da50adcea8cf225cc'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:10.204057 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2cf87a3e-1d37-4d1f-814f-e7ebfafa3c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5353022ba42e444da50adcea8cf225cc'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:10.288479 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1185/2325] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:04:09 2022] DELETE /identity/v3/users/5353022ba42e444da50adcea8cf225cc => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:04:10.293497 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba0f66-27c4-4c26-b73a-67a55c9e702a None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:10.293497 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba0f66-27c4-4c26-b73a-67a55c9e702a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:10.298830 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba0f66-27c4-4c26-b73a-67a55c9e702a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:10.325674 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c7ba0f66-27c4-4c26-b73a-67a55c9e702a None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:10.326980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c7ba0f66-27c4-4c26-b73a-67a55c9e702a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:10.425070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1141/2326] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:10.432672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf87a3e-1d37-4d1f-814f-e7ebfafa3c1f admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:10.434986 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2cf87a3e-1d37-4d1f-814f-e7ebfafa3c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:10.564648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf87a3e-1d37-4d1f-814f-e7ebfafa3c1f admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:10.573032 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14def887-19b5-4fde-82d6-c8b8c121ee6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:10.573709 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14def887-19b5-4fde-82d6-c8b8c121ee6f service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:10.573989 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14def887-19b5-4fde-82d6-c8b8c121ee6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:10.574268 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14def887-19b5-4fde-82d6-c8b8c121ee6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:10.596767 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14def887-19b5-4fde-82d6-c8b8c121ee6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:10.598778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14def887-19b5-4fde-82d6-c8b8c121ee6f service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:10.610682 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1186/2327] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:04:11.829589 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba0f66-27c4-4c26-b73a-67a55c9e702a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:11.832800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c7ba0f66-27c4-4c26-b73a-67a55c9e702a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:11.865355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba0f66-27c4-4c26-b73a-67a55c9e702a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:11.883847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343b7be-6379-4327-97b5-ea1f2db67045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:11.884776 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343b7be-6379-4327-97b5-ea1f2db67045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:11.885054 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343b7be-6379-4327-97b5-ea1f2db67045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:11.885332 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343b7be-6379-4327-97b5-ea1f2db67045 admin admin] PATH_INFO: `/v3/projects/ab5163e62ec54a6b98201cc6e2cadaca` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:11.898659 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343b7be-6379-4327-97b5-ea1f2db67045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab5163e62ec54a6b98201cc6e2cadaca)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:11.902182 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343b7be-6379-4327-97b5-ea1f2db67045 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:12.147229 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c343b7be-6379-4327-97b5-ea1f2db67045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab5163e62ec54a6b98201cc6e2cadaca', 'request_id': 'req-c343b7be-6379-4327-97b5-ea1f2db67045'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:12.242438 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c343b7be-6379-4327-97b5-ea1f2db67045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab5163e62ec54a6b98201cc6e2cadaca', 'request_id': 'req-c343b7be-6379-4327-97b5-ea1f2db67045'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:12.250845 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c343b7be-6379-4327-97b5-ea1f2db67045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab5163e62ec54a6b98201cc6e2cadaca', 'request_id': 'req-c343b7be-6379-4327-97b5-ea1f2db67045'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:12.265414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c343b7be-6379-4327-97b5-ea1f2db67045 admin admin] The token cache is being invalidate because project ab5163e62ec54a6b98201cc6e2cadaca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:04:12.266075 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c343b7be-6379-4327-97b5-ea1f2db67045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:12.267972 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c343b7be-6379-4327-97b5-ea1f2db67045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:12.271598 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1142/2328] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:04:11 2022] DELETE /identity/v3/projects/ab5163e62ec54a6b98201cc6e2cadaca => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:04:12.275320 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14def887-19b5-4fde-82d6-c8b8c121ee6f service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:12.299471 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14def887-19b5-4fde-82d6-c8b8c121ee6f service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:12.356730 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:12.447550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58906c7-2dbc-4226-b6d5-07f5b0bcd3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:12.448576 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58906c7-2dbc-4226-b6d5-07f5b0bcd3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:12.449039 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58906c7-2dbc-4226-b6d5-07f5b0bcd3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:12.453659 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58906c7-2dbc-4226-b6d5-07f5b0bcd3fd admin admin] PATH_INFO: `/v3/users/54c84c2ce43940b291883c34bb53d964` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:12.453659 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58906c7-2dbc-4226-b6d5-07f5b0bcd3fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=54c84c2ce43940b291883c34bb53d964)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:12.456383 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58906c7-2dbc-4226-b6d5-07f5b0bcd3fd admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:12.804422 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f58906c7-2dbc-4226-b6d5-07f5b0bcd3fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54c84c2ce43940b291883c34bb53d964'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:12.825592 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f58906c7-2dbc-4226-b6d5-07f5b0bcd3fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54c84c2ce43940b291883c34bb53d964'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:12.828210 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f58906c7-2dbc-4226-b6d5-07f5b0bcd3fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54c84c2ce43940b291883c34bb53d964'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:12.829284 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f58906c7-2dbc-4226-b6d5-07f5b0bcd3fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54c84c2ce43940b291883c34bb53d964'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:12.889389 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f58906c7-2dbc-4226-b6d5-07f5b0bcd3fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54c84c2ce43940b291883c34bb53d964'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:13.009020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1187/2329] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:04:12 2022] DELETE /identity/v3/users/54c84c2ce43940b291883c34bb53d964 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:04:14.674710 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343b7be-6379-4327-97b5-ea1f2db67045 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:14.677858 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c343b7be-6379-4327-97b5-ea1f2db67045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:14.730095 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343b7be-6379-4327-97b5-ea1f2db67045 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:14.766365 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:14.822403 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143a817-28e9-428e-8e41-b88b3dd04a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:14.823697 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143a817-28e9-428e-8e41-b88b3dd04a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:14.824199 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143a817-28e9-428e-8e41-b88b3dd04a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:14.824656 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143a817-28e9-428e-8e41-b88b3dd04a5e admin admin] PATH_INFO: `/v3/projects/56b621ba510347f79c7791f1b3fa8add` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:14.826288 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143a817-28e9-428e-8e41-b88b3dd04a5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=56b621ba510347f79c7791f1b3fa8add)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:14.828690 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143a817-28e9-428e-8e41-b88b3dd04a5e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:15.019771 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2143a817-28e9-428e-8e41-b88b3dd04a5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b621ba510347f79c7791f1b3fa8add', 'request_id': 'req-2143a817-28e9-428e-8e41-b88b3dd04a5e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:15.127685 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2143a817-28e9-428e-8e41-b88b3dd04a5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b621ba510347f79c7791f1b3fa8add', 'request_id': 'req-2143a817-28e9-428e-8e41-b88b3dd04a5e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:15.139012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2143a817-28e9-428e-8e41-b88b3dd04a5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b621ba510347f79c7791f1b3fa8add', 'request_id': 'req-2143a817-28e9-428e-8e41-b88b3dd04a5e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:15.189159 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2143a817-28e9-428e-8e41-b88b3dd04a5e admin admin] The token cache is being invalidate because project 56b621ba510347f79c7791f1b3fa8add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:04:15.189466 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2143a817-28e9-428e-8e41-b88b3dd04a5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:15.190176 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2143a817-28e9-428e-8e41-b88b3dd04a5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:15.197725 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1143/2330] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:04:14 2022] DELETE /identity/v3/projects/56b621ba510347f79c7791f1b3fa8add => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:04:15.199448 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d970af-9d05-4654-84c9-a63ce1717ca4 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:15.200398 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d970af-9d05-4654-84c9-a63ce1717ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:15.200965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d970af-9d05-4654-84c9-a63ce1717ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:15.222568 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-d5d970af-9d05-4654-84c9-a63ce1717ca4 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:15.224563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d5d970af-9d05-4654-84c9-a63ce1717ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:15.305980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1188/2331] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:15.313998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b335745-7887-4c45-9f98-b68e261754e8 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:15.318377 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b335745-7887-4c45-9f98-b68e261754e8 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:15.318377 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b335745-7887-4c45-9f98-b68e261754e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:15.350327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-3b335745-7887-4c45-9f98-b68e261754e8 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:15.350327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3b335745-7887-4c45-9f98-b68e261754e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:15.363296 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d970af-9d05-4654-84c9-a63ce1717ca4 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:15.378175 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1144/2332] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:15.380015 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d970af-9d05-4654-84c9-a63ce1717ca4 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:15.387928 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73eabbe-753b-4794-8462-807d42b1400b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:15.388686 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eabbe-753b-4794-8462-807d42b1400b admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:15.388956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eabbe-753b-4794-8462-807d42b1400b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:15.389240 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eabbe-753b-4794-8462-807d42b1400b admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:15.390011 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73eabbe-753b-4794-8462-807d42b1400b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:04:15.390922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73eabbe-753b-4794-8462-807d42b1400b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:15.393190 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73eabbe-753b-4794-8462-807d42b1400b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:15.416142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b335745-7887-4c45-9f98-b68e261754e8 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:15.422318 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1189/2333] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:04:15.428343 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b335745-7887-4c45-9f98-b68e261754e8 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:15.435140 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f3271-8de5-452a-b07a-843631503755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:15.435797 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f3271-8de5-452a-b07a-843631503755 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:15.436086 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f3271-8de5-452a-b07a-843631503755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:15.436362 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f3271-8de5-452a-b07a-843631503755 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:15.437100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f3271-8de5-452a-b07a-843631503755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:15.439029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f3271-8de5-452a-b07a-843631503755 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:15.534962 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1145/2334] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:04:15 2022] POST /identity/v3/projects => generated 389 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:04:15.540385 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73eabbe-753b-4794-8462-807d42b1400b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:15.554012 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73eabbe-753b-4794-8462-807d42b1400b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:15.608037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:15.661171 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a2bf8-fc74-42e1-8ce0-330babc3f806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:15.662296 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a2bf8-fc74-42e1-8ce0-330babc3f806 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:15.662765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a2bf8-fc74-42e1-8ce0-330babc3f806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:15.664408 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a2bf8-fc74-42e1-8ce0-330babc3f806 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:15.665426 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a2bf8-fc74-42e1-8ce0-330babc3f806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:15.667731 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a2bf8-fc74-42e1-8ce0-330babc3f806 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:15.796639 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1190/2335] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:04:15 2022] POST /identity/v3/users => generated 295 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:04:15.801881 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f3271-8de5-452a-b07a-843631503755 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:15.814423 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f3271-8de5-452a-b07a-843631503755 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:15.835573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977853c-ee0a-4f7b-9d9f-182035abc774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:15.836449 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977853c-ee0a-4f7b-9d9f-182035abc774 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:15.836906 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977853c-ee0a-4f7b-9d9f-182035abc774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:15.837369 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977853c-ee0a-4f7b-9d9f-182035abc774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:15.838257 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977853c-ee0a-4f7b-9d9f-182035abc774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:15.840020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977853c-ee0a-4f7b-9d9f-182035abc774 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:15.866986 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1146/2336] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:04:15.868380 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a2bf8-fc74-42e1-8ce0-330babc3f806 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:15.882294 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a2bf8-fc74-42e1-8ce0-330babc3f806 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:15.887190 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6ccdc-dd5c-4b89-9137-ef31832be66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:15.888124 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6ccdc-dd5c-4b89-9137-ef31832be66e admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:15.888689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6ccdc-dd5c-4b89-9137-ef31832be66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:15.888983 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6ccdc-dd5c-4b89-9137-ef31832be66e admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:15.889880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6ccdc-dd5c-4b89-9137-ef31832be66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:15.891523 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6ccdc-dd5c-4b89-9137-ef31832be66e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:15.906037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1191/2337] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:04:15.909971 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977853c-ee0a-4f7b-9d9f-182035abc774 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:15.920944 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977853c-ee0a-4f7b-9d9f-182035abc774 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:15.925947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e4b55-0166-4c4e-90f3-3be8d428b807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:15.928191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e4b55-0166-4c4e-90f3-3be8d428b807 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:15.928191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e4b55-0166-4c4e-90f3-3be8d428b807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:15.928191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e4b55-0166-4c4e-90f3-3be8d428b807 admin admin] PATH_INFO: `/v3/projects/cdb5faf9dafc4de4986c6b94417020c8/users/61d3872e090142f3b725a1989b1a5016/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:15.957347 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e4b55-0166-4c4e-90f3-3be8d428b807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb5faf9dafc4de4986c6b94417020c8, user_id=61d3872e090142f3b725a1989b1a5016, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:15.960283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e4b55-0166-4c4e-90f3-3be8d428b807 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:16.044709 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1147/2338] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:04:15 2022] PUT /identity/v3/projects/cdb5faf9dafc4de4986c6b94417020c8/users/61d3872e090142f3b725a1989b1a5016/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:04:16.053800 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91275b45-943b-4997-99ca-0eec5351d246 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:16.054096 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91275b45-943b-4997-99ca-0eec5351d246 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:16.054361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91275b45-943b-4997-99ca-0eec5351d246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:16.087116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-91275b45-943b-4997-99ca-0eec5351d246 None None] MFA Rules not processed for user `61d3872e090142f3b725a1989b1a5016`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:16.088981 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-91275b45-943b-4997-99ca-0eec5351d246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:16.263483 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1192/2339] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:04:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:04:16.268139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e4b55-0166-4c4e-90f3-3be8d428b807 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:16.393550 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:16.456206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e4b55-0166-4c4e-90f3-3be8d428b807 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:16.473480 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d73260-eb17-438d-bf1f-28c456db2ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:16.474480 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d73260-eb17-438d-bf1f-28c456db2ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:16.474778 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d73260-eb17-438d-bf1f-28c456db2ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:16.475056 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d73260-eb17-438d-bf1f-28c456db2ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:16.475785 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d73260-eb17-438d-bf1f-28c456db2ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:16.481109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d73260-eb17-438d-bf1f-28c456db2ce5 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:16.754616 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1148/2340] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:04:16 2022] POST /identity/v3/projects => generated 387 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:04:16.819812 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91275b45-943b-4997-99ca-0eec5351d246 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:16.832690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91275b45-943b-4997-99ca-0eec5351d246 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:16.956606 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5736d1-cb81-4ac7-8d58-0a76b5878734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:16.956606 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5736d1-cb81-4ac7-8d58-0a76b5878734 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:16.956606 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5736d1-cb81-4ac7-8d58-0a76b5878734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:16.956606 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5736d1-cb81-4ac7-8d58-0a76b5878734 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:16.957581 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5736d1-cb81-4ac7-8d58-0a76b5878734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:16.964194 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5736d1-cb81-4ac7-8d58-0a76b5878734 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:17.716403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1193/2341] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:04:16 2022] POST /identity/v3/users => generated 300 bytes in 897 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:04:17.720495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d73260-eb17-438d-bf1f-28c456db2ce5 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:17.745004 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d73260-eb17-438d-bf1f-28c456db2ce5 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:17.763583 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8b78f-e880-454a-97ce-e85b18f68f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:17.764862 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8b78f-e880-454a-97ce-e85b18f68f25 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:17.765403 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8b78f-e880-454a-97ce-e85b18f68f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:17.765892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8b78f-e880-454a-97ce-e85b18f68f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:17.766998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8b78f-e880-454a-97ce-e85b18f68f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:17.768906 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8b78f-e880-454a-97ce-e85b18f68f25 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:17.793370 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1149/2342] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:04:17.798046 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5736d1-cb81-4ac7-8d58-0a76b5878734 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:17.813255 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5736d1-cb81-4ac7-8d58-0a76b5878734 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:17.828927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0691fd-1714-40ad-8556-c643499ba880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:17.832289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0691fd-1714-40ad-8556-c643499ba880 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:17.832289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0691fd-1714-40ad-8556-c643499ba880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:17.832289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0691fd-1714-40ad-8556-c643499ba880 admin admin] PATH_INFO: `/v3/projects/035d4d5b042342eabca13c0520bca1a8/users/5f29d02725c44c3fad016c31619550da/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:17.880747 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0691fd-1714-40ad-8556-c643499ba880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=035d4d5b042342eabca13c0520bca1a8, user_id=5f29d02725c44c3fad016c31619550da, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:17.883951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0691fd-1714-40ad-8556-c643499ba880 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:18.034047 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1194/2343] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:04:17 2022] PUT /identity/v3/projects/035d4d5b042342eabca13c0520bca1a8/users/5f29d02725c44c3fad016c31619550da/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:04:18.037587 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8b78f-e880-454a-97ce-e85b18f68f25 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:18.073252 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8b78f-e880-454a-97ce-e85b18f68f25 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:18.214116 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d825f-4c09-4850-8b3c-19662a20e6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:18.215023 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d825f-4c09-4850-8b3c-19662a20e6bf admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:18.215023 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d825f-4c09-4850-8b3c-19662a20e6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:18.215311 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d825f-4c09-4850-8b3c-19662a20e6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:18.215996 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d825f-4c09-4850-8b3c-19662a20e6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:18.220141 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d825f-4c09-4850-8b3c-19662a20e6bf admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:18.240970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1150/2344] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:04:18.244768 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0691fd-1714-40ad-8556-c643499ba880 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:18.252211 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:18.260749 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0691fd-1714-40ad-8556-c643499ba880 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:18.276949 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e598d-b2f3-48e6-a773-f7c49d516677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:18.278664 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e598d-b2f3-48e6-a773-f7c49d516677 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:18.279197 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e598d-b2f3-48e6-a773-f7c49d516677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:18.279486 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e598d-b2f3-48e6-a773-f7c49d516677 admin admin] PATH_INFO: `/v3/projects/035d4d5b042342eabca13c0520bca1a8/users/5f29d02725c44c3fad016c31619550da/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:18.281691 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e598d-b2f3-48e6-a773-f7c49d516677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=035d4d5b042342eabca13c0520bca1a8, user_id=5f29d02725c44c3fad016c31619550da, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:18.286396 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e598d-b2f3-48e6-a773-f7c49d516677 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:18.306949 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1195/2345] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:04:18 2022] PUT /identity/v3/projects/035d4d5b042342eabca13c0520bca1a8/users/5f29d02725c44c3fad016c31619550da/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:04:18.327685 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5fe35-ffb5-41e9-8c06-7f709784cb5a None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:18.327685 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5fe35-ffb5-41e9-8c06-7f709784cb5a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:18.327685 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5fe35-ffb5-41e9-8c06-7f709784cb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:18.353998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-acb5fe35-ffb5-41e9-8c06-7f709784cb5a None None] MFA Rules not processed for user `5f29d02725c44c3fad016c31619550da`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:18.356685 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-acb5fe35-ffb5-41e9-8c06-7f709784cb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:18.520966 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1151/2346] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:04:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:18.531518 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e598d-b2f3-48e6-a773-f7c49d516677 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:18.535237 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-179e598d-b2f3-48e6-a773-f7c49d516677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:18.649725 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e598d-b2f3-48e6-a773-f7c49d516677 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:18.658724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207f89a-0c7c-4654-afc8-d39d046914bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:18.659351 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207f89a-0c7c-4654-afc8-d39d046914bf service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:18.659688 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207f89a-0c7c-4654-afc8-d39d046914bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:18.660014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207f89a-0c7c-4654-afc8-d39d046914bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:18.683926 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207f89a-0c7c-4654-afc8-d39d046914bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:18.685566 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207f89a-0c7c-4654-afc8-d39d046914bf service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:18.717290 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1196/2347] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:04:18.967369 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5fe35-ffb5-41e9-8c06-7f709784cb5a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:19.088228 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:19.161821 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5fe35-ffb5-41e9-8c06-7f709784cb5a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:19.182203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4242efe-b5cb-4401-9b48-766accb3b30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:19.182851 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4242efe-b5cb-4401-9b48-766accb3b30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:19.183155 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4242efe-b5cb-4401-9b48-766accb3b30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:19.183476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4242efe-b5cb-4401-9b48-766accb3b30d admin admin] PATH_INFO: `/v3/users/61d3872e090142f3b725a1989b1a5016` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:19.185109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4242efe-b5cb-4401-9b48-766accb3b30d admin admin] RBAC: Authorizing `identity:delete_user(user_id=61d3872e090142f3b725a1989b1a5016)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:19.187103 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4242efe-b5cb-4401-9b48-766accb3b30d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:19.472884 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d4242efe-b5cb-4401-9b48-766accb3b30d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61d3872e090142f3b725a1989b1a5016'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:19.515085 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d4242efe-b5cb-4401-9b48-766accb3b30d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61d3872e090142f3b725a1989b1a5016'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:19.516132 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d4242efe-b5cb-4401-9b48-766accb3b30d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61d3872e090142f3b725a1989b1a5016'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:19.517648 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d4242efe-b5cb-4401-9b48-766accb3b30d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61d3872e090142f3b725a1989b1a5016'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:19.563169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d4242efe-b5cb-4401-9b48-766accb3b30d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61d3872e090142f3b725a1989b1a5016'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:19.655686 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d25216-679d-41c9-a247-cbe704bcfe4e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:19.656245 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d25216-679d-41c9-a247-cbe704bcfe4e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:19.656245 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d25216-679d-41c9-a247-cbe704bcfe4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:19.681536 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1152/2348] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:04:18 2022] DELETE /identity/v3/users/61d3872e090142f3b725a1989b1a5016 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:04:19.693305 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf1a95-6eb6-4eef-ab23-87612802440b None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:19.694008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf1a95-6eb6-4eef-ab23-87612802440b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:19.694008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf1a95-6eb6-4eef-ab23-87612802440b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:19.720432 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-74d25216-679d-41c9-a247-cbe704bcfe4e None None] MFA Rules not processed for user `9fec0c5afb3248d68f39cdd51c1656be`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:19.721998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-74d25216-679d-41c9-a247-cbe704bcfe4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:19.737147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-04bf1a95-6eb6-4eef-ab23-87612802440b None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:19.741887 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-04bf1a95-6eb6-4eef-ab23-87612802440b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:19.890649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1197/2349] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:04:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:04:19.911750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1153/2350] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:19.942028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d25216-679d-41c9-a247-cbe704bcfe4e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:19.944051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-74d25216-679d-41c9-a247-cbe704bcfe4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:20.096625 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d25216-679d-41c9-a247-cbe704bcfe4e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:20.117612 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5561c-da0b-4276-90ad-3f92ce0e4b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:20.121652 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5561c-da0b-4276-90ad-3f92ce0e4b58 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:20.124879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5561c-da0b-4276-90ad-3f92ce0e4b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:20.125856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5561c-da0b-4276-90ad-3f92ce0e4b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:20.152029 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5561c-da0b-4276-90ad-3f92ce0e4b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:20.155502 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5561c-da0b-4276-90ad-3f92ce0e4b58 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:20.174475 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1198/2351] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:04:20.185068 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf1a95-6eb6-4eef-ab23-87612802440b None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:20.193761 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-04bf1a95-6eb6-4eef-ab23-87612802440b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:20.365743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:20.390660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf1a95-6eb6-4eef-ab23-87612802440b None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:20.416425 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8afebd-46d5-4b03-9ada-f229b9093610 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:20.417159 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8afebd-46d5-4b03-9ada-f229b9093610 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:20.418144 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8afebd-46d5-4b03-9ada-f229b9093610 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:20.418144 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8afebd-46d5-4b03-9ada-f229b9093610 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:20.422465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4e8afebd-46d5-4b03-9ada-f229b9093610 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:20.549152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8afebd-46d5-4b03-9ada-f229b9093610 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:20.553262 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8afebd-46d5-4b03-9ada-f229b9093610 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:20.584672 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1154/2352] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:04:20.932410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5561c-da0b-4276-90ad-3f92ce0e4b58 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:20.934836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-96c5561c-da0b-4276-90ad-3f92ce0e4b58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:20.964173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5561c-da0b-4276-90ad-3f92ce0e4b58 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:20.988393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41deb0c8-b651-4658-9f0c-6e32784a2d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:20.989997 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41deb0c8-b651-4658-9f0c-6e32784a2d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:20.990371 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41deb0c8-b651-4658-9f0c-6e32784a2d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:20.991110 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41deb0c8-b651-4658-9f0c-6e32784a2d15 admin admin] PATH_INFO: `/v3/projects/cdb5faf9dafc4de4986c6b94417020c8` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:20.992524 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41deb0c8-b651-4658-9f0c-6e32784a2d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb5faf9dafc4de4986c6b94417020c8)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:20.995158 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41deb0c8-b651-4658-9f0c-6e32784a2d15 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:21.041119 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:21.159240 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-41deb0c8-b651-4658-9f0c-6e32784a2d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb5faf9dafc4de4986c6b94417020c8', 'request_id': 'req-41deb0c8-b651-4658-9f0c-6e32784a2d15'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:21.167377 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-41deb0c8-b651-4658-9f0c-6e32784a2d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb5faf9dafc4de4986c6b94417020c8', 'request_id': 'req-41deb0c8-b651-4658-9f0c-6e32784a2d15'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:21.176058 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-41deb0c8-b651-4658-9f0c-6e32784a2d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb5faf9dafc4de4986c6b94417020c8', 'request_id': 'req-41deb0c8-b651-4658-9f0c-6e32784a2d15'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:21.290673 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-41deb0c8-b651-4658-9f0c-6e32784a2d15 admin admin] The token cache is being invalidate because project cdb5faf9dafc4de4986c6b94417020c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:04:21.290976 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-41deb0c8-b651-4658-9f0c-6e32784a2d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:21.293084 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-41deb0c8-b651-4658-9f0c-6e32784a2d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:21.293351 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1199/2353] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:04:20 2022] DELETE /identity/v3/projects/cdb5faf9dafc4de4986c6b94417020c8 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:04:21.297278 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8afebd-46d5-4b03-9ada-f229b9093610 service nova] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:21.309037 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8afebd-46d5-4b03-9ada-f229b9093610 service nova] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:21.377359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816984cb-3d89-433e-b8a8-cd82a56284fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:21.381757 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816984cb-3d89-433e-b8a8-cd82a56284fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:21.381757 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816984cb-3d89-433e-b8a8-cd82a56284fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:21.381757 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816984cb-3d89-433e-b8a8-cd82a56284fb admin admin] PATH_INFO: `/v3/users/5f29d02725c44c3fad016c31619550da` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:21.381757 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816984cb-3d89-433e-b8a8-cd82a56284fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f29d02725c44c3fad016c31619550da)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:21.382526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816984cb-3d89-433e-b8a8-cd82a56284fb admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:21.595168 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-816984cb-3d89-433e-b8a8-cd82a56284fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f29d02725c44c3fad016c31619550da'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:21.603740 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-816984cb-3d89-433e-b8a8-cd82a56284fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f29d02725c44c3fad016c31619550da'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:21.604475 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-816984cb-3d89-433e-b8a8-cd82a56284fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f29d02725c44c3fad016c31619550da'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:21.605119 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-816984cb-3d89-433e-b8a8-cd82a56284fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f29d02725c44c3fad016c31619550da'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:21.620378 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-816984cb-3d89-433e-b8a8-cd82a56284fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f29d02725c44c3fad016c31619550da'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:21.734820 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1155/2354] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:04:21 2022] DELETE /identity/v3/users/5f29d02725c44c3fad016c31619550da => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:04:23.156342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41deb0c8-b651-4658-9f0c-6e32784a2d15 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:23.158115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-41deb0c8-b651-4658-9f0c-6e32784a2d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:23.191421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41deb0c8-b651-4658-9f0c-6e32784a2d15 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:23.372304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6912b60-3772-4cfa-8376-0c1b80102b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:23.373230 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912b60-3772-4cfa-8376-0c1b80102b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:23.373513 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912b60-3772-4cfa-8376-0c1b80102b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:23.373793 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912b60-3772-4cfa-8376-0c1b80102b7c admin admin] PATH_INFO: `/v3/projects/035d4d5b042342eabca13c0520bca1a8` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:23.375065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6912b60-3772-4cfa-8376-0c1b80102b7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=035d4d5b042342eabca13c0520bca1a8)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:23.377131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6912b60-3772-4cfa-8376-0c1b80102b7c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:23.544335 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e6912b60-3772-4cfa-8376-0c1b80102b7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '035d4d5b042342eabca13c0520bca1a8', 'request_id': 'req-e6912b60-3772-4cfa-8376-0c1b80102b7c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:23.550238 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e6912b60-3772-4cfa-8376-0c1b80102b7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '035d4d5b042342eabca13c0520bca1a8', 'request_id': 'req-e6912b60-3772-4cfa-8376-0c1b80102b7c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:23.556815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e6912b60-3772-4cfa-8376-0c1b80102b7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '035d4d5b042342eabca13c0520bca1a8', 'request_id': 'req-e6912b60-3772-4cfa-8376-0c1b80102b7c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:23.688235 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e6912b60-3772-4cfa-8376-0c1b80102b7c admin admin] The token cache is being invalidate because project 035d4d5b042342eabca13c0520bca1a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:04:23.694991 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e6912b60-3772-4cfa-8376-0c1b80102b7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:23.694991 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e6912b60-3772-4cfa-8376-0c1b80102b7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:23.694991 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1200/2355] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:04:23 2022] DELETE /identity/v3/projects/035d4d5b042342eabca13c0520bca1a8 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:04:23.698679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573d409-943f-4883-b235-bf601b474d4c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:23.699197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573d409-943f-4883-b235-bf601b474d4c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:23.699278 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573d409-943f-4883-b235-bf601b474d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:23.735799 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d573d409-943f-4883-b235-bf601b474d4c None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:23.737244 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d573d409-943f-4883-b235-bf601b474d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:23.744366 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:23.843006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1156/2356] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:23.851035 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384bc22-97b5-4e71-be78-7a327ee3aac2 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:23.851581 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384bc22-97b5-4e71-be78-7a327ee3aac2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:23.852048 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384bc22-97b5-4e71-be78-7a327ee3aac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:23.905439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-2384bc22-97b5-4e71-be78-7a327ee3aac2 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:23.906731 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2384bc22-97b5-4e71-be78-7a327ee3aac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:23.918326 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1201/2357] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:23.919632 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573d409-943f-4883-b235-bf601b474d4c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:23.934221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573d409-943f-4883-b235-bf601b474d4c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:23.939814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b46ee5-5858-4554-8b34-32cfa5cbea81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:23.941413 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b46ee5-5858-4554-8b34-32cfa5cbea81 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:23.941542 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b46ee5-5858-4554-8b34-32cfa5cbea81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:23.941863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b46ee5-5858-4554-8b34-32cfa5cbea81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:23.942626 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b46ee5-5858-4554-8b34-32cfa5cbea81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:04:23.943037 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b46ee5-5858-4554-8b34-32cfa5cbea81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:23.945077 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b46ee5-5858-4554-8b34-32cfa5cbea81 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:23.962071 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1157/2358] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 13:04:23.967674 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384bc22-97b5-4e71-be78-7a327ee3aac2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:23.978003 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384bc22-97b5-4e71-be78-7a327ee3aac2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:23.983118 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b4c46-ae69-46f7-aa85-60ba0db8ec2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:23.985232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b4c46-ae69-46f7-aa85-60ba0db8ec2e admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:23.985232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b4c46-ae69-46f7-aa85-60ba0db8ec2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:23.985232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b4c46-ae69-46f7-aa85-60ba0db8ec2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:23.985232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b4c46-ae69-46f7-aa85-60ba0db8ec2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:23.987217 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b4c46-ae69-46f7-aa85-60ba0db8ec2e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:24.084474 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1202/2359] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:04:23 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:04:24.088480 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b46ee5-5858-4554-8b34-32cfa5cbea81 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:24.099561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b46ee5-5858-4554-8b34-32cfa5cbea81 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:24.177323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86ed03-b545-4692-b83a-ba0b293ec050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:24.180257 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86ed03-b545-4692-b83a-ba0b293ec050 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:24.180702 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86ed03-b545-4692-b83a-ba0b293ec050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:24.181049 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86ed03-b545-4692-b83a-ba0b293ec050 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:24.181849 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86ed03-b545-4692-b83a-ba0b293ec050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:24.184085 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86ed03-b545-4692-b83a-ba0b293ec050 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:24.299567 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1158/2360] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:04:24 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:04:24.304430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b4c46-ae69-46f7-aa85-60ba0db8ec2e admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:24.320035 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b4c46-ae69-46f7-aa85-60ba0db8ec2e admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:24.328308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea6b57-45f7-45f6-bb15-dba36956f805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:24.329378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea6b57-45f7-45f6-bb15-dba36956f805 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:24.329778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea6b57-45f7-45f6-bb15-dba36956f805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:24.330304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea6b57-45f7-45f6-bb15-dba36956f805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:24.331255 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea6b57-45f7-45f6-bb15-dba36956f805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:24.334018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea6b57-45f7-45f6-bb15-dba36956f805 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:24.336089 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:24.351180 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1203/2361] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:04:24.356211 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86ed03-b545-4692-b83a-ba0b293ec050 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:24.371468 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86ed03-b545-4692-b83a-ba0b293ec050 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:24.376378 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1f44d-dfa4-4d4e-ab9d-4f09935c88b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:24.377152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1f44d-dfa4-4d4e-ab9d-4f09935c88b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:24.377437 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1f44d-dfa4-4d4e-ab9d-4f09935c88b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:24.377714 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1f44d-dfa4-4d4e-ab9d-4f09935c88b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:24.378566 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1f44d-dfa4-4d4e-ab9d-4f09935c88b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:24.380180 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1f44d-dfa4-4d4e-ab9d-4f09935c88b8 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:24.392805 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1159/2362] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:04:24.395318 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea6b57-45f7-45f6-bb15-dba36956f805 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:24.405989 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea6b57-45f7-45f6-bb15-dba36956f805 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:24.411147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9af99c-cc46-4418-a5f6-c6808de8eee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:24.412095 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9af99c-cc46-4418-a5f6-c6808de8eee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:24.412843 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9af99c-cc46-4418-a5f6-c6808de8eee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:24.412843 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9af99c-cc46-4418-a5f6-c6808de8eee5 admin admin] PATH_INFO: `/v3/projects/d85b847979fd432882c137fc8b76a096/users/dfda37aa186245ebab3582e5261f5e61/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:24.428237 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9af99c-cc46-4418-a5f6-c6808de8eee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85b847979fd432882c137fc8b76a096, user_id=dfda37aa186245ebab3582e5261f5e61, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:24.430903 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9af99c-cc46-4418-a5f6-c6808de8eee5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:24.505904 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1204/2363] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:04:24 2022] PUT /identity/v3/projects/d85b847979fd432882c137fc8b76a096/users/dfda37aa186245ebab3582e5261f5e61/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:04:24.511241 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fdd50-92b6-44e5-8239-06ab35db3f06 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:24.511757 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fdd50-92b6-44e5-8239-06ab35db3f06 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:24.512051 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fdd50-92b6-44e5-8239-06ab35db3f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:24.538424 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-876fdd50-92b6-44e5-8239-06ab35db3f06 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:24.540530 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-876fdd50-92b6-44e5-8239-06ab35db3f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:24.608610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1160/2364] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:24.618992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9af99c-cc46-4418-a5f6-c6808de8eee5 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:24.620759 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ef9af99c-cc46-4418-a5f6-c6808de8eee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:24.683246 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9af99c-cc46-4418-a5f6-c6808de8eee5 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:24.687104 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fc13b-b150-4d8b-bedc-a60f86568d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:24.687777 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fc13b-b150-4d8b-bedc-a60f86568d32 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:24.688066 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fc13b-b150-4d8b-bedc-a60f86568d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:24.688346 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fc13b-b150-4d8b-bedc-a60f86568d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:24.698334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fc13b-b150-4d8b-bedc-a60f86568d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:24.699787 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fc13b-b150-4d8b-bedc-a60f86568d32 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:24.710061 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1205/2365] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:04:24.750313 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fdd50-92b6-44e5-8239-06ab35db3f06 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:24.760155 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fdd50-92b6-44e5-8239-06ab35db3f06 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:24.764164 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564a69a-8f19-4ee1-8ae6-26a797405f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:24.764932 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564a69a-8f19-4ee1-8ae6-26a797405f1e service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:24.765216 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564a69a-8f19-4ee1-8ae6-26a797405f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:24.765541 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564a69a-8f19-4ee1-8ae6-26a797405f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:24.767323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9564a69a-8f19-4ee1-8ae6-26a797405f1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:24.830484 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564a69a-8f19-4ee1-8ae6-26a797405f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:24.832426 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564a69a-8f19-4ee1-8ae6-26a797405f1e service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:24.842661 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1161/2366] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:24 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:04:24.893446 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:26.711230 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb83cf-7aa5-4d51-85a1-09486964c2cd None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:26.711725 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb83cf-7aa5-4d51-85a1-09486964c2cd None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:26.711839 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb83cf-7aa5-4d51-85a1-09486964c2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:26.742616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-3dfb83cf-7aa5-4d51-85a1-09486964c2cd None None] MFA Rules not processed for user `dfda37aa186245ebab3582e5261f5e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:26.743999 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3dfb83cf-7aa5-4d51-85a1-09486964c2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:26.823502 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564a69a-8f19-4ee1-8ae6-26a797405f1e service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:26.825276 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1206/2367] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:04:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:26.835872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564a69a-8f19-4ee1-8ae6-26a797405f1e service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:26.840521 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df156c2-3908-4b9a-93af-6ff4d11717ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:26.841320 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df156c2-3908-4b9a-93af-6ff4d11717ff admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:26.841709 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df156c2-3908-4b9a-93af-6ff4d11717ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:26.842119 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df156c2-3908-4b9a-93af-6ff4d11717ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:26.842958 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df156c2-3908-4b9a-93af-6ff4d11717ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:26.845047 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df156c2-3908-4b9a-93af-6ff4d11717ff admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:26.930538 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1162/2368] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:04:26 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:04:26.935080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb83cf-7aa5-4d51-85a1-09486964c2cd None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:26.949827 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb83cf-7aa5-4d51-85a1-09486964c2cd None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:27.055560 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b020d87-5447-4278-a6b4-9323a2da061e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:27.055560 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b020d87-5447-4278-a6b4-9323a2da061e admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:27.055560 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b020d87-5447-4278-a6b4-9323a2da061e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:27.055560 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b020d87-5447-4278-a6b4-9323a2da061e admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:27.056003 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b020d87-5447-4278-a6b4-9323a2da061e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:27.056003 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b020d87-5447-4278-a6b4-9323a2da061e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:27.061942 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:27.159124 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1207/2369] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:04:26 2022] POST /identity/v3/users => generated 292 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:04:27.160293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df156c2-3908-4b9a-93af-6ff4d11717ff admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:27.170548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df156c2-3908-4b9a-93af-6ff4d11717ff admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:27.175068 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3cefd-c04a-43f5-b6a2-1e1d1f810494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:27.175723 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3cefd-c04a-43f5-b6a2-1e1d1f810494 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:27.176090 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3cefd-c04a-43f5-b6a2-1e1d1f810494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:27.176387 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3cefd-c04a-43f5-b6a2-1e1d1f810494 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:27.177241 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3cefd-c04a-43f5-b6a2-1e1d1f810494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:27.178850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3cefd-c04a-43f5-b6a2-1e1d1f810494 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:27.193248 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1163/2370] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:04:27.194512 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b020d87-5447-4278-a6b4-9323a2da061e admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:27.204569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b020d87-5447-4278-a6b4-9323a2da061e admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:27.210018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743c618-0aa8-479a-b389-8e5776db2b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:27.211148 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743c618-0aa8-479a-b389-8e5776db2b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:27.211582 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743c618-0aa8-479a-b389-8e5776db2b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:27.213837 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743c618-0aa8-479a-b389-8e5776db2b4b admin admin] PATH_INFO: `/v3/projects/3f33a00929e84ba6bfdb383ab01d143b/users/02ac67ad455e437faca868d57c5c0c61/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:27.229918 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743c618-0aa8-479a-b389-8e5776db2b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f33a00929e84ba6bfdb383ab01d143b, user_id=02ac67ad455e437faca868d57c5c0c61, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:27.232873 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743c618-0aa8-479a-b389-8e5776db2b4b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:27.346109 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1208/2371] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:04:27 2022] PUT /identity/v3/projects/3f33a00929e84ba6bfdb383ab01d143b/users/02ac67ad455e437faca868d57c5c0c61/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:04:27.346866 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3cefd-c04a-43f5-b6a2-1e1d1f810494 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:27.359440 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3cefd-c04a-43f5-b6a2-1e1d1f810494 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:27.427029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bb047-4fb8-4d62-97d6-283339e5da1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:27.427029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bb047-4fb8-4d62-97d6-283339e5da1b admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:27.427029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bb047-4fb8-4d62-97d6-283339e5da1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:27.427029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bb047-4fb8-4d62-97d6-283339e5da1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:27.427392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bb047-4fb8-4d62-97d6-283339e5da1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:27.427392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bb047-4fb8-4d62-97d6-283339e5da1b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:27.439949 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1164/2372] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:04:27.445562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743c618-0aa8-479a-b389-8e5776db2b4b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:27.459902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743c618-0aa8-479a-b389-8e5776db2b4b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:27.467681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a54f73-ac41-430e-884a-09caa3bcb943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:27.468976 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a54f73-ac41-430e-884a-09caa3bcb943 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:27.469592 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a54f73-ac41-430e-884a-09caa3bcb943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:27.469949 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a54f73-ac41-430e-884a-09caa3bcb943 admin admin] PATH_INFO: `/v3/projects/3f33a00929e84ba6bfdb383ab01d143b/users/02ac67ad455e437faca868d57c5c0c61/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:27.472216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a54f73-ac41-430e-884a-09caa3bcb943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f33a00929e84ba6bfdb383ab01d143b, user_id=02ac67ad455e437faca868d57c5c0c61, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:27.476671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a54f73-ac41-430e-884a-09caa3bcb943 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:27.509067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1209/2373] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:04:27 2022] PUT /identity/v3/projects/3f33a00929e84ba6bfdb383ab01d143b/users/02ac67ad455e437faca868d57c5c0c61/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:04:29.231257 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032049e-ea87-4eed-9448-5e5edf97dd7f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:29.233094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032049e-ea87-4eed-9448-5e5edf97dd7f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:29.233094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032049e-ea87-4eed-9448-5e5edf97dd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:29.268199 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-5032049e-ea87-4eed-9448-5e5edf97dd7f None None] MFA Rules not processed for user `02ac67ad455e437faca868d57c5c0c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:29.270359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5032049e-ea87-4eed-9448-5e5edf97dd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:29.353109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:29.358017 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1165/2374] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:04:29 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:29.368199 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a54f73-ac41-430e-884a-09caa3bcb943 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:29.371749 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-86a54f73-ac41-430e-884a-09caa3bcb943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:29.440297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a54f73-ac41-430e-884a-09caa3bcb943 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:29.444637 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122064bf-cf56-46f3-bdeb-f24289effcf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:29.445322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122064bf-cf56-46f3-bdeb-f24289effcf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:29.445605 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122064bf-cf56-46f3-bdeb-f24289effcf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:29.445906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122064bf-cf56-46f3-bdeb-f24289effcf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:29.512956 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122064bf-cf56-46f3-bdeb-f24289effcf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:29.514529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122064bf-cf56-46f3-bdeb-f24289effcf4 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:29.524444 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1210/2375] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:04:32.427904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032049e-ea87-4eed-9448-5e5edf97dd7f None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:32.437780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032049e-ea87-4eed-9448-5e5edf97dd7f None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:32.441841 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882ba4b-a9c2-4095-a502-0caafd812bcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:32.447617 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882ba4b-a9c2-4095-a502-0caafd812bcf service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:32.447617 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882ba4b-a9c2-4095-a502-0caafd812bcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:32.447617 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882ba4b-a9c2-4095-a502-0caafd812bcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:32.451901 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882ba4b-a9c2-4095-a502-0caafd812bcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:32.453368 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882ba4b-a9c2-4095-a502-0caafd812bcf service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:32.463333 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1166/2376] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:32 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:04:33.118778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d86c5-74bd-4e35-b4ac-a47ba5601c56 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:33.118778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d86c5-74bd-4e35-b4ac-a47ba5601c56 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:33.118778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d86c5-74bd-4e35-b4ac-a47ba5601c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:33.136033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-8d1d86c5-74bd-4e35-b4ac-a47ba5601c56 None None] MFA Rules not processed for user `ab47c91ba7854bc09f656607dbb41cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:33.137355 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8d1d86c5-74bd-4e35-b4ac-a47ba5601c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:33.195190 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1211/2377] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jul 5 13:04:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:33.207179 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882ba4b-a9c2-4095-a502-0caafd812bcf service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:33.208571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8882ba4b-a9c2-4095-a502-0caafd812bcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:33.286822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882ba4b-a9c2-4095-a502-0caafd812bcf service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:33.292061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1645cf1-dbc7-4a9d-ada5-85232683044c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fb7db02f8e945a7af39cb30c3d606f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:33.292773 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1645cf1-dbc7-4a9d-ada5-85232683044c service swift] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:33.293061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1645cf1-dbc7-4a9d-ada5-85232683044c service swift] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:33.293341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1645cf1-dbc7-4a9d-ada5-85232683044c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:33.302823 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1645cf1-dbc7-4a9d-ada5-85232683044c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:33.304432 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1645cf1-dbc7-4a9d-ada5-85232683044c service swift] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:33.312757 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1167/2378] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jul 5 13:04:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 13:04:43.188125 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:INSERT=3,keystone:SELECT=90 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:43.309466 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=38 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:45.387199 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54ec4e-54b4-447b-8e12-e3f0dae7dd2b None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:45.387906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54ec4e-54b4-447b-8e12-e3f0dae7dd2b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:45.387906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54ec4e-54b4-447b-8e12-e3f0dae7dd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:45.409629 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-3d54ec4e-54b4-447b-8e12-e3f0dae7dd2b None None] MFA Rules not processed for user `ab47c91ba7854bc09f656607dbb41cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:45.411246 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3d54ec4e-54b4-447b-8e12-e3f0dae7dd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:45.424972 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1212/2379] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jul 5 13:04:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:45.444882 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1645cf1-dbc7-4a9d-ada5-85232683044c service swift] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:45.459704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1645cf1-dbc7-4a9d-ada5-85232683044c service swift] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:45.466910 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cbe56-145e-409f-abc2-996ea907bf88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fb7db02f8e945a7af39cb30c3d606f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:45.469424 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cbe56-145e-409f-abc2-996ea907bf88 service swift] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:45.469424 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cbe56-145e-409f-abc2-996ea907bf88 service swift] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:45.469424 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cbe56-145e-409f-abc2-996ea907bf88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:45.480768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cbe56-145e-409f-abc2-996ea907bf88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:45.482739 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cbe56-145e-409f-abc2-996ea907bf88 service swift] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:45.494911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1168/2380] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jul 5 13:04:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:04:49.839903 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67565538-50db-4fba-9f82-aa1ec91aa668 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:49.840506 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67565538-50db-4fba-9f82-aa1ec91aa668 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:49.840506 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67565538-50db-4fba-9f82-aa1ec91aa668 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:49.841909 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1213/2381] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jul 5 13:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 13:04:49.850538 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971ef2c-bfb8-43b5-aff0-00e6fbf5db10 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:49.851378 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971ef2c-bfb8-43b5-aff0-00e6fbf5db10 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:49.851378 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971ef2c-bfb8-43b5-aff0-00e6fbf5db10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:49.926104 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f971ef2c-bfb8-43b5-aff0-00e6fbf5db10 None None] MFA Rules not processed for user `43b85b5c7b1e4d73b29fb96f4fa6db71`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:49.927360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f971ef2c-bfb8-43b5-aff0-00e6fbf5db10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:50.044400 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1169/2382] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jul 5 13:04:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:04:50.129404 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67565538-50db-4fba-9f82-aa1ec91aa668 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:50.131647 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-67565538-50db-4fba-9f82-aa1ec91aa668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:50.155586 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67565538-50db-4fba-9f82-aa1ec91aa668 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:50.162083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1cc88-1367-4a8e-b9cc-f82ea28e9f07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43b85b5c7b1e4d73b29fb96f4fa6db71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:50.164056 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1cc88-1367-4a8e-b9cc-f82ea28e9f07 service placement] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:50.165129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1cc88-1367-4a8e-b9cc-f82ea28e9f07 service placement] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:50.165693 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1cc88-1367-4a8e-b9cc-f82ea28e9f07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:50.177287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1cc88-1367-4a8e-b9cc-f82ea28e9f07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:50.179407 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1cc88-1367-4a8e-b9cc-f82ea28e9f07 service placement] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:50.203826 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1214/2383] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:04:50.969541 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971ef2c-bfb8-43b5-aff0-00e6fbf5db10 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:51.069811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971ef2c-bfb8-43b5-aff0-00e6fbf5db10 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:51.075172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce2b73-84ba-4ae4-83a0-c78518d21a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:51.075529 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce2b73-84ba-4ae4-83a0-c78518d21a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:51.075808 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce2b73-84ba-4ae4-83a0-c78518d21a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:51.076094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce2b73-84ba-4ae4-83a0-c78518d21a43 admin admin] PATH_INFO: `/v3/users/dfda37aa186245ebab3582e5261f5e61` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:51.077432 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce2b73-84ba-4ae4-83a0-c78518d21a43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfda37aa186245ebab3582e5261f5e61)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:51.079336 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce2b73-84ba-4ae4-83a0-c78518d21a43 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:51.446324 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-10ce2b73-84ba-4ae4-83a0-c78518d21a43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfda37aa186245ebab3582e5261f5e61'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:51.459720 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-10ce2b73-84ba-4ae4-83a0-c78518d21a43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfda37aa186245ebab3582e5261f5e61'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:51.460458 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-10ce2b73-84ba-4ae4-83a0-c78518d21a43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfda37aa186245ebab3582e5261f5e61'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:51.461121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-10ce2b73-84ba-4ae4-83a0-c78518d21a43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfda37aa186245ebab3582e5261f5e61'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:51.477447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:51.480341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-10ce2b73-84ba-4ae4-83a0-c78518d21a43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfda37aa186245ebab3582e5261f5e61'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:51.557156 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1170/2384] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:04:50 2022] DELETE /identity/v3/users/dfda37aa186245ebab3582e5261f5e61 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:04:51.991081 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1cc88-1367-4a8e-b9cc-f82ea28e9f07 service placement] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:52.004120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1cc88-1367-4a8e-b9cc-f82ea28e9f07 service placement] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:52.096049 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c9e8a-b582-4465-8b28-9bd2e2a040b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:52.097599 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c9e8a-b582-4465-8b28-9bd2e2a040b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:52.098298 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c9e8a-b582-4465-8b28-9bd2e2a040b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:52.099311 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c9e8a-b582-4465-8b28-9bd2e2a040b7 admin admin] PATH_INFO: `/v3/projects/d85b847979fd432882c137fc8b76a096` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:52.101276 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c9e8a-b582-4465-8b28-9bd2e2a040b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85b847979fd432882c137fc8b76a096)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:52.106911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c9e8a-b582-4465-8b28-9bd2e2a040b7 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:52.233305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1e7c9e8a-b582-4465-8b28-9bd2e2a040b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85b847979fd432882c137fc8b76a096', 'request_id': 'req-1e7c9e8a-b582-4465-8b28-9bd2e2a040b7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:52.244561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1e7c9e8a-b582-4465-8b28-9bd2e2a040b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85b847979fd432882c137fc8b76a096', 'request_id': 'req-1e7c9e8a-b582-4465-8b28-9bd2e2a040b7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:52.261017 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1e7c9e8a-b582-4465-8b28-9bd2e2a040b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85b847979fd432882c137fc8b76a096', 'request_id': 'req-1e7c9e8a-b582-4465-8b28-9bd2e2a040b7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:52.352142 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1e7c9e8a-b582-4465-8b28-9bd2e2a040b7 admin admin] The token cache is being invalidate because project d85b847979fd432882c137fc8b76a096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:04:52.352455 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1e7c9e8a-b582-4465-8b28-9bd2e2a040b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:52.353517 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1e7c9e8a-b582-4465-8b28-9bd2e2a040b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:52.358303 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1215/2385] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:04:51 2022] DELETE /identity/v3/projects/d85b847979fd432882c137fc8b76a096 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:04:52.359692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce2b73-84ba-4ae4-83a0-c78518d21a43 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:52.361237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-10ce2b73-84ba-4ae4-83a0-c78518d21a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:52.380245 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce2b73-84ba-4ae4-83a0-c78518d21a43 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:52.491951 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c56b7-529c-4ed5-8e63-914c75b91a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:52.493399 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c56b7-529c-4ed5-8e63-914c75b91a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:52.493805 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c56b7-529c-4ed5-8e63-914c75b91a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:52.494173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c56b7-529c-4ed5-8e63-914c75b91a52 admin admin] PATH_INFO: `/v3/users/02ac67ad455e437faca868d57c5c0c61` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:52.497908 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c56b7-529c-4ed5-8e63-914c75b91a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02ac67ad455e437faca868d57c5c0c61)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:52.499303 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c56b7-529c-4ed5-8e63-914c75b91a52 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:52.731760 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-419c56b7-529c-4ed5-8e63-914c75b91a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02ac67ad455e437faca868d57c5c0c61'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:52.741307 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-419c56b7-529c-4ed5-8e63-914c75b91a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02ac67ad455e437faca868d57c5c0c61'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:52.742218 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-419c56b7-529c-4ed5-8e63-914c75b91a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02ac67ad455e437faca868d57c5c0c61'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:52.742939 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-419c56b7-529c-4ed5-8e63-914c75b91a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02ac67ad455e437faca868d57c5c0c61'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:52.767666 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-419c56b7-529c-4ed5-8e63-914c75b91a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02ac67ad455e437faca868d57c5c0c61'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:52.856377 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1171/2386] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:04:52 2022] DELETE /identity/v3/users/02ac67ad455e437faca868d57c5c0c61 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:04:53.085415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff91a39-94f8-4e6c-9fb8-c088fe1e097f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:53.086043 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff91a39-94f8-4e6c-9fb8-c088fe1e097f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:53.086333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff91a39-94f8-4e6c-9fb8-c088fe1e097f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:53.117214 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-9ff91a39-94f8-4e6c-9fb8-c088fe1e097f None None] MFA Rules not processed for user `661062780f5c45d180a05e402fc7bc27`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:53.118757 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9ff91a39-94f8-4e6c-9fb8-c088fe1e097f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:53.222750 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1216/2387] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:04:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:53.303123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c56b7-529c-4ed5-8e63-914c75b91a52 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:53.306385 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-419c56b7-529c-4ed5-8e63-914c75b91a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:53.402374 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c56b7-529c-4ed5-8e63-914c75b91a52 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:53.408299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc9095-b0d8-4606-b4be-af9f357b6b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:53.410246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc9095-b0d8-4606-b4be-af9f357b6b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:53.410614 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc9095-b0d8-4606-b4be-af9f357b6b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:53.410984 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc9095-b0d8-4606-b4be-af9f357b6b42 admin admin] PATH_INFO: `/v3/projects/3f33a00929e84ba6bfdb383ab01d143b` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:53.416453 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc9095-b0d8-4606-b4be-af9f357b6b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f33a00929e84ba6bfdb383ab01d143b)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:53.418550 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc9095-b0d8-4606-b4be-af9f357b6b42 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:53.431019 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:53.557070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fdcc9095-b0d8-4606-b4be-af9f357b6b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f33a00929e84ba6bfdb383ab01d143b', 'request_id': 'req-fdcc9095-b0d8-4606-b4be-af9f357b6b42'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:53.652322 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fdcc9095-b0d8-4606-b4be-af9f357b6b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f33a00929e84ba6bfdb383ab01d143b', 'request_id': 'req-fdcc9095-b0d8-4606-b4be-af9f357b6b42'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:53.661177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fdcc9095-b0d8-4606-b4be-af9f357b6b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f33a00929e84ba6bfdb383ab01d143b', 'request_id': 'req-fdcc9095-b0d8-4606-b4be-af9f357b6b42'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:53.680785 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fdcc9095-b0d8-4606-b4be-af9f357b6b42 admin admin] The token cache is being invalidate because project 3f33a00929e84ba6bfdb383ab01d143b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:04:53.681305 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fdcc9095-b0d8-4606-b4be-af9f357b6b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:53.682705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fdcc9095-b0d8-4606-b4be-af9f357b6b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:04:53.687792 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1172/2388] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:04:53 2022] DELETE /identity/v3/projects/3f33a00929e84ba6bfdb383ab01d143b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:04:53.692186 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c90f49-2c8e-4504-834b-1324b13dc51b None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:53.695735 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c90f49-2c8e-4504-834b-1324b13dc51b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:53.695735 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c90f49-2c8e-4504-834b-1324b13dc51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:53.719347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-e2c90f49-2c8e-4504-834b-1324b13dc51b None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:53.720663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e2c90f49-2c8e-4504-834b-1324b13dc51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:53.743038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:53.834177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1217/2389] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:04:53.845220 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c6a61-02f1-464c-9451-701f816c29b0 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:53.845696 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c6a61-02f1-464c-9451-701f816c29b0 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:53.846103 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c6a61-02f1-464c-9451-701f816c29b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:53.867224 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-337c6a61-02f1-464c-9451-701f816c29b0 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:53.868860 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-337c6a61-02f1-464c-9451-701f816c29b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:53.881536 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1173/2390] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:53.882796 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c90f49-2c8e-4504-834b-1324b13dc51b None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:53.898155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c90f49-2c8e-4504-834b-1324b13dc51b None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:53.904782 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faff81-07bf-400b-9c0a-d8c5c60caafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:53.905679 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faff81-07bf-400b-9c0a-d8c5c60caafb admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:53.906166 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faff81-07bf-400b-9c0a-d8c5c60caafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:53.907018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faff81-07bf-400b-9c0a-d8c5c60caafb admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:53.907798 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04faff81-07bf-400b-9c0a-d8c5c60caafb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:04:53.908518 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04faff81-07bf-400b-9c0a-d8c5c60caafb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:53.910635 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04faff81-07bf-400b-9c0a-d8c5c60caafb admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:53.936679 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1218/2391] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:04:53.940739 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c6a61-02f1-464c-9451-701f816c29b0 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:53.964522 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c6a61-02f1-464c-9451-701f816c29b0 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:53.982378 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bed758-8972-4e6d-b0ad-37b1ded9614b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:53.982986 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bed758-8972-4e6d-b0ad-37b1ded9614b admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:53.983419 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bed758-8972-4e6d-b0ad-37b1ded9614b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:53.983621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bed758-8972-4e6d-b0ad-37b1ded9614b admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:53.984376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bed758-8972-4e6d-b0ad-37b1ded9614b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:53.986353 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bed758-8972-4e6d-b0ad-37b1ded9614b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:54.114521 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1174/2392] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:04:53 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:04:54.122372 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faff81-07bf-400b-9c0a-d8c5c60caafb admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:54.154400 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faff81-07bf-400b-9c0a-d8c5c60caafb admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:54.252127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae370854-50d8-491b-8e16-72404c02ec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:54.252961 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae370854-50d8-491b-8e16-72404c02ec8c admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:54.253313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae370854-50d8-491b-8e16-72404c02ec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:54.253677 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae370854-50d8-491b-8e16-72404c02ec8c admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:54.254697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae370854-50d8-491b-8e16-72404c02ec8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:54.256945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae370854-50d8-491b-8e16-72404c02ec8c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:54.357366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1219/2393] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:04:54 2022] POST /identity/v3/users => generated 288 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:04:54.361414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bed758-8972-4e6d-b0ad-37b1ded9614b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:54.386272 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bed758-8972-4e6d-b0ad-37b1ded9614b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:54.394235 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1911c-5f39-410d-bb47-326db20dcc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:54.394989 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1911c-5f39-410d-bb47-326db20dcc82 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:54.395439 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1911c-5f39-410d-bb47-326db20dcc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:54.395885 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1911c-5f39-410d-bb47-326db20dcc82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:54.397169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1911c-5f39-410d-bb47-326db20dcc82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:54.399396 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1911c-5f39-410d-bb47-326db20dcc82 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:54.423873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1175/2394] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:04:54.429972 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae370854-50d8-491b-8e16-72404c02ec8c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:54.443467 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae370854-50d8-491b-8e16-72404c02ec8c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:54.451744 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e8b8e-0985-4e86-8b26-5bd931c6ab9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:54.454198 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e8b8e-0985-4e86-8b26-5bd931c6ab9c admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:54.454198 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e8b8e-0985-4e86-8b26-5bd931c6ab9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:54.454198 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e8b8e-0985-4e86-8b26-5bd931c6ab9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:54.454889 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e8b8e-0985-4e86-8b26-5bd931c6ab9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:54.456936 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e8b8e-0985-4e86-8b26-5bd931c6ab9c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:54.473732 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1911c-5f39-410d-bb47-326db20dcc82 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:54.487536 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1220/2395] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:04:54.489200 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1911c-5f39-410d-bb47-326db20dcc82 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:54.495295 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6535cf-906a-4295-a912-3c2a72047a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:54.496452 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6535cf-906a-4295-a912-3c2a72047a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:54.497041 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6535cf-906a-4295-a912-3c2a72047a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:54.497510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6535cf-906a-4295-a912-3c2a72047a17 admin admin] PATH_INFO: `/v3/projects/beb233d6f43d470f97c9c7fbeccbc9df/users/1bf96bda9a6a47479142f35cc0c81db5/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:54.540403 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6535cf-906a-4295-a912-3c2a72047a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb233d6f43d470f97c9c7fbeccbc9df, user_id=1bf96bda9a6a47479142f35cc0c81db5, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:54.544756 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6535cf-906a-4295-a912-3c2a72047a17 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:54.634569 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1176/2396] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:04:54 2022] PUT /identity/v3/projects/beb233d6f43d470f97c9c7fbeccbc9df/users/1bf96bda9a6a47479142f35cc0c81db5/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:04:54.645661 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7448d3-1dfa-4e96-99de-24f37f026a39 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:54.646054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7448d3-1dfa-4e96-99de-24f37f026a39 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:54.646412 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7448d3-1dfa-4e96-99de-24f37f026a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:54.684766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-0f7448d3-1dfa-4e96-99de-24f37f026a39 None None] MFA Rules not processed for user `1bf96bda9a6a47479142f35cc0c81db5`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:54.686184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0f7448d3-1dfa-4e96-99de-24f37f026a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:54.779393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1221/2397] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:04:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:54.784208 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6535cf-906a-4295-a912-3c2a72047a17 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:54.904933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6535cf-906a-4295-a912-3c2a72047a17 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:54.912912 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d2250-458c-45bb-9d4f-b102e8afcd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:54.916519 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d2250-458c-45bb-9d4f-b102e8afcd99 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:54.916837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d2250-458c-45bb-9d4f-b102e8afcd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:54.917255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d2250-458c-45bb-9d4f-b102e8afcd99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:54.918072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d2250-458c-45bb-9d4f-b102e8afcd99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:54.922472 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d2250-458c-45bb-9d4f-b102e8afcd99 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:54.995903 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1177/2398] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:04:54 2022] POST /identity/v3/projects => generated 377 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:04:55.000009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7448d3-1dfa-4e96-99de-24f37f026a39 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:55.015791 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7448d3-1dfa-4e96-99de-24f37f026a39 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:55.026589 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:55.096544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac99023-fc79-4a9c-b1e0-da603542a4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:55.097274 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac99023-fc79-4a9c-b1e0-da603542a4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:55.097588 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac99023-fc79-4a9c-b1e0-da603542a4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:55.097833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac99023-fc79-4a9c-b1e0-da603542a4b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:55.098608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac99023-fc79-4a9c-b1e0-da603542a4b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:55.100663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac99023-fc79-4a9c-b1e0-da603542a4b1 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:55.175114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1222/2399] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:04:54 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:04:55.179181 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d2250-458c-45bb-9d4f-b102e8afcd99 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:55.192400 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d2250-458c-45bb-9d4f-b102e8afcd99 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:55.198245 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a704554-e8a5-4936-b4b9-e7c3c14e6fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:55.198954 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a704554-e8a5-4936-b4b9-e7c3c14e6fea admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:55.199251 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a704554-e8a5-4936-b4b9-e7c3c14e6fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:55.199559 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a704554-e8a5-4936-b4b9-e7c3c14e6fea admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:55.200502 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a704554-e8a5-4936-b4b9-e7c3c14e6fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:55.202212 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a704554-e8a5-4936-b4b9-e7c3c14e6fea admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:55.214561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1178/2400] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:04:55.218609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac99023-fc79-4a9c-b1e0-da603542a4b1 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:55.233032 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac99023-fc79-4a9c-b1e0-da603542a4b1 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:55.239840 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462a23e-d236-43da-8daa-bd3941c0abac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:55.239840 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462a23e-d236-43da-8daa-bd3941c0abac admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:55.242764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462a23e-d236-43da-8daa-bd3941c0abac admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:55.242764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462a23e-d236-43da-8daa-bd3941c0abac admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:55.242764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462a23e-d236-43da-8daa-bd3941c0abac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:55.243839 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462a23e-d236-43da-8daa-bd3941c0abac admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:55.274285 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1223/2401] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:04:55.280504 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a704554-e8a5-4936-b4b9-e7c3c14e6fea admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:55.290828 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a704554-e8a5-4936-b4b9-e7c3c14e6fea admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:55.295443 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b4e93-9f66-408a-96ce-59ae82b16cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:55.296299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b4e93-9f66-408a-96ce-59ae82b16cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:55.296601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b4e93-9f66-408a-96ce-59ae82b16cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:55.296893 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b4e93-9f66-408a-96ce-59ae82b16cd6 admin admin] PATH_INFO: `/v3/projects/249c02ff335d44e0a4f58e6ab801ae82/users/5e2af3d5cb4b4637be84c04c8a992bfc/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:55.300426 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:55.313273 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b4e93-9f66-408a-96ce-59ae82b16cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=249c02ff335d44e0a4f58e6ab801ae82, user_id=5e2af3d5cb4b4637be84c04c8a992bfc, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:55.316536 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b4e93-9f66-408a-96ce-59ae82b16cd6 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:55.409141 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1179/2402] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:04:55 2022] PUT /identity/v3/projects/249c02ff335d44e0a4f58e6ab801ae82/users/5e2af3d5cb4b4637be84c04c8a992bfc/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:04:55.419474 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879ecc2-bbf1-4fde-bbff-6f51634dc120 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:55.419773 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879ecc2-bbf1-4fde-bbff-6f51634dc120 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:55.420125 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879ecc2-bbf1-4fde-bbff-6f51634dc120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:55.483229 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a879ecc2-bbf1-4fde-bbff-6f51634dc120 None None] MFA Rules not processed for user `5e2af3d5cb4b4637be84c04c8a992bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:55.485052 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a879ecc2-bbf1-4fde-bbff-6f51634dc120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:55.564641 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1224/2403] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:04:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:55.568566 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b4e93-9f66-408a-96ce-59ae82b16cd6 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:55.666811 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b4e93-9f66-408a-96ce-59ae82b16cd6 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:55.672035 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c3301-bf72-474a-ae69-0b0868d8c2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:55.672699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c3301-bf72-474a-ae69-0b0868d8c2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:55.672988 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c3301-bf72-474a-ae69-0b0868d8c2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:55.673402 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c3301-bf72-474a-ae69-0b0868d8c2a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:55.674679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c3301-bf72-474a-ae69-0b0868d8c2a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:55.676645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c3301-bf72-474a-ae69-0b0868d8c2a6 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:55.792459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1180/2404] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:04:55 2022] POST /identity/v3/projects => generated 377 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:04:55.793623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879ecc2-bbf1-4fde-bbff-6f51634dc120 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:55.808689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879ecc2-bbf1-4fde-bbff-6f51634dc120 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:55.893502 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d78a00-2639-4f72-ae07-dfd95f920b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:55.894762 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d78a00-2639-4f72-ae07-dfd95f920b39 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:55.895107 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d78a00-2639-4f72-ae07-dfd95f920b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:55.895383 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d78a00-2639-4f72-ae07-dfd95f920b39 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:55.896087 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d78a00-2639-4f72-ae07-dfd95f920b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:55.898739 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d78a00-2639-4f72-ae07-dfd95f920b39 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:56.074116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1225/2405] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:04:55 2022] POST /identity/v3/users => generated 295 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:04:56.075281 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c3301-bf72-474a-ae69-0b0868d8c2a6 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:56.087974 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c3301-bf72-474a-ae69-0b0868d8c2a6 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:56.093271 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbaf555-ad75-4041-a3ae-8b288e3395b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:56.094028 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbaf555-ad75-4041-a3ae-8b288e3395b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:56.094319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbaf555-ad75-4041-a3ae-8b288e3395b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:56.099049 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbaf555-ad75-4041-a3ae-8b288e3395b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:56.099049 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbaf555-ad75-4041-a3ae-8b288e3395b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:56.099049 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbaf555-ad75-4041-a3ae-8b288e3395b5 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:56.109977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1181/2406] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:04:56.114338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d78a00-2639-4f72-ae07-dfd95f920b39 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:56.141936 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d78a00-2639-4f72-ae07-dfd95f920b39 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:56.167293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92279bad-a39c-4851-b6b9-bd7d27e826af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:56.168222 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92279bad-a39c-4851-b6b9-bd7d27e826af admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:56.168549 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92279bad-a39c-4851-b6b9-bd7d27e826af admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:56.168859 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92279bad-a39c-4851-b6b9-bd7d27e826af admin admin] PATH_INFO: `/v3/projects/b72a8f05db274f6bb1a6f94375b30ec3/users/ca950f21f42546a79c079a3b636bc46e/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:56.173279 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:56.186135 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92279bad-a39c-4851-b6b9-bd7d27e826af admin admin] RBAC: Authorizing `identity:create_grant(project_id=b72a8f05db274f6bb1a6f94375b30ec3, user_id=ca950f21f42546a79c079a3b636bc46e, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:56.188980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92279bad-a39c-4851-b6b9-bd7d27e826af admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:56.341943 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1226/2407] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:04:56 2022] PUT /identity/v3/projects/b72a8f05db274f6bb1a6f94375b30ec3/users/ca950f21f42546a79c079a3b636bc46e/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:04:56.346574 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbaf555-ad75-4041-a3ae-8b288e3395b5 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:56.359820 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbaf555-ad75-4041-a3ae-8b288e3395b5 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:56.423069 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f9f56-f6e7-462b-b0f5-4a65e51768f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:56.423770 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f9f56-f6e7-462b-b0f5-4a65e51768f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:56.424100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f9f56-f6e7-462b-b0f5-4a65e51768f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:56.424957 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f9f56-f6e7-462b-b0f5-4a65e51768f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:56.425681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f9f56-f6e7-462b-b0f5-4a65e51768f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:56.427380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f9f56-f6e7-462b-b0f5-4a65e51768f5 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:56.440894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1182/2408] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:04:56.442129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92279bad-a39c-4851-b6b9-bd7d27e826af admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:56.465788 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92279bad-a39c-4851-b6b9-bd7d27e826af admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:56.475486 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb635d-281d-4ef5-9df8-ecf13649180a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:56.476811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb635d-281d-4ef5-9df8-ecf13649180a admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:56.477269 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb635d-281d-4ef5-9df8-ecf13649180a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:56.477700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb635d-281d-4ef5-9df8-ecf13649180a admin admin] PATH_INFO: `/v3/projects/b72a8f05db274f6bb1a6f94375b30ec3/users/ca950f21f42546a79c079a3b636bc46e/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:56.481659 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb635d-281d-4ef5-9df8-ecf13649180a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b72a8f05db274f6bb1a6f94375b30ec3, user_id=ca950f21f42546a79c079a3b636bc46e, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:56.485373 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb635d-281d-4ef5-9df8-ecf13649180a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:56.498177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1227/2409] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:04:56 2022] PUT /identity/v3/projects/b72a8f05db274f6bb1a6f94375b30ec3/users/ca950f21f42546a79c079a3b636bc46e/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:04:56.508142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f096f-b518-4a56-b731-e11727e170d6 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:56.508434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f096f-b518-4a56-b731-e11727e170d6 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:56.508735 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f096f-b518-4a56-b731-e11727e170d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:56.535572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2d2f096f-b518-4a56-b731-e11727e170d6 None None] MFA Rules not processed for user `ca950f21f42546a79c079a3b636bc46e`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:56.536843 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2d2f096f-b518-4a56-b731-e11727e170d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:56.579404 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:56.603433 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1183/2410] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:04:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:56.617428 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb635d-281d-4ef5-9df8-ecf13649180a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:56.619250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-47eb635d-281d-4ef5-9df8-ecf13649180a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:56.695694 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb635d-281d-4ef5-9df8-ecf13649180a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:56.700027 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af449bc6-0d77-4ade-b054-4f0d5acdaa51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:56.700712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af449bc6-0d77-4ade-b054-4f0d5acdaa51 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:56.700998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af449bc6-0d77-4ade-b054-4f0d5acdaa51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:56.702879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af449bc6-0d77-4ade-b054-4f0d5acdaa51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:56.761302 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af449bc6-0d77-4ade-b054-4f0d5acdaa51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:56.762993 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af449bc6-0d77-4ade-b054-4f0d5acdaa51 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:56.774236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1228/2411] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:04:57.416554 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dadcb-59ee-4ace-aaf6-c13e08924924 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:57.416875 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dadcb-59ee-4ace-aaf6-c13e08924924 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:57.417153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dadcb-59ee-4ace-aaf6-c13e08924924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:57.436084 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-1f9dadcb-59ee-4ace-aaf6-c13e08924924 None None] MFA Rules not processed for user `ab47c91ba7854bc09f656607dbb41cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:57.437373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1f9dadcb-59ee-4ace-aaf6-c13e08924924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:57.442129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc313ab-5a91-4cd1-8ee4-7ac01a4cb273 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:57.442638 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc313ab-5a91-4cd1-8ee4-7ac01a4cb273 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:57.442748 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc313ab-5a91-4cd1-8ee4-7ac01a4cb273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:57.460048 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-abc313ab-5a91-4cd1-8ee4-7ac01a4cb273 None None] MFA Rules not processed for user `aa97e27060b3429bbad061a256db19f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:04:57.461282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-abc313ab-5a91-4cd1-8ee4-7ac01a4cb273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:57.494124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1184/2412] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jul 5 13:04:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:57.508849 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9dadcb-59ee-4ace-aaf6-c13e08924924 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:57.510966 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1f9dadcb-59ee-4ace-aaf6-c13e08924924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:57.524849 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1229/2413] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:04:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:04:57.590231 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9dadcb-59ee-4ace-aaf6-c13e08924924 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:57.596803 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d843128-0d90-41bd-8cbc-63f785f57a76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fb7db02f8e945a7af39cb30c3d606f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:57.598352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d843128-0d90-41bd-8cbc-63f785f57a76 service swift] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:57.598703 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d843128-0d90-41bd-8cbc-63f785f57a76 service swift] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:57.599048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d843128-0d90-41bd-8cbc-63f785f57a76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:57.608418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d843128-0d90-41bd-8cbc-63f785f57a76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:57.610125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d843128-0d90-41bd-8cbc-63f785f57a76 service swift] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:57.620165 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1185/2414] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jul 5 13:04:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 13:04:59.163728 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc313ab-5a91-4cd1-8ee4-7ac01a4cb273 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:04:59.165328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-abc313ab-5a91-4cd1-8ee4-7ac01a4cb273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:04:59.178373 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc313ab-5a91-4cd1-8ee4-7ac01a4cb273 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:04:59.187611 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cf3f9-55f6-4bbf-ae73-5156fc19cbf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:04:59.188289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cf3f9-55f6-4bbf-ae73-5156fc19cbf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:04:59.189224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cf3f9-55f6-4bbf-ae73-5156fc19cbf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:04:59.189522 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cf3f9-55f6-4bbf-ae73-5156fc19cbf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:04:59.220461 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:04:59.253053 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92cf3f9-55f6-4bbf-ae73-5156fc19cbf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:04:59.254724 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92cf3f9-55f6-4bbf-ae73-5156fc19cbf9 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:04:59.264798 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1230/2415] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:04:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:05:01.028079 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d843128-0d90-41bd-8cbc-63f785f57a76 service swift] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:01.039046 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d843128-0d90-41bd-8cbc-63f785f57a76 service swift] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:01.043470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1026bf5-478e-46d1-8859-d8b76ee019e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:01.044311 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1026bf5-478e-46d1-8859-d8b76ee019e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:01.044820 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1026bf5-478e-46d1-8859-d8b76ee019e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:01.045244 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1026bf5-478e-46d1-8859-d8b76ee019e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:01.059400 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1026bf5-478e-46d1-8859-d8b76ee019e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:01.061360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1026bf5-478e-46d1-8859-d8b76ee019e8 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:01.075607 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1186/2416] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:05:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:05:01.701710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cf3f9-55f6-4bbf-ae73-5156fc19cbf9 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:01.703202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a92cf3f9-55f6-4bbf-ae73-5156fc19cbf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:01.792992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cf3f9-55f6-4bbf-ae73-5156fc19cbf9 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:01.798048 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa6838-3755-45d4-8b61-a2d03b530dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:01.799273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa6838-3755-45d4-8b61-a2d03b530dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:01.799551 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa6838-3755-45d4-8b61-a2d03b530dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:01.800176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa6838-3755-45d4-8b61-a2d03b530dfc admin admin] PATH_INFO: `/v3/users/e4a4bd26db664e44850f5ebccd838315` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:01.801901 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa6838-3755-45d4-8b61-a2d03b530dfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4a4bd26db664e44850f5ebccd838315)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:01.803958 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa6838-3755-45d4-8b61-a2d03b530dfc admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:02.210474 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f2aa6838-3755-45d4-8b61-a2d03b530dfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4a4bd26db664e44850f5ebccd838315'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:02.217469 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f2aa6838-3755-45d4-8b61-a2d03b530dfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4a4bd26db664e44850f5ebccd838315'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:02.218207 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f2aa6838-3755-45d4-8b61-a2d03b530dfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4a4bd26db664e44850f5ebccd838315'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:02.218809 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f2aa6838-3755-45d4-8b61-a2d03b530dfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4a4bd26db664e44850f5ebccd838315'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:02.232005 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f2aa6838-3755-45d4-8b61-a2d03b530dfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4a4bd26db664e44850f5ebccd838315'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:02.367093 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1231/2417] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:05:01 2022] DELETE /identity/v3/users/e4a4bd26db664e44850f5ebccd838315 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:05:02.650196 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1026bf5-478e-46d1-8859-d8b76ee019e8 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:02.663395 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1026bf5-478e-46d1-8859-d8b76ee019e8 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:02.754930 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cda83f-04e9-414d-b9fa-1f8ea4498f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:02.755306 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cda83f-04e9-414d-b9fa-1f8ea4498f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:02.755891 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cda83f-04e9-414d-b9fa-1f8ea4498f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:02.756362 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cda83f-04e9-414d-b9fa-1f8ea4498f7e admin admin] PATH_INFO: `/v3/projects/380379df1d7e4ebe90c75bcefecbc787` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:02.758097 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cda83f-04e9-414d-b9fa-1f8ea4498f7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=380379df1d7e4ebe90c75bcefecbc787)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:02.760270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cda83f-04e9-414d-b9fa-1f8ea4498f7e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:02.763199 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:02.918359 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c2cda83f-04e9-414d-b9fa-1f8ea4498f7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380379df1d7e4ebe90c75bcefecbc787', 'request_id': 'req-c2cda83f-04e9-414d-b9fa-1f8ea4498f7e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:03.037716 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c2cda83f-04e9-414d-b9fa-1f8ea4498f7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380379df1d7e4ebe90c75bcefecbc787', 'request_id': 'req-c2cda83f-04e9-414d-b9fa-1f8ea4498f7e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:03.050204 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c2cda83f-04e9-414d-b9fa-1f8ea4498f7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380379df1d7e4ebe90c75bcefecbc787', 'request_id': 'req-c2cda83f-04e9-414d-b9fa-1f8ea4498f7e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:03.078246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c2cda83f-04e9-414d-b9fa-1f8ea4498f7e admin admin] The token cache is being invalidate because project 380379df1d7e4ebe90c75bcefecbc787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:05:03.078568 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c2cda83f-04e9-414d-b9fa-1f8ea4498f7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:03.083324 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c2cda83f-04e9-414d-b9fa-1f8ea4498f7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:03.087692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1187/2418] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:05:02 2022] DELETE /identity/v3/projects/380379df1d7e4ebe90c75bcefecbc787 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:05:05.909939 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa6838-3755-45d4-8b61-a2d03b530dfc admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:05.916033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f2aa6838-3755-45d4-8b61-a2d03b530dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:05.925266 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa6838-3755-45d4-8b61-a2d03b530dfc admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:05.969168 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:05.980925 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4db3f1-3376-4f59-8eff-bd8278005a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:06.006863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4db3f1-3376-4f59-8eff-bd8278005a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:06.006863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4db3f1-3376-4f59-8eff-bd8278005a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:06.006863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4db3f1-3376-4f59-8eff-bd8278005a12 admin admin] PATH_INFO: `/v3/users/1bf96bda9a6a47479142f35cc0c81db5` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:06.006863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4db3f1-3376-4f59-8eff-bd8278005a12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bf96bda9a6a47479142f35cc0c81db5)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:06.006863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4db3f1-3376-4f59-8eff-bd8278005a12 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:06.220327 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bb4db3f1-3376-4f59-8eff-bd8278005a12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bf96bda9a6a47479142f35cc0c81db5'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:06.227629 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bb4db3f1-3376-4f59-8eff-bd8278005a12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bf96bda9a6a47479142f35cc0c81db5'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:06.228573 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bb4db3f1-3376-4f59-8eff-bd8278005a12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bf96bda9a6a47479142f35cc0c81db5'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:06.229217 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bb4db3f1-3376-4f59-8eff-bd8278005a12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bf96bda9a6a47479142f35cc0c81db5'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:06.241761 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bb4db3f1-3376-4f59-8eff-bd8278005a12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bf96bda9a6a47479142f35cc0c81db5'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:06.333457 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1232/2419] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:05:05 2022] DELETE /identity/v3/users/1bf96bda9a6a47479142f35cc0c81db5 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:05:06.337735 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d624a-1da1-4534-bcf6-81d31f359e93 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:06.338214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d624a-1da1-4534-bcf6-81d31f359e93 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:06.338311 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d624a-1da1-4534-bcf6-81d31f359e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:06.356742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c01d624a-1da1-4534-bcf6-81d31f359e93 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:05:06.357996 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c01d624a-1da1-4534-bcf6-81d31f359e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:06.417645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1188/2420] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:05:06.427915 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4db3f1-3376-4f59-8eff-bd8278005a12 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:06.429331 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-bb4db3f1-3376-4f59-8eff-bd8278005a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:06.490405 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4db3f1-3376-4f59-8eff-bd8278005a12 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:06.494036 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f5c78-4fdd-4a9f-ba2d-57f68193e3c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:06.494689 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f5c78-4fdd-4a9f-ba2d-57f68193e3c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:06.494972 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f5c78-4fdd-4a9f-ba2d-57f68193e3c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:06.495273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f5c78-4fdd-4a9f-ba2d-57f68193e3c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:06.504903 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f5c78-4fdd-4a9f-ba2d-57f68193e3c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:06.506358 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f5c78-4fdd-4a9f-ba2d-57f68193e3c9 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:06.516252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1233/2421] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:05:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:05:07.165028 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d624a-1da1-4534-bcf6-81d31f359e93 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:07.169784 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c01d624a-1da1-4534-bcf6-81d31f359e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:07.197375 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d624a-1da1-4534-bcf6-81d31f359e93 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:07.207797 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b408add-a42d-413f-ba81-cd2cf1e46654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:07.209445 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b408add-a42d-413f-ba81-cd2cf1e46654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:07.210128 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b408add-a42d-413f-ba81-cd2cf1e46654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:07.210860 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b408add-a42d-413f-ba81-cd2cf1e46654 admin admin] PATH_INFO: `/v3/projects/beb233d6f43d470f97c9c7fbeccbc9df` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:07.213072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b408add-a42d-413f-ba81-cd2cf1e46654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beb233d6f43d470f97c9c7fbeccbc9df)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:07.217376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b408add-a42d-413f-ba81-cd2cf1e46654 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:07.369091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1b408add-a42d-413f-ba81-cd2cf1e46654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beb233d6f43d470f97c9c7fbeccbc9df', 'request_id': 'req-1b408add-a42d-413f-ba81-cd2cf1e46654'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:07.481132 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1b408add-a42d-413f-ba81-cd2cf1e46654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beb233d6f43d470f97c9c7fbeccbc9df', 'request_id': 'req-1b408add-a42d-413f-ba81-cd2cf1e46654'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:07.488441 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1b408add-a42d-413f-ba81-cd2cf1e46654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beb233d6f43d470f97c9c7fbeccbc9df', 'request_id': 'req-1b408add-a42d-413f-ba81-cd2cf1e46654'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:07.499767 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1b408add-a42d-413f-ba81-cd2cf1e46654 admin admin] The token cache is being invalidate because project beb233d6f43d470f97c9c7fbeccbc9df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:05:07.500053 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1b408add-a42d-413f-ba81-cd2cf1e46654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:07.500817 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1b408add-a42d-413f-ba81-cd2cf1e46654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:07.503105 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1189/2422] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:05:07 2022] DELETE /identity/v3/projects/beb233d6f43d470f97c9c7fbeccbc9df => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:05:07.507200 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f5c78-4fdd-4a9f-ba2d-57f68193e3c9 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:07.516988 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f5c78-4fdd-4a9f-ba2d-57f68193e3c9 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:07.573834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f090b6-34fb-414a-86d4-508c26766d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:07.574867 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f090b6-34fb-414a-86d4-508c26766d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:07.575316 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f090b6-34fb-414a-86d4-508c26766d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:07.575622 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f090b6-34fb-414a-86d4-508c26766d8b admin admin] PATH_INFO: `/v3/users/5e2af3d5cb4b4637be84c04c8a992bfc` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:07.576865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f090b6-34fb-414a-86d4-508c26766d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e2af3d5cb4b4637be84c04c8a992bfc)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:07.578826 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f090b6-34fb-414a-86d4-508c26766d8b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:07.591437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:07.854997 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f3f090b6-34fb-414a-86d4-508c26766d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e2af3d5cb4b4637be84c04c8a992bfc'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:07.861712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f3f090b6-34fb-414a-86d4-508c26766d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e2af3d5cb4b4637be84c04c8a992bfc'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:07.862365 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f3f090b6-34fb-414a-86d4-508c26766d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e2af3d5cb4b4637be84c04c8a992bfc'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:07.863028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f3f090b6-34fb-414a-86d4-508c26766d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e2af3d5cb4b4637be84c04c8a992bfc'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:07.876010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f3f090b6-34fb-414a-86d4-508c26766d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e2af3d5cb4b4637be84c04c8a992bfc'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:08.027155 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1234/2423] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:05:07 2022] DELETE /identity/v3/users/5e2af3d5cb4b4637be84c04c8a992bfc => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:05:08.459522 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b408add-a42d-413f-ba81-cd2cf1e46654 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:08.461742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1b408add-a42d-413f-ba81-cd2cf1e46654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:08.476190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b408add-a42d-413f-ba81-cd2cf1e46654 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:08.489564 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:08.535001 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2684a-105e-4555-9d08-6d32e738bbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:08.535909 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2684a-105e-4555-9d08-6d32e738bbf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:08.536192 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2684a-105e-4555-9d08-6d32e738bbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:08.536464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2684a-105e-4555-9d08-6d32e738bbf2 admin admin] PATH_INFO: `/v3/projects/249c02ff335d44e0a4f58e6ab801ae82` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:08.537659 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2684a-105e-4555-9d08-6d32e738bbf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=249c02ff335d44e0a4f58e6ab801ae82)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:08.539583 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2684a-105e-4555-9d08-6d32e738bbf2 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:08.645924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-00b2684a-105e-4555-9d08-6d32e738bbf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '249c02ff335d44e0a4f58e6ab801ae82', 'request_id': 'req-00b2684a-105e-4555-9d08-6d32e738bbf2'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:08.726522 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-00b2684a-105e-4555-9d08-6d32e738bbf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '249c02ff335d44e0a4f58e6ab801ae82', 'request_id': 'req-00b2684a-105e-4555-9d08-6d32e738bbf2'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:08.733479 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-00b2684a-105e-4555-9d08-6d32e738bbf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '249c02ff335d44e0a4f58e6ab801ae82', 'request_id': 'req-00b2684a-105e-4555-9d08-6d32e738bbf2'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:08.744782 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-00b2684a-105e-4555-9d08-6d32e738bbf2 admin admin] The token cache is being invalidate because project 249c02ff335d44e0a4f58e6ab801ae82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:05:08.745079 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-00b2684a-105e-4555-9d08-6d32e738bbf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:08.745730 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-00b2684a-105e-4555-9d08-6d32e738bbf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:08.747268 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1190/2424] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:05:08 2022] DELETE /identity/v3/projects/249c02ff335d44e0a4f58e6ab801ae82 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:05:08.751451 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f090b6-34fb-414a-86d4-508c26766d8b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:08.752920 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f3f090b6-34fb-414a-86d4-508c26766d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:08.765917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f090b6-34fb-414a-86d4-508c26766d8b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:08.823995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e319db-d683-41f8-87fb-79e84ee5bf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:08.824905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e319db-d683-41f8-87fb-79e84ee5bf01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:08.825188 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e319db-d683-41f8-87fb-79e84ee5bf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:08.825467 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e319db-d683-41f8-87fb-79e84ee5bf01 admin admin] PATH_INFO: `/v3/users/ca950f21f42546a79c079a3b636bc46e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:08.826740 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e319db-d683-41f8-87fb-79e84ee5bf01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca950f21f42546a79c079a3b636bc46e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:08.828864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e319db-d683-41f8-87fb-79e84ee5bf01 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:09.078818 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-31e319db-d683-41f8-87fb-79e84ee5bf01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca950f21f42546a79c079a3b636bc46e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:09.088070 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-31e319db-d683-41f8-87fb-79e84ee5bf01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca950f21f42546a79c079a3b636bc46e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:09.088901 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-31e319db-d683-41f8-87fb-79e84ee5bf01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca950f21f42546a79c079a3b636bc46e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:09.092555 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-31e319db-d683-41f8-87fb-79e84ee5bf01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca950f21f42546a79c079a3b636bc46e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:09.110373 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-31e319db-d683-41f8-87fb-79e84ee5bf01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca950f21f42546a79c079a3b636bc46e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:09.196506 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1235/2425] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:05:08 2022] DELETE /identity/v3/users/ca950f21f42546a79c079a3b636bc46e => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:05:09.705493 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2684a-105e-4555-9d08-6d32e738bbf2 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:09.706974 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-00b2684a-105e-4555-9d08-6d32e738bbf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:09.720342 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2684a-105e-4555-9d08-6d32e738bbf2 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:09.778821 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80681e1e-d5d8-467e-89e8-2dcadd045267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:09.779683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80681e1e-d5d8-467e-89e8-2dcadd045267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:09.779972 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80681e1e-d5d8-467e-89e8-2dcadd045267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:09.780253 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80681e1e-d5d8-467e-89e8-2dcadd045267 admin admin] PATH_INFO: `/v3/projects/b72a8f05db274f6bb1a6f94375b30ec3` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:09.781553 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80681e1e-d5d8-467e-89e8-2dcadd045267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b72a8f05db274f6bb1a6f94375b30ec3)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:09.784698 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80681e1e-d5d8-467e-89e8-2dcadd045267 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:09.891417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:09.892765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-80681e1e-d5d8-467e-89e8-2dcadd045267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b72a8f05db274f6bb1a6f94375b30ec3', 'request_id': 'req-80681e1e-d5d8-467e-89e8-2dcadd045267'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:10.057911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-80681e1e-d5d8-467e-89e8-2dcadd045267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b72a8f05db274f6bb1a6f94375b30ec3', 'request_id': 'req-80681e1e-d5d8-467e-89e8-2dcadd045267'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:10.065290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-80681e1e-d5d8-467e-89e8-2dcadd045267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b72a8f05db274f6bb1a6f94375b30ec3', 'request_id': 'req-80681e1e-d5d8-467e-89e8-2dcadd045267'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:10.076206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-80681e1e-d5d8-467e-89e8-2dcadd045267 admin admin] The token cache is being invalidate because project b72a8f05db274f6bb1a6f94375b30ec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:05:10.076498 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-80681e1e-d5d8-467e-89e8-2dcadd045267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:10.077189 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-80681e1e-d5d8-467e-89e8-2dcadd045267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:10.078802 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1191/2426] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:05:09 2022] DELETE /identity/v3/projects/b72a8f05db274f6bb1a6f94375b30ec3 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:05:10.084849 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434b5ea-a968-4e1d-ad2c-557d8386f5df None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:10.085332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434b5ea-a968-4e1d-ad2c-557d8386f5df None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:10.085532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434b5ea-a968-4e1d-ad2c-557d8386f5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:10.106823 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-5434b5ea-a968-4e1d-ad2c-557d8386f5df None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:05:10.108088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5434b5ea-a968-4e1d-ad2c-557d8386f5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:10.113495 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:10.170060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1236/2427] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:05:10.178277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855de4ff-0243-4de5-a63f-52c5987edb57 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:10.178573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855de4ff-0243-4de5-a63f-52c5987edb57 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:10.178912 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855de4ff-0243-4de5-a63f-52c5987edb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:10.197121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-855de4ff-0243-4de5-a63f-52c5987edb57 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:05:10.198320 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-855de4ff-0243-4de5-a63f-52c5987edb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:10.206227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1192/2428] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:05:10.210539 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434b5ea-a968-4e1d-ad2c-557d8386f5df None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:10.220294 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434b5ea-a968-4e1d-ad2c-557d8386f5df None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:10.225758 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5634d-0ab4-40d5-9b30-070923ba4120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:10.226444 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5634d-0ab4-40d5-9b30-070923ba4120 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:10.226733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5634d-0ab4-40d5-9b30-070923ba4120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:10.227013 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5634d-0ab4-40d5-9b30-070923ba4120 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:10.227911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5634d-0ab4-40d5-9b30-070923ba4120 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:05:10.228509 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5634d-0ab4-40d5-9b30-070923ba4120 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:10.230191 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5634d-0ab4-40d5-9b30-070923ba4120 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:10.242308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1237/2429] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:05:10.250091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855de4ff-0243-4de5-a63f-52c5987edb57 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:10.259371 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855de4ff-0243-4de5-a63f-52c5987edb57 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:10.263960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e9a2d-e0fb-4e04-9b9c-5c6f2b020137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:10.264615 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e9a2d-e0fb-4e04-9b9c-5c6f2b020137 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:10.264912 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e9a2d-e0fb-4e04-9b9c-5c6f2b020137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:10.265190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e9a2d-e0fb-4e04-9b9c-5c6f2b020137 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:10.265874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e9a2d-e0fb-4e04-9b9c-5c6f2b020137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:10.268315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e9a2d-e0fb-4e04-9b9c-5c6f2b020137 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:10.361021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1193/2430] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:05:10 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:05:10.362187 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5634d-0ab4-40d5-9b30-070923ba4120 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:10.372505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5634d-0ab4-40d5-9b30-070923ba4120 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:10.430512 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0ed1f-8cab-44a7-ae71-c5d6ade54bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:10.431177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0ed1f-8cab-44a7-ae71-c5d6ade54bec admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:10.431457 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0ed1f-8cab-44a7-ae71-c5d6ade54bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:10.431732 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0ed1f-8cab-44a7-ae71-c5d6ade54bec admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:10.432433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0ed1f-8cab-44a7-ae71-c5d6ade54bec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:10.434458 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0ed1f-8cab-44a7-ae71-c5d6ade54bec admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:10.592786 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1238/2431] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:05:10 2022] POST /identity/v3/users => generated 288 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:05:10.594007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e9a2d-e0fb-4e04-9b9c-5c6f2b020137 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:10.605309 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e9a2d-e0fb-4e04-9b9c-5c6f2b020137 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:10.610215 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4d2c6-8520-489f-b600-be1075b77a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:10.611168 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4d2c6-8520-489f-b600-be1075b77a6e admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:10.611454 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4d2c6-8520-489f-b600-be1075b77a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:10.611728 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4d2c6-8520-489f-b600-be1075b77a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:10.612451 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4d2c6-8520-489f-b600-be1075b77a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:10.614081 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4d2c6-8520-489f-b600-be1075b77a6e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:10.624368 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1194/2432] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:05:10.628800 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0ed1f-8cab-44a7-ae71-c5d6ade54bec admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:10.639452 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0ed1f-8cab-44a7-ae71-c5d6ade54bec admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:10.644892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0ad09-9acc-488f-8f2f-d66203cd18b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:10.645548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0ad09-9acc-488f-8f2f-d66203cd18b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:10.645833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0ad09-9acc-488f-8f2f-d66203cd18b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:10.646111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0ad09-9acc-488f-8f2f-d66203cd18b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:10.646837 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0ad09-9acc-488f-8f2f-d66203cd18b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:10.648620 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0ad09-9acc-488f-8f2f-d66203cd18b7 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:10.658772 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1239/2433] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:05:10.662753 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4d2c6-8520-489f-b600-be1075b77a6e admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:10.672750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4d2c6-8520-489f-b600-be1075b77a6e admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:10.677337 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10845eaa-21de-46ea-b663-61af7c0ce5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:10.678204 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10845eaa-21de-46ea-b663-61af7c0ce5a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:10.678483 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10845eaa-21de-46ea-b663-61af7c0ce5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:10.678756 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10845eaa-21de-46ea-b663-61af7c0ce5a2 admin admin] PATH_INFO: `/v3/projects/85af5c12238140c4a6334d9b3256f664/users/a316766a5e5e490189884369d59c74d7/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:10.693513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10845eaa-21de-46ea-b663-61af7c0ce5a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85af5c12238140c4a6334d9b3256f664, user_id=a316766a5e5e490189884369d59c74d7, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:10.696166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10845eaa-21de-46ea-b663-61af7c0ce5a2 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:10.766744 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1195/2434] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:05:10 2022] PUT /identity/v3/projects/85af5c12238140c4a6334d9b3256f664/users/a316766a5e5e490189884369d59c74d7/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:05:10.844512 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa19f9e-c20e-4196-83f6-c1e5daaec5ab None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:10.844834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa19f9e-c20e-4196-83f6-c1e5daaec5ab None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:10.845154 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa19f9e-c20e-4196-83f6-c1e5daaec5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:10.873097 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-3aa19f9e-c20e-4196-83f6-c1e5daaec5ab None None] MFA Rules not processed for user `a316766a5e5e490189884369d59c74d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:05:10.874404 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3aa19f9e-c20e-4196-83f6-c1e5daaec5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:10.940409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1240/2435] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:05:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:05:10.951395 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10845eaa-21de-46ea-b663-61af7c0ce5a2 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:10.953314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-10845eaa-21de-46ea-b663-61af7c0ce5a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:11.013048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10845eaa-21de-46ea-b663-61af7c0ce5a2 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:11.016750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb4672-7502-4fa8-9e8e-998b6e6aaebf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:11.017393 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb4672-7502-4fa8-9e8e-998b6e6aaebf service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:11.017681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb4672-7502-4fa8-9e8e-998b6e6aaebf service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:11.017964 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb4672-7502-4fa8-9e8e-998b6e6aaebf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:11.026682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb4672-7502-4fa8-9e8e-998b6e6aaebf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:11.028128 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb4672-7502-4fa8-9e8e-998b6e6aaebf service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:11.037175 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1196/2436] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:05:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:05:12.930067 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be742db-d02a-4fb2-a744-69ae2a028d28 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:12.930624 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be742db-d02a-4fb2-a744-69ae2a028d28 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:12.930624 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be742db-d02a-4fb2-a744-69ae2a028d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:12.937479 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:12.948629 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-4be742db-d02a-4fb2-a744-69ae2a028d28 None None] MFA Rules not processed for user `a316766a5e5e490189884369d59c74d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:05:12.951119 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4be742db-d02a-4fb2-a744-69ae2a028d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:12.957950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1241/2437] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:05:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:05:15.359059 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb4672-7502-4fa8-9e8e-998b6e6aaebf service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:15.360564 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-57eb4672-7502-4fa8-9e8e-998b6e6aaebf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:15.418623 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb4672-7502-4fa8-9e8e-998b6e6aaebf service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:15.422111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2363eff-aa3d-4a4d-8773-e0d1fab88e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:15.422776 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2363eff-aa3d-4a4d-8773-e0d1fab88e0d service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:15.423055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2363eff-aa3d-4a4d-8773-e0d1fab88e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:15.423331 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2363eff-aa3d-4a4d-8773-e0d1fab88e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:15.425148 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a2363eff-aa3d-4a4d-8773-e0d1fab88e0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:15.461579 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:15.494570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2363eff-aa3d-4a4d-8773-e0d1fab88e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:15.496055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2363eff-aa3d-4a4d-8773-e0d1fab88e0d service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:15.506139 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1197/2438] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:05:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:05:23.189224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:25.635096 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=16 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:32.791135 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadecf0-7637-4125-b4f3-2786ad439985 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:32.791626 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadecf0-7637-4125-b4f3-2786ad439985 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:32.791736 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadecf0-7637-4125-b4f3-2786ad439985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:32.809585 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-0fadecf0-7637-4125-b4f3-2786ad439985 None None] MFA Rules not processed for user `475bac060a98475d858e6181eec7ce11`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:05:32.810799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0fadecf0-7637-4125-b4f3-2786ad439985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:32.865810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1242/2439] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:05:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:05:32.905332 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e2532-8e12-4189-8072-3b5440408aa4 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:32.905853 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e2532-8e12-4189-8072-3b5440408aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:32.905968 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e2532-8e12-4189-8072-3b5440408aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:32.929148 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-533e2532-8e12-4189-8072-3b5440408aa4 None None] MFA Rules not processed for user `ab47c91ba7854bc09f656607dbb41cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:05:32.930399 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-533e2532-8e12-4189-8072-3b5440408aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:32.988319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1198/2440] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jul 5 13:05:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:05:33.000082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadecf0-7637-4125-b4f3-2786ad439985 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:33.001562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0fadecf0-7637-4125-b4f3-2786ad439985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:33.080361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadecf0-7637-4125-b4f3-2786ad439985 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:33.086791 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f474920-dbad-4bfd-9a51-bf4a77ea3841 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fb7db02f8e945a7af39cb30c3d606f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:33.087452 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f474920-dbad-4bfd-9a51-bf4a77ea3841 service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:33.087735 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f474920-dbad-4bfd-9a51-bf4a77ea3841 service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:33.088008 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f474920-dbad-4bfd-9a51-bf4a77ea3841 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:33.097403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f474920-dbad-4bfd-9a51-bf4a77ea3841 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:33.099031 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f474920-dbad-4bfd-9a51-bf4a77ea3841 service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:33.108454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1243/2441] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jul 5 13:05:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:05:34.093097 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8907ff7-34e2-45d8-a8a4-c77903466c4b None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:34.093566 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8907ff7-34e2-45d8-a8a4-c77903466c4b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:34.093794 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8907ff7-34e2-45d8-a8a4-c77903466c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:34.112182 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d8907ff7-34e2-45d8-a8a4-c77903466c4b None None] MFA Rules not processed for user `ab47c91ba7854bc09f656607dbb41cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:05:34.113562 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d8907ff7-34e2-45d8-a8a4-c77903466c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:34.120936 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1199/2442] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jul 5 13:05:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:05:34.133477 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f474920-dbad-4bfd-9a51-bf4a77ea3841 service swift] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:34.144911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f474920-dbad-4bfd-9a51-bf4a77ea3841 service swift] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:34.149980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a64a05-9eb3-47c1-baee-5a730a65818f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fb7db02f8e945a7af39cb30c3d606f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:34.150646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a64a05-9eb3-47c1-baee-5a730a65818f service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:34.151044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a64a05-9eb3-47c1-baee-5a730a65818f service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:34.151331 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a64a05-9eb3-47c1-baee-5a730a65818f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:34.159907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a64a05-9eb3-47c1-baee-5a730a65818f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:34.162098 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a64a05-9eb3-47c1-baee-5a730a65818f service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:34.170583 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1244/2443] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jul 5 13:05:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:05:34.808091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c0fdb-bef6-4423-bda2-f4dff9cf96f9 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:34.808381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c0fdb-bef6-4423-bda2-f4dff9cf96f9 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:34.808694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c0fdb-bef6-4423-bda2-f4dff9cf96f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:34.826423 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b50c0fdb-bef6-4423-bda2-f4dff9cf96f9 None None] MFA Rules not processed for user `ab47c91ba7854bc09f656607dbb41cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:05:34.827614 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b50c0fdb-bef6-4423-bda2-f4dff9cf96f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:34.834799 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1200/2444] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jul 5 13:05:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:05:34.846378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a64a05-9eb3-47c1-baee-5a730a65818f service swift] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:34.858027 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a64a05-9eb3-47c1-baee-5a730a65818f service swift] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:34.863200 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a222975-0e47-49da-bde5-5a99707688a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fb7db02f8e945a7af39cb30c3d606f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:34.863846 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a222975-0e47-49da-bde5-5a99707688a4 service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:34.864131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a222975-0e47-49da-bde5-5a99707688a4 service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:34.864411 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a222975-0e47-49da-bde5-5a99707688a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:34.873020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a222975-0e47-49da-bde5-5a99707688a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:34.874623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a222975-0e47-49da-bde5-5a99707688a4 service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:34.883630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1245/2445] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jul 5 13:05:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:05:35.464411 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1385788-3d38-41d0-9c87-79589d987dc5 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:35.464942 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1385788-3d38-41d0-9c87-79589d987dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:35.468927 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1385788-3d38-41d0-9c87-79589d987dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:35.483468 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-a1385788-3d38-41d0-9c87-79589d987dc5 None None] MFA Rules not processed for user `ab47c91ba7854bc09f656607dbb41cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:05:35.484714 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a1385788-3d38-41d0-9c87-79589d987dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:35.491957 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1201/2446] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jul 5 13:05:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:05:35.504437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a222975-0e47-49da-bde5-5a99707688a4 service swift] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:35.515480 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a222975-0e47-49da-bde5-5a99707688a4 service swift] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:35.521225 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f667d-1a40-42d6-a962-15691b03517f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fb7db02f8e945a7af39cb30c3d606f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:35.521808 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f667d-1a40-42d6-a962-15691b03517f service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:35.522087 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f667d-1a40-42d6-a962-15691b03517f service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:35.522359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f667d-1a40-42d6-a962-15691b03517f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:35.531060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f667d-1a40-42d6-a962-15691b03517f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:35.532803 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f667d-1a40-42d6-a962-15691b03517f service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:35.541305 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1246/2447] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jul 5 13:05:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:05:36.861711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e56ff5-77e6-4dc1-82f2-3229f6a38d4a None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:36.862556 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e56ff5-77e6-4dc1-82f2-3229f6a38d4a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:36.862842 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e56ff5-77e6-4dc1-82f2-3229f6a38d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:36.883167 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e6e56ff5-77e6-4dc1-82f2-3229f6a38d4a None None] MFA Rules not processed for user `ad3f91c024f8415cac4784fec0689757`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:05:36.884398 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e6e56ff5-77e6-4dc1-82f2-3229f6a38d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:36.949860 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1202/2448] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:05:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:05:38.139572 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f667d-1a40-42d6-a962-15691b03517f service swift] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:38.228470 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:38.239172 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f667d-1a40-42d6-a962-15691b03517f service swift] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:38.250482 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5c0a2-e046-44f3-8e24-8ca8401306af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:38.251568 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5c0a2-e046-44f3-8e24-8ca8401306af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:38.251851 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5c0a2-e046-44f3-8e24-8ca8401306af admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:38.252123 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5c0a2-e046-44f3-8e24-8ca8401306af admin admin] PATH_INFO: `/v3/users/a316766a5e5e490189884369d59c74d7` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:38.253694 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5c0a2-e046-44f3-8e24-8ca8401306af admin admin] RBAC: Authorizing `identity:delete_user(user_id=a316766a5e5e490189884369d59c74d7)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:38.255674 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5c0a2-e046-44f3-8e24-8ca8401306af admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:38.506615 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8bc5c0a2-e046-44f3-8e24-8ca8401306af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a316766a5e5e490189884369d59c74d7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:38.513646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8bc5c0a2-e046-44f3-8e24-8ca8401306af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a316766a5e5e490189884369d59c74d7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:38.514249 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8bc5c0a2-e046-44f3-8e24-8ca8401306af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a316766a5e5e490189884369d59c74d7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:38.514883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8bc5c0a2-e046-44f3-8e24-8ca8401306af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a316766a5e5e490189884369d59c74d7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:38.528066 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8bc5c0a2-e046-44f3-8e24-8ca8401306af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a316766a5e5e490189884369d59c74d7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:38.612216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1247/2449] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:05:38 2022] DELETE /identity/v3/users/a316766a5e5e490189884369d59c74d7 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:05:38.614027 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319287cc-ad2b-4b30-b08b-9a5f1879988c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:38.614509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319287cc-ad2b-4b30-b08b-9a5f1879988c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:38.614627 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319287cc-ad2b-4b30-b08b-9a5f1879988c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:38.634249 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-319287cc-ad2b-4b30-b08b-9a5f1879988c None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:05:38.635660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-319287cc-ad2b-4b30-b08b-9a5f1879988c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:38.708072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1203/2450] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:05:38.718911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5c0a2-e046-44f3-8e24-8ca8401306af admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:38.720642 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8bc5c0a2-e046-44f3-8e24-8ca8401306af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:38.797082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5c0a2-e046-44f3-8e24-8ca8401306af admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:38.802399 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791762eb-69fa-4dd0-b849-557fc724bd83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:38.803219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791762eb-69fa-4dd0-b849-557fc724bd83 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:38.803587 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791762eb-69fa-4dd0-b849-557fc724bd83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:38.803964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791762eb-69fa-4dd0-b849-557fc724bd83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:38.815998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791762eb-69fa-4dd0-b849-557fc724bd83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:38.818893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791762eb-69fa-4dd0-b849-557fc724bd83 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:38.831079 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1248/2451] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:05:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:05:39.059926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319287cc-ad2b-4b30-b08b-9a5f1879988c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:39.068256 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-319287cc-ad2b-4b30-b08b-9a5f1879988c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:39.089053 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319287cc-ad2b-4b30-b08b-9a5f1879988c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:39.093130 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c38999-152e-4ed6-8163-78a7dc4d2475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:39.094007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c38999-152e-4ed6-8163-78a7dc4d2475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:39.094291 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c38999-152e-4ed6-8163-78a7dc4d2475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:39.094575 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c38999-152e-4ed6-8163-78a7dc4d2475 admin admin] PATH_INFO: `/v3/projects/85af5c12238140c4a6334d9b3256f664` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:39.095822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c38999-152e-4ed6-8163-78a7dc4d2475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85af5c12238140c4a6334d9b3256f664)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:39.099585 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c38999-152e-4ed6-8163-78a7dc4d2475 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:39.203247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:39.219924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-68c38999-152e-4ed6-8163-78a7dc4d2475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85af5c12238140c4a6334d9b3256f664', 'request_id': 'req-68c38999-152e-4ed6-8163-78a7dc4d2475'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:39.303996 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-68c38999-152e-4ed6-8163-78a7dc4d2475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85af5c12238140c4a6334d9b3256f664', 'request_id': 'req-68c38999-152e-4ed6-8163-78a7dc4d2475'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:39.310712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-68c38999-152e-4ed6-8163-78a7dc4d2475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85af5c12238140c4a6334d9b3256f664', 'request_id': 'req-68c38999-152e-4ed6-8163-78a7dc4d2475'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:39.321073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-68c38999-152e-4ed6-8163-78a7dc4d2475 admin admin] The token cache is being invalidate because project 85af5c12238140c4a6334d9b3256f664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:05:39.321368 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-68c38999-152e-4ed6-8163-78a7dc4d2475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:39.321955 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-68c38999-152e-4ed6-8163-78a7dc4d2475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:39.323506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1204/2452] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:05:39 2022] DELETE /identity/v3/projects/85af5c12238140c4a6334d9b3256f664 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:05:39.328967 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd1d9e-39a4-49e6-b4bd-4178940adc53 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:39.329442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd1d9e-39a4-49e6-b4bd-4178940adc53 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:39.329558 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd1d9e-39a4-49e6-b4bd-4178940adc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:39.349889 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-ccfd1d9e-39a4-49e6-b4bd-4178940adc53 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:05:39.351206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ccfd1d9e-39a4-49e6-b4bd-4178940adc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:39.413289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1249/2453] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:05:39.421721 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965068c-adc7-45f0-8907-7ee29de58a54 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:39.422020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965068c-adc7-45f0-8907-7ee29de58a54 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:39.422296 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965068c-adc7-45f0-8907-7ee29de58a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:39.440975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-a965068c-adc7-45f0-8907-7ee29de58a54 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:05:39.442191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a965068c-adc7-45f0-8907-7ee29de58a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:39.450072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1205/2454] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:05:39.454227 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd1d9e-39a4-49e6-b4bd-4178940adc53 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:39.464297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd1d9e-39a4-49e6-b4bd-4178940adc53 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:39.469009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e6575-9cd0-48b7-bf11-bb7bc802685e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:39.469821 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e6575-9cd0-48b7-bf11-bb7bc802685e admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:39.470106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e6575-9cd0-48b7-bf11-bb7bc802685e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:39.470410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e6575-9cd0-48b7-bf11-bb7bc802685e admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:39.471133 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e6575-9cd0-48b7-bf11-bb7bc802685e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:05:39.472089 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e6575-9cd0-48b7-bf11-bb7bc802685e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:39.473851 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e6575-9cd0-48b7-bf11-bb7bc802685e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:39.485671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1250/2455] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:05:39.489831 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965068c-adc7-45f0-8907-7ee29de58a54 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:39.498933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965068c-adc7-45f0-8907-7ee29de58a54 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:39.503491 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc3515-f448-477d-8cd5-d6338fe1bb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:39.504135 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc3515-f448-477d-8cd5-d6338fe1bb56 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:39.504423 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc3515-f448-477d-8cd5-d6338fe1bb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:39.504736 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc3515-f448-477d-8cd5-d6338fe1bb56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:39.505453 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc3515-f448-477d-8cd5-d6338fe1bb56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:39.507355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc3515-f448-477d-8cd5-d6338fe1bb56 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:39.590897 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1206/2456] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:05:39 2022] POST /identity/v3/projects => generated 397 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:05:39.595117 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e6575-9cd0-48b7-bf11-bb7bc802685e admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:39.602454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:39.606816 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e6575-9cd0-48b7-bf11-bb7bc802685e admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:39.663896 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadaa5d-68da-49d2-8feb-b8fe4f66e7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:39.664567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadaa5d-68da-49d2-8feb-b8fe4f66e7cd admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:39.664882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadaa5d-68da-49d2-8feb-b8fe4f66e7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:39.665221 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadaa5d-68da-49d2-8feb-b8fe4f66e7cd admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:39.665851 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadaa5d-68da-49d2-8feb-b8fe4f66e7cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:39.667816 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadaa5d-68da-49d2-8feb-b8fe4f66e7cd admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:39.763819 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1251/2457] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:05:39 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:05:39.766284 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc3515-f448-477d-8cd5-d6338fe1bb56 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:39.776817 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc3515-f448-477d-8cd5-d6338fe1bb56 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:39.781581 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73be8b-d521-4cfe-a813-cf31601b2779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:39.782348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73be8b-d521-4cfe-a813-cf31601b2779 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:39.782642 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73be8b-d521-4cfe-a813-cf31601b2779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:39.782917 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73be8b-d521-4cfe-a813-cf31601b2779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:39.783645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73be8b-d521-4cfe-a813-cf31601b2779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:39.785911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73be8b-d521-4cfe-a813-cf31601b2779 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:39.799648 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1207/2458] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:05:39.801096 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadaa5d-68da-49d2-8feb-b8fe4f66e7cd admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:39.811436 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadaa5d-68da-49d2-8feb-b8fe4f66e7cd admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:39.816766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3587e5-cf89-4cfe-b501-e724f0619364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:39.817668 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3587e5-cf89-4cfe-b501-e724f0619364 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:39.818963 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3587e5-cf89-4cfe-b501-e724f0619364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:39.819247 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3587e5-cf89-4cfe-b501-e724f0619364 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:39.820407 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3587e5-cf89-4cfe-b501-e724f0619364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:39.822064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3587e5-cf89-4cfe-b501-e724f0619364 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:39.846567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1252/2459] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:05:39.846925 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73be8b-d521-4cfe-a813-cf31601b2779 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:39.865214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73be8b-d521-4cfe-a813-cf31601b2779 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:39.870595 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b93dcf-6e2a-4398-bd6a-e38f41eec0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:39.877026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b93dcf-6e2a-4398-bd6a-e38f41eec0a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:39.877026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b93dcf-6e2a-4398-bd6a-e38f41eec0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:39.877026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b93dcf-6e2a-4398-bd6a-e38f41eec0a6 admin admin] PATH_INFO: `/v3/projects/b4a801978d8a4b569cfe5ee0d87009f1/users/e79abf79facc4ea7a7f1f62385b71724/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:39.893061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b93dcf-6e2a-4398-bd6a-e38f41eec0a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4a801978d8a4b569cfe5ee0d87009f1, user_id=e79abf79facc4ea7a7f1f62385b71724, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:39.897017 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b93dcf-6e2a-4398-bd6a-e38f41eec0a6 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:40.019426 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1208/2460] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:05:39 2022] PUT /identity/v3/projects/b4a801978d8a4b569cfe5ee0d87009f1/users/e79abf79facc4ea7a7f1f62385b71724/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:05:40.029883 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e3f7d-7378-4f27-af09-437c3b679f6b None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:40.030344 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e3f7d-7378-4f27-af09-437c3b679f6b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:40.030608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e3f7d-7378-4f27-af09-437c3b679f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:40.068763 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-8a9e3f7d-7378-4f27-af09-437c3b679f6b None None] MFA Rules not processed for user `e79abf79facc4ea7a7f1f62385b71724`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:05:40.069935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8a9e3f7d-7378-4f27-af09-437c3b679f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:40.136525 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1253/2461] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:05:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:05:40.148419 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b93dcf-6e2a-4398-bd6a-e38f41eec0a6 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:40.150134 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d7b93dcf-6e2a-4398-bd6a-e38f41eec0a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:40.207417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b93dcf-6e2a-4398-bd6a-e38f41eec0a6 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:40.210974 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcd3ed-5cb1-40b3-a4d8-41b7e4b0eea7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:40.211609 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcd3ed-5cb1-40b3-a4d8-41b7e4b0eea7 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:40.211893 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcd3ed-5cb1-40b3-a4d8-41b7e4b0eea7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:40.212169 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcd3ed-5cb1-40b3-a4d8-41b7e4b0eea7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:40.220233 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcd3ed-5cb1-40b3-a4d8-41b7e4b0eea7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:40.221721 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcd3ed-5cb1-40b3-a4d8-41b7e4b0eea7 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:40.230565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1209/2462] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:05:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:05:49.408891 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e3f7d-7378-4f27-af09-437c3b679f6b None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:49.470473 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e3f7d-7378-4f27-af09-437c3b679f6b None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:49.474940 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527d4a0-0287-40a2-b446-ff649c325440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:49.475805 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527d4a0-0287-40a2-b446-ff649c325440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:49.476084 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527d4a0-0287-40a2-b446-ff649c325440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:49.476359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527d4a0-0287-40a2-b446-ff649c325440 admin admin] PATH_INFO: `/v3/users/e79abf79facc4ea7a7f1f62385b71724` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:49.477568 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527d4a0-0287-40a2-b446-ff649c325440 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e79abf79facc4ea7a7f1f62385b71724)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:49.479753 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527d4a0-0287-40a2-b446-ff649c325440 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:49.493653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:49.672234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0527d4a0-0287-40a2-b446-ff649c325440 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e79abf79facc4ea7a7f1f62385b71724'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:49.681332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0527d4a0-0287-40a2-b446-ff649c325440 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e79abf79facc4ea7a7f1f62385b71724'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:49.682420 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0527d4a0-0287-40a2-b446-ff649c325440 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e79abf79facc4ea7a7f1f62385b71724'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:49.682692 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0527d4a0-0287-40a2-b446-ff649c325440 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e79abf79facc4ea7a7f1f62385b71724'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:49.695522 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0527d4a0-0287-40a2-b446-ff649c325440 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e79abf79facc4ea7a7f1f62385b71724'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:49.771454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1254/2463] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:05:49 2022] DELETE /identity/v3/users/e79abf79facc4ea7a7f1f62385b71724 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:05:49.781960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9631f-9aea-472e-9f3d-fb2ca729c40f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:49.782535 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9631f-9aea-472e-9f3d-fb2ca729c40f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:49.782535 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9631f-9aea-472e-9f3d-fb2ca729c40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:49.802376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-a0b9631f-9aea-472e-9f3d-fb2ca729c40f None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:05:49.804006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a0b9631f-9aea-472e-9f3d-fb2ca729c40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:49.850057 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:49.863031 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1210/2464] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:05:49.872681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527d4a0-0287-40a2-b446-ff649c325440 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:49.874166 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0527d4a0-0287-40a2-b446-ff649c325440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:49.931113 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527d4a0-0287-40a2-b446-ff649c325440 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:49.934696 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872a347-d326-4944-b6f3-e2a0bf3e8c53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:49.935337 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872a347-d326-4944-b6f3-e2a0bf3e8c53 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:49.935616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872a347-d326-4944-b6f3-e2a0bf3e8c53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:49.935890 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872a347-d326-4944-b6f3-e2a0bf3e8c53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:49.944922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872a347-d326-4944-b6f3-e2a0bf3e8c53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:49.946361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872a347-d326-4944-b6f3-e2a0bf3e8c53 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:49.955945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1255/2465] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:05:50.454007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9631f-9aea-472e-9f3d-fb2ca729c40f None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:50.455574 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a0b9631f-9aea-472e-9f3d-fb2ca729c40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:50.468677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9631f-9aea-472e-9f3d-fb2ca729c40f None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:50.473405 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284289c7-0815-4b59-aeee-f845fe820450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:50.474615 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284289c7-0815-4b59-aeee-f845fe820450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:50.474757 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284289c7-0815-4b59-aeee-f845fe820450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:50.474935 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284289c7-0815-4b59-aeee-f845fe820450 admin admin] PATH_INFO: `/v3/projects/b4a801978d8a4b569cfe5ee0d87009f1` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:50.476117 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284289c7-0815-4b59-aeee-f845fe820450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4a801978d8a4b569cfe5ee0d87009f1)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:50.478180 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284289c7-0815-4b59-aeee-f845fe820450 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:50.584733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-284289c7-0815-4b59-aeee-f845fe820450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4a801978d8a4b569cfe5ee0d87009f1', 'request_id': 'req-284289c7-0815-4b59-aeee-f845fe820450'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:50.657598 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-284289c7-0815-4b59-aeee-f845fe820450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4a801978d8a4b569cfe5ee0d87009f1', 'request_id': 'req-284289c7-0815-4b59-aeee-f845fe820450'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:50.664084 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-284289c7-0815-4b59-aeee-f845fe820450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4a801978d8a4b569cfe5ee0d87009f1', 'request_id': 'req-284289c7-0815-4b59-aeee-f845fe820450'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:50.674408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-284289c7-0815-4b59-aeee-f845fe820450 admin admin] The token cache is being invalidate because project b4a801978d8a4b569cfe5ee0d87009f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:05:50.675370 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-284289c7-0815-4b59-aeee-f845fe820450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:50.676011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-284289c7-0815-4b59-aeee-f845fe820450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:05:50.677643 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1211/2466] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:05:50 2022] DELETE /identity/v3/projects/b4a801978d8a4b569cfe5ee0d87009f1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:05:59.140935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872a347-d326-4944-b6f3-e2a0bf3e8c53 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:05:59.142344 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6872a347-d326-4944-b6f3-e2a0bf3e8c53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:59.197750 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872a347-d326-4944-b6f3-e2a0bf3e8c53 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:05:59.245911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c537e7-b85c-4024-a63c-150307b92afd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:05:59.246569 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c537e7-b85c-4024-a63c-150307b92afd service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:05:59.246854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c537e7-b85c-4024-a63c-150307b92afd service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:05:59.247132 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c537e7-b85c-4024-a63c-150307b92afd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:05:59.248990 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-97c537e7-b85c-4024-a63c-150307b92afd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:05:59.253961 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:05:59.320549 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c537e7-b85c-4024-a63c-150307b92afd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:05:59.321959 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c537e7-b85c-4024-a63c-150307b92afd service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:05:59.333199 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1256/2467] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:05:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:00.671495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=30,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:08.863958 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284289c7-0815-4b59-aeee-f845fe820450 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:08.865386 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-284289c7-0815-4b59-aeee-f845fe820450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:08.879473 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284289c7-0815-4b59-aeee-f845fe820450 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:08.883735 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de30e68-a9ee-4c9c-bfc1-c7659102935e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:08.884384 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de30e68-a9ee-4c9c-bfc1-c7659102935e service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:08.884689 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de30e68-a9ee-4c9c-bfc1-c7659102935e service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:08.884995 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de30e68-a9ee-4c9c-bfc1-c7659102935e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:08.886828 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1de30e68-a9ee-4c9c-bfc1-c7659102935e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:08.902620 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de30e68-a9ee-4c9c-bfc1-c7659102935e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:08.904003 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de30e68-a9ee-4c9c-bfc1-c7659102935e service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:08.916171 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1212/2468] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:09.389215 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=31 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:10.977403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c537e7-b85c-4024-a63c-150307b92afd service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:10.978846 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-97c537e7-b85c-4024-a63c-150307b92afd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:10.993799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c537e7-b85c-4024-a63c-150307b92afd service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:10.999218 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585801ca-48dc-4b58-aaea-e33bbb4622f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:10.999856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585801ca-48dc-4b58-aaea-e33bbb4622f9 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:11.000140 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585801ca-48dc-4b58-aaea-e33bbb4622f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:11.000413 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585801ca-48dc-4b58-aaea-e33bbb4622f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:11.002163 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-585801ca-48dc-4b58-aaea-e33bbb4622f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:11.059052 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585801ca-48dc-4b58-aaea-e33bbb4622f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:11.060692 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585801ca-48dc-4b58-aaea-e33bbb4622f9 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:11.070488 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1257/2469] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:18.824400 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380a781-0e9d-4854-811b-69e6a4454eac None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:18.824973 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380a781-0e9d-4854-811b-69e6a4454eac None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:18.824973 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380a781-0e9d-4854-811b-69e6a4454eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:18.842752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-8380a781-0e9d-4854-811b-69e6a4454eac None None] MFA Rules not processed for user `aa97e27060b3429bbad061a256db19f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:18.843945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8380a781-0e9d-4854-811b-69e6a4454eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:18.851324 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1213/2470] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:06:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:19.150560 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585801ca-48dc-4b58-aaea-e33bbb4622f9 service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:19.152002 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-585801ca-48dc-4b58-aaea-e33bbb4622f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:19.206927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585801ca-48dc-4b58-aaea-e33bbb4622f9 service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:19.211077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d60cd-251a-48a2-93f7-96f95282ec75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:19.211718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d60cd-251a-48a2-93f7-96f95282ec75 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:19.212002 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d60cd-251a-48a2-93f7-96f95282ec75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:19.212288 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d60cd-251a-48a2-93f7-96f95282ec75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:19.214056 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e91d60cd-251a-48a2-93f7-96f95282ec75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:19.223267 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d60cd-251a-48a2-93f7-96f95282ec75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:19.224731 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d60cd-251a-48a2-93f7-96f95282ec75 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:19.233437 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1258/2471] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:19.609336 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380a781-0e9d-4854-811b-69e6a4454eac None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:19.610743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8380a781-0e9d-4854-811b-69e6a4454eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:19.682444 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380a781-0e9d-4854-811b-69e6a4454eac None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:19.687425 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf57eb0-0dc7-40ef-9e8b-2f7684dc1949 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43b85b5c7b1e4d73b29fb96f4fa6db71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:19.688077 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf57eb0-0dc7-40ef-9e8b-2f7684dc1949 service placement] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:19.688363 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf57eb0-0dc7-40ef-9e8b-2f7684dc1949 service placement] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:19.688704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf57eb0-0dc7-40ef-9e8b-2f7684dc1949 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:19.690472 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-adf57eb0-0dc7-40ef-9e8b-2f7684dc1949 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:19.702800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf57eb0-0dc7-40ef-9e8b-2f7684dc1949 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:19.704376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf57eb0-0dc7-40ef-9e8b-2f7684dc1949 service placement] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:19.714935 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1214/2472] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:20.313991 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d60cd-251a-48a2-93f7-96f95282ec75 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:20.323182 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d60cd-251a-48a2-93f7-96f95282ec75 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:20.326718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d809603-7307-4be8-a831-6df6b91b6a27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:20.327365 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d809603-7307-4be8-a831-6df6b91b6a27 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:20.327624 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d809603-7307-4be8-a831-6df6b91b6a27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:20.327896 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d809603-7307-4be8-a831-6df6b91b6a27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:20.329673 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3d809603-7307-4be8-a831-6df6b91b6a27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:20.390974 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d809603-7307-4be8-a831-6df6b91b6a27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:20.392456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d809603-7307-4be8-a831-6df6b91b6a27 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:20.402476 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1259/2473] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:06:27.057713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf57eb0-0dc7-40ef-9e8b-2f7684dc1949 service placement] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:27.059262 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-adf57eb0-0dc7-40ef-9e8b-2f7684dc1949 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:27.072321 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf57eb0-0dc7-40ef-9e8b-2f7684dc1949 service placement] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:27.075905 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37417d59-0861-4e1a-8267-98acd4b3f5c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:27.076548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37417d59-0861-4e1a-8267-98acd4b3f5c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:27.076866 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37417d59-0861-4e1a-8267-98acd4b3f5c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:27.077161 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37417d59-0861-4e1a-8267-98acd4b3f5c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:27.079224 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-37417d59-0861-4e1a-8267-98acd4b3f5c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:27.089803 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37417d59-0861-4e1a-8267-98acd4b3f5c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:27.091243 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37417d59-0861-4e1a-8267-98acd4b3f5c2 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:27.099435 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1215/2474] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:28.838121 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d809603-7307-4be8-a831-6df6b91b6a27 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:28.856998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d809603-7307-4be8-a831-6df6b91b6a27 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:28.866578 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b7546-34f9-4024-bd6d-9982471ef3be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:28.869687 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b7546-34f9-4024-bd6d-9982471ef3be service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:28.869687 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b7546-34f9-4024-bd6d-9982471ef3be service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:28.869687 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b7546-34f9-4024-bd6d-9982471ef3be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:28.870205 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-132b7546-34f9-4024-bd6d-9982471ef3be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:28.913127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:28.936027 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b7546-34f9-4024-bd6d-9982471ef3be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:28.937749 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b7546-34f9-4024-bd6d-9982471ef3be service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:28.947923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1260/2475] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:35.071230 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37417d59-0861-4e1a-8267-98acd4b3f5c2 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:35.079251 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=48 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:35.086462 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37417d59-0861-4e1a-8267-98acd4b3f5c2 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:35.093007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23403612-f8fa-4258-bc89-4ec16637f332 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:35.093737 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23403612-f8fa-4258-bc89-4ec16637f332 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:35.094095 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23403612-f8fa-4258-bc89-4ec16637f332 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:35.094444 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23403612-f8fa-4258-bc89-4ec16637f332 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:35.097601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-23403612-f8fa-4258-bc89-4ec16637f332 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:35.111438 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23403612-f8fa-4258-bc89-4ec16637f332 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:35.113651 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23403612-f8fa-4258-bc89-4ec16637f332 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:35.125081 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1216/2476] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:39.023211 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=10 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:45.142698 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=5 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:46.379762 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b7546-34f9-4024-bd6d-9982471ef3be service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:46.391310 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b7546-34f9-4024-bd6d-9982471ef3be service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:46.395291 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76e99f-4344-4117-a1e2-06cab12405e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:46.395949 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76e99f-4344-4117-a1e2-06cab12405e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:46.396235 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76e99f-4344-4117-a1e2-06cab12405e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:46.396758 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76e99f-4344-4117-a1e2-06cab12405e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:46.398967 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-eb76e99f-4344-4117-a1e2-06cab12405e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:46.480393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76e99f-4344-4117-a1e2-06cab12405e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:46.482016 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76e99f-4344-4117-a1e2-06cab12405e2 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:46.493848 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1261/2477] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:48.124744 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c85128-689b-476c-9d3b-ce7f2f63d2b3 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:48.132465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c85128-689b-476c-9d3b-ce7f2f63d2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:48.132465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c85128-689b-476c-9d3b-ce7f2f63d2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:48.152177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e8c85128-689b-476c-9d3b-ce7f2f63d2b3 None None] MFA Rules not processed for user `ab47c91ba7854bc09f656607dbb41cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:48.153947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e8c85128-689b-476c-9d3b-ce7f2f63d2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:48.217286 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1217/2478] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jul 5 13:06:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:48.376554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76e99f-4344-4117-a1e2-06cab12405e2 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:48.378273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-eb76e99f-4344-4117-a1e2-06cab12405e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:48.495977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76e99f-4344-4117-a1e2-06cab12405e2 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:48.502225 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cd904-caa1-4d81-ac5f-3bd4d55763c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fb7db02f8e945a7af39cb30c3d606f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:48.502892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cd904-caa1-4d81-ac5f-3bd4d55763c9 service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:48.503183 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cd904-caa1-4d81-ac5f-3bd4d55763c9 service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:48.503462 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cd904-caa1-4d81-ac5f-3bd4d55763c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:48.515282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cd904-caa1-4d81-ac5f-3bd4d55763c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:48.517413 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cd904-caa1-4d81-ac5f-3bd4d55763c9 service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:48.527241 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1262/2479] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jul 5 13:06:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:06:49.848071 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c85128-689b-476c-9d3b-ce7f2f63d2b3 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:49.870491 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c85128-689b-476c-9d3b-ce7f2f63d2b3 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:49.876889 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b930d90-1d42-4241-baa3-0a8b306c6dc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:49.877598 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b930d90-1d42-4241-baa3-0a8b306c6dc3 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:49.877820 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b930d90-1d42-4241-baa3-0a8b306c6dc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:49.878218 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b930d90-1d42-4241-baa3-0a8b306c6dc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:49.881138 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4b930d90-1d42-4241-baa3-0a8b306c6dc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:49.898259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b930d90-1d42-4241-baa3-0a8b306c6dc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:49.900173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b930d90-1d42-4241-baa3-0a8b306c6dc3 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:49.913937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1218/2480] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:06:51.557725 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cd904-caa1-4d81-ac5f-3bd4d55763c9 service swift] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:51.559292 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-074cd904-caa1-4d81-ac5f-3bd4d55763c9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:51.602260 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cd904-caa1-4d81-ac5f-3bd4d55763c9 service swift] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:51.611377 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe03586-bcc2-47fb-afcc-df587066930f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:51.612720 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe03586-bcc2-47fb-afcc-df587066930f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:51.613327 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe03586-bcc2-47fb-afcc-df587066930f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:51.613839 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe03586-bcc2-47fb-afcc-df587066930f admin admin] PATH_INFO: `/v3/users/ad3f91c024f8415cac4784fec0689757` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:51.615553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe03586-bcc2-47fb-afcc-df587066930f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3f91c024f8415cac4784fec0689757)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:51.618851 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe03586-bcc2-47fb-afcc-df587066930f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:52.107051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ffe03586-bcc2-47fb-afcc-df587066930f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3f91c024f8415cac4784fec0689757'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:52.114077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ffe03586-bcc2-47fb-afcc-df587066930f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3f91c024f8415cac4784fec0689757'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:52.186364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ffe03586-bcc2-47fb-afcc-df587066930f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3f91c024f8415cac4784fec0689757'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:52.186364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ffe03586-bcc2-47fb-afcc-df587066930f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3f91c024f8415cac4784fec0689757'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:52.186364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ffe03586-bcc2-47fb-afcc-df587066930f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3f91c024f8415cac4784fec0689757'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:52.186364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:52.411269 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1263/2481] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:06:51 2022] DELETE /identity/v3/users/ad3f91c024f8415cac4784fec0689757 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:52.722722 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b930d90-1d42-4241-baa3-0a8b306c6dc3 service nova] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:52.744200 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b930d90-1d42-4241-baa3-0a8b306c6dc3 service nova] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:52.812219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba8e66-5520-40a3-acfb-d0dd3170261e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:52.813962 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba8e66-5520-40a3-acfb-d0dd3170261e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:52.814620 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba8e66-5520-40a3-acfb-d0dd3170261e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:52.815136 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba8e66-5520-40a3-acfb-d0dd3170261e admin admin] PATH_INFO: `/v3/projects/7836a0ee154744b49a323e6b94860e50` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:52.816575 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba8e66-5520-40a3-acfb-d0dd3170261e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7836a0ee154744b49a323e6b94860e50)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:52.823032 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba8e66-5520-40a3-acfb-d0dd3170261e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:52.931732 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-faba8e66-5520-40a3-acfb-d0dd3170261e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7836a0ee154744b49a323e6b94860e50', 'request_id': 'req-faba8e66-5520-40a3-acfb-d0dd3170261e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:53.008260 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-faba8e66-5520-40a3-acfb-d0dd3170261e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7836a0ee154744b49a323e6b94860e50', 'request_id': 'req-faba8e66-5520-40a3-acfb-d0dd3170261e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:53.016883 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-faba8e66-5520-40a3-acfb-d0dd3170261e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7836a0ee154744b49a323e6b94860e50', 'request_id': 'req-faba8e66-5520-40a3-acfb-d0dd3170261e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:53.030091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-faba8e66-5520-40a3-acfb-d0dd3170261e admin admin] The token cache is being invalidate because project 7836a0ee154744b49a323e6b94860e50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:06:53.030709 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-faba8e66-5520-40a3-acfb-d0dd3170261e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:53.031594 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-faba8e66-5520-40a3-acfb-d0dd3170261e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:06:53.033593 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1219/2482] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:06:52 2022] DELETE /identity/v3/projects/7836a0ee154744b49a323e6b94860e50 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:53.038704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8279c6-7d9d-4a91-b369-a57613958c15 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:53.039774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8279c6-7d9d-4a91-b369-a57613958c15 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:53.040111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8279c6-7d9d-4a91-b369-a57613958c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:53.067728 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-4e8279c6-7d9d-4a91-b369-a57613958c15 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:53.069633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4e8279c6-7d9d-4a91-b369-a57613958c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:53.148051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1264/2483] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:53.158319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35df26-3ae9-42b1-98ec-54b2dfa99322 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:53.158579 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35df26-3ae9-42b1-98ec-54b2dfa99322 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:53.158863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35df26-3ae9-42b1-98ec-54b2dfa99322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:53.180818 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-bd35df26-3ae9-42b1-98ec-54b2dfa99322 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:53.182025 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-bd35df26-3ae9-42b1-98ec-54b2dfa99322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:53.191926 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1220/2484] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:53.196284 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8279c6-7d9d-4a91-b369-a57613958c15 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:53.209410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8279c6-7d9d-4a91-b369-a57613958c15 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:53.215892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746be53-799e-43a2-b982-9734fd3a3a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:53.216622 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746be53-799e-43a2-b982-9734fd3a3a3c admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:53.216981 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746be53-799e-43a2-b982-9734fd3a3a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:53.217264 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746be53-799e-43a2-b982-9734fd3a3a3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:53.218139 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746be53-799e-43a2-b982-9734fd3a3a3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:06:53.219234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746be53-799e-43a2-b982-9734fd3a3a3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:53.221544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746be53-799e-43a2-b982-9734fd3a3a3c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:53.249148 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35df26-3ae9-42b1-98ec-54b2dfa99322 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:53.257404 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1265/2485] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:06:53.265279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35df26-3ae9-42b1-98ec-54b2dfa99322 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:53.271990 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ae584-bd12-4c0e-8a0f-dc8e0ebbf876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:53.272818 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ae584-bd12-4c0e-8a0f-dc8e0ebbf876 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:53.273102 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ae584-bd12-4c0e-8a0f-dc8e0ebbf876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:53.273375 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ae584-bd12-4c0e-8a0f-dc8e0ebbf876 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:53.274067 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ae584-bd12-4c0e-8a0f-dc8e0ebbf876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:53.276028 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ae584-bd12-4c0e-8a0f-dc8e0ebbf876 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:53.292489 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:06:53.403471 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1221/2486] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:06:53 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:06:53.406847 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746be53-799e-43a2-b982-9734fd3a3a3c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:53.433638 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746be53-799e-43a2-b982-9734fd3a3a3c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:53.540443 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e924dfc-6d80-4702-9bf4-9236652e0059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:53.541287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e924dfc-6d80-4702-9bf4-9236652e0059 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:53.541700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e924dfc-6d80-4702-9bf4-9236652e0059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:53.542116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e924dfc-6d80-4702-9bf4-9236652e0059 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:53.543108 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e924dfc-6d80-4702-9bf4-9236652e0059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:53.545190 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e924dfc-6d80-4702-9bf4-9236652e0059 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:53.636651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1266/2487] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:06:53 2022] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:06:53.640943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ae584-bd12-4c0e-8a0f-dc8e0ebbf876 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:53.664950 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ae584-bd12-4c0e-8a0f-dc8e0ebbf876 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:53.686081 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698ad11-5c8a-4459-9dde-27f98d72392c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:53.687045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698ad11-5c8a-4459-9dde-27f98d72392c admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:53.687556 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698ad11-5c8a-4459-9dde-27f98d72392c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:53.688045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698ad11-5c8a-4459-9dde-27f98d72392c admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:53.689320 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698ad11-5c8a-4459-9dde-27f98d72392c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:53.691594 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698ad11-5c8a-4459-9dde-27f98d72392c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:53.716963 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e924dfc-6d80-4702-9bf4-9236652e0059 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:53.722959 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1222/2488] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:06:53.736007 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e924dfc-6d80-4702-9bf4-9236652e0059 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:53.741124 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e37029-0306-4a14-85f5-cfb65a5c8ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:53.742060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e37029-0306-4a14-85f5-cfb65a5c8ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:53.742562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e37029-0306-4a14-85f5-cfb65a5c8ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:53.743035 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e37029-0306-4a14-85f5-cfb65a5c8ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:53.743957 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e37029-0306-4a14-85f5-cfb65a5c8ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:53.745952 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e37029-0306-4a14-85f5-cfb65a5c8ef1 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:53.760639 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1267/2489] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:06:53.763084 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698ad11-5c8a-4459-9dde-27f98d72392c admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:53.776978 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698ad11-5c8a-4459-9dde-27f98d72392c admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:53.781651 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8e175-9740-4a81-a67c-071b8bf6befa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:53.782892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8e175-9740-4a81-a67c-071b8bf6befa admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:53.783177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8e175-9740-4a81-a67c-071b8bf6befa admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:53.788712 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8e175-9740-4a81-a67c-071b8bf6befa admin admin] PATH_INFO: `/v3/projects/a9e9afdc843646768800da2ede466298/users/15ce49dfe7d0401caa1784c35b2ef90e/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:53.805965 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8e175-9740-4a81-a67c-071b8bf6befa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e9afdc843646768800da2ede466298, user_id=15ce49dfe7d0401caa1784c35b2ef90e, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:53.811160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8e175-9740-4a81-a67c-071b8bf6befa admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:53.905942 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1223/2490] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:06:53 2022] PUT /identity/v3/projects/a9e9afdc843646768800da2ede466298/users/15ce49dfe7d0401caa1784c35b2ef90e/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:06:53.911118 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcaae2-785b-4612-9067-24ae74c17c11 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:53.911412 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcaae2-785b-4612-9067-24ae74c17c11 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:53.912405 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcaae2-785b-4612-9067-24ae74c17c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:53.935536 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-acfcaae2-785b-4612-9067-24ae74c17c11 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:06:53.941700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-acfcaae2-785b-4612-9067-24ae74c17c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:54.019929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1268/2491] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:06:54.025707 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8e175-9740-4a81-a67c-071b8bf6befa admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:06:54.029745 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ead8e175-9740-4a81-a67c-071b8bf6befa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:06:54.127937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8e175-9740-4a81-a67c-071b8bf6befa admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:06:54.132626 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce59829-8f96-4123-aa01-5f7d9da00fa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:06:54.133595 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce59829-8f96-4123-aa01-5f7d9da00fa4 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:06:54.134080 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce59829-8f96-4123-aa01-5f7d9da00fa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:06:54.134577 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce59829-8f96-4123-aa01-5f7d9da00fa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:06:54.148301 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce59829-8f96-4123-aa01-5f7d9da00fa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:06:54.150119 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce59829-8f96-4123-aa01-5f7d9da00fa4 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:06:54.164994 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1224/2492] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:07:01.304233 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fb349-18bc-46b8-a7d0-ad0fe77ff211 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:01.304753 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fb349-18bc-46b8-a7d0-ad0fe77ff211 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:01.304867 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fb349-18bc-46b8-a7d0-ad0fe77ff211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:01.310733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:01.341021 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-2f7fb349-18bc-46b8-a7d0-ad0fe77ff211 None None] MFA Rules not processed for user `15ce49dfe7d0401caa1784c35b2ef90e`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:01.342476 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2f7fb349-18bc-46b8-a7d0-ad0fe77ff211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:01.417565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1269/2493] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:07:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:01.431395 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce59829-8f96-4123-aa01-5f7d9da00fa4 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:01.433119 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0ce59829-8f96-4123-aa01-5f7d9da00fa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:01.516946 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce59829-8f96-4123-aa01-5f7d9da00fa4 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:01.523778 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06390157-96a0-4245-9db8-62a33171d093 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:01.524461 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06390157-96a0-4245-9db8-62a33171d093 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:01.524781 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06390157-96a0-4245-9db8-62a33171d093 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:01.525113 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06390157-96a0-4245-9db8-62a33171d093 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:01.534477 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06390157-96a0-4245-9db8-62a33171d093 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:01.537503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06390157-96a0-4245-9db8-62a33171d093 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:01.548852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1225/2494] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:07:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:07:04.670727 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b7820-d2b7-4453-8826-bbc81e5e876e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:04.682177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b7820-d2b7-4453-8826-bbc81e5e876e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:04.682177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b7820-d2b7-4453-8826-bbc81e5e876e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:04.704184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-ac6b7820-d2b7-4453-8826-bbc81e5e876e None None] MFA Rules not processed for user `15ce49dfe7d0401caa1784c35b2ef90e`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:04.705858 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ac6b7820-d2b7-4453-8826-bbc81e5e876e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:04.720641 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1270/2495] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:07:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:11.201724 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2c403-1f49-4b89-b8b6-e5902ca23e10 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:11.202564 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2c403-1f49-4b89-b8b6-e5902ca23e10 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:11.202999 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2c403-1f49-4b89-b8b6-e5902ca23e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:11.227879 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e1c2c403-1f49-4b89-b8b6-e5902ca23e10 None None] MFA Rules not processed for user `ab47c91ba7854bc09f656607dbb41cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:11.230598 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e1c2c403-1f49-4b89-b8b6-e5902ca23e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:11.293963 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:11.309275 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1226/2496] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jul 5 13:07:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:11.321197 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b7820-d2b7-4453-8826-bbc81e5e876e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:11.322652 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ac6b7820-d2b7-4453-8826-bbc81e5e876e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:11.406235 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b7820-d2b7-4453-8826-bbc81e5e876e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:11.411571 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38209792-7c0c-4ea4-b6ca-2e86d7ad513b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fb7db02f8e945a7af39cb30c3d606f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:11.412389 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38209792-7c0c-4ea4-b6ca-2e86d7ad513b service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:11.412790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38209792-7c0c-4ea4-b6ca-2e86d7ad513b service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:11.413140 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38209792-7c0c-4ea4-b6ca-2e86d7ad513b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:11.421688 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38209792-7c0c-4ea4-b6ca-2e86d7ad513b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:11.423318 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38209792-7c0c-4ea4-b6ca-2e86d7ad513b service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:11.432576 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1271/2497] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jul 5 13:07:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:07:21.428453 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=66 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:21.536537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:27.719892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883f904-3c14-482c-9a9e-36c958565b58 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:27.719892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883f904-3c14-482c-9a9e-36c958565b58 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:27.719892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883f904-3c14-482c-9a9e-36c958565b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:27.738458 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2883f904-3c14-482c-9a9e-36c958565b58 None None] MFA Rules not processed for user `ab47c91ba7854bc09f656607dbb41cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:27.739666 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2883f904-3c14-482c-9a9e-36c958565b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:27.746788 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1227/2498] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jul 5 13:07:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:27.759459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38209792-7c0c-4ea4-b6ca-2e86d7ad513b service swift] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:27.770301 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38209792-7c0c-4ea4-b6ca-2e86d7ad513b service swift] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:27.776059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e13f60-f6c7-45d6-938a-1b89e901216a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fb7db02f8e945a7af39cb30c3d606f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:27.776999 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e13f60-f6c7-45d6-938a-1b89e901216a service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:27.777280 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e13f60-f6c7-45d6-938a-1b89e901216a service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:27.777556 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e13f60-f6c7-45d6-938a-1b89e901216a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:27.791996 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e13f60-f6c7-45d6-938a-1b89e901216a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:27.795124 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e13f60-f6c7-45d6-938a-1b89e901216a service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:27.802331 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1272/2499] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jul 5 13:07:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:07:29.179952 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977682b-291c-4fce-bc85-d75fb8e1a7bc None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:29.180551 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977682b-291c-4fce-bc85-d75fb8e1a7bc None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:29.180551 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977682b-291c-4fce-bc85-d75fb8e1a7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:29.198241 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-0977682b-291c-4fce-bc85-d75fb8e1a7bc None None] MFA Rules not processed for user `661062780f5c45d180a05e402fc7bc27`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:29.199436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0977682b-291c-4fce-bc85-d75fb8e1a7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:29.252979 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1228/2500] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:07:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:31.888858 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e13f60-f6c7-45d6-938a-1b89e901216a service swift] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:31.890498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f8e13f60-f6c7-45d6-938a-1b89e901216a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:31.910516 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e13f60-f6c7-45d6-938a-1b89e901216a service swift] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:31.920810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2870b-795b-4dd1-8634-606d4247bb3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:31.924260 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2870b-795b-4dd1-8634-606d4247bb3a service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:31.924260 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2870b-795b-4dd1-8634-606d4247bb3a service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:31.924260 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2870b-795b-4dd1-8634-606d4247bb3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:31.924260 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-79e2870b-795b-4dd1-8634-606d4247bb3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:31.939137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2870b-795b-4dd1-8634-606d4247bb3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:31.940802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2870b-795b-4dd1-8634-606d4247bb3a service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:31.962348 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1273/2501] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:07:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:07:39.246364 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=28 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:41.948463 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=12 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:44.758871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977682b-291c-4fce-bc85-d75fb8e1a7bc None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:44.768401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977682b-291c-4fce-bc85-d75fb8e1a7bc None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:44.772002 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b689e2-1794-4120-bfd5-7a5f9221400c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:44.772671 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b689e2-1794-4120-bfd5-7a5f9221400c service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:44.772963 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b689e2-1794-4120-bfd5-7a5f9221400c service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:44.773274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b689e2-1794-4120-bfd5-7a5f9221400c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:44.776100 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a5b689e2-1794-4120-bfd5-7a5f9221400c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:44.787506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b689e2-1794-4120-bfd5-7a5f9221400c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:44.788997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b689e2-1794-4120-bfd5-7a5f9221400c service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:44.798725 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1229/2502] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:07:48.922358 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2870b-795b-4dd1-8634-606d4247bb3a service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:48.923851 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-79e2870b-795b-4dd1-8634-606d4247bb3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:48.941330 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2870b-795b-4dd1-8634-606d4247bb3a service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:48.943988 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606804f8-1d2b-4412-a980-5f5b06394ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:48.944911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606804f8-1d2b-4412-a980-5f5b06394ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:48.945804 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606804f8-1d2b-4412-a980-5f5b06394ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:48.946086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606804f8-1d2b-4412-a980-5f5b06394ad8 admin admin] PATH_INFO: `/v3/users/aa97e27060b3429bbad061a256db19f1` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:48.947311 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606804f8-1d2b-4412-a980-5f5b06394ad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa97e27060b3429bbad061a256db19f1)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:48.949332 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606804f8-1d2b-4412-a980-5f5b06394ad8 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:49.156399 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-606804f8-1d2b-4412-a980-5f5b06394ad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa97e27060b3429bbad061a256db19f1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:49.164207 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-606804f8-1d2b-4412-a980-5f5b06394ad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa97e27060b3429bbad061a256db19f1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:49.164955 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-606804f8-1d2b-4412-a980-5f5b06394ad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa97e27060b3429bbad061a256db19f1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:49.165581 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-606804f8-1d2b-4412-a980-5f5b06394ad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa97e27060b3429bbad061a256db19f1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:49.177816 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-606804f8-1d2b-4412-a980-5f5b06394ad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa97e27060b3429bbad061a256db19f1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:49.296950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1274/2503] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:07:48 2022] DELETE /identity/v3/users/aa97e27060b3429bbad061a256db19f1 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:49.783022 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b689e2-1794-4120-bfd5-7a5f9221400c service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:49.793660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b689e2-1794-4120-bfd5-7a5f9221400c service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:49.850134 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a28a7-94c3-4234-b0be-0b9b8800c49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:49.851017 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a28a7-94c3-4234-b0be-0b9b8800c49b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:49.851299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a28a7-94c3-4234-b0be-0b9b8800c49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:49.851575 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a28a7-94c3-4234-b0be-0b9b8800c49b admin admin] PATH_INFO: `/v3/projects/163f0d5f47be49f493296f228d1080a5` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:49.853319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a28a7-94c3-4234-b0be-0b9b8800c49b admin admin] RBAC: Authorizing `identity:delete_project(project_id=163f0d5f47be49f493296f228d1080a5)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:49.855219 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a28a7-94c3-4234-b0be-0b9b8800c49b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:49.978929 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e74a28a7-94c3-4234-b0be-0b9b8800c49b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '163f0d5f47be49f493296f228d1080a5', 'request_id': 'req-e74a28a7-94c3-4234-b0be-0b9b8800c49b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:50.067626 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e74a28a7-94c3-4234-b0be-0b9b8800c49b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '163f0d5f47be49f493296f228d1080a5', 'request_id': 'req-e74a28a7-94c3-4234-b0be-0b9b8800c49b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:50.075161 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e74a28a7-94c3-4234-b0be-0b9b8800c49b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '163f0d5f47be49f493296f228d1080a5', 'request_id': 'req-e74a28a7-94c3-4234-b0be-0b9b8800c49b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:50.085873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e74a28a7-94c3-4234-b0be-0b9b8800c49b admin admin] The token cache is being invalidate because project 163f0d5f47be49f493296f228d1080a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:07:50.086168 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e74a28a7-94c3-4234-b0be-0b9b8800c49b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:50.087432 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e74a28a7-94c3-4234-b0be-0b9b8800c49b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:50.089091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1230/2504] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:07:49 2022] DELETE /identity/v3/projects/163f0d5f47be49f493296f228d1080a5 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:50.093925 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cacb7-dced-4e50-93bb-5c5a68fd20b0 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:50.094415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cacb7-dced-4e50-93bb-5c5a68fd20b0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:50.094557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cacb7-dced-4e50-93bb-5c5a68fd20b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:50.112659 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-323cacb7-dced-4e50-93bb-5c5a68fd20b0 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:50.113865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-323cacb7-dced-4e50-93bb-5c5a68fd20b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:50.172805 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1275/2505] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:07:50.180280 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d9fb2-755f-4249-a720-61a1dc232027 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:50.180575 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d9fb2-755f-4249-a720-61a1dc232027 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:50.180886 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d9fb2-755f-4249-a720-61a1dc232027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:50.199678 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-5a7d9fb2-755f-4249-a720-61a1dc232027 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:50.200933 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5a7d9fb2-755f-4249-a720-61a1dc232027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:50.209000 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1231/2506] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:50.213805 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cacb7-dced-4e50-93bb-5c5a68fd20b0 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:50.223805 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cacb7-dced-4e50-93bb-5c5a68fd20b0 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:50.228896 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79dba0-4ab3-48dd-b0aa-b6496034a87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:50.229566 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79dba0-4ab3-48dd-b0aa-b6496034a87a admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:50.229863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79dba0-4ab3-48dd-b0aa-b6496034a87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:50.230107 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79dba0-4ab3-48dd-b0aa-b6496034a87a admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:50.231281 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79dba0-4ab3-48dd-b0aa-b6496034a87a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:07:50.231526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79dba0-4ab3-48dd-b0aa-b6496034a87a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:50.233253 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79dba0-4ab3-48dd-b0aa-b6496034a87a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:50.246750 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1276/2507] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:07:50.251137 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d9fb2-755f-4249-a720-61a1dc232027 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:50.262313 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d9fb2-755f-4249-a720-61a1dc232027 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:50.267389 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bc867-ba19-4d4e-a1f3-a58a163c80ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:50.268055 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bc867-ba19-4d4e-a1f3-a58a163c80ef admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:50.268339 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bc867-ba19-4d4e-a1f3-a58a163c80ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:50.268680 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bc867-ba19-4d4e-a1f3-a58a163c80ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:50.269561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bc867-ba19-4d4e-a1f3-a58a163c80ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:50.271595 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bc867-ba19-4d4e-a1f3-a58a163c80ef admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:50.426470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1232/2508] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:07:50 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:07:50.428281 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79dba0-4ab3-48dd-b0aa-b6496034a87a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:50.439083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79dba0-4ab3-48dd-b0aa-b6496034a87a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:50.495066 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ac263-eaad-4a11-8f56-7cdb5af03157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:50.495747 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ac263-eaad-4a11-8f56-7cdb5af03157 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:50.496038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ac263-eaad-4a11-8f56-7cdb5af03157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:50.496322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ac263-eaad-4a11-8f56-7cdb5af03157 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:50.497044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ac263-eaad-4a11-8f56-7cdb5af03157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:50.499008 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ac263-eaad-4a11-8f56-7cdb5af03157 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:50.505598 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:50.642677 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1277/2509] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:07:50 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:07:50.647516 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bc867-ba19-4d4e-a1f3-a58a163c80ef admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:50.669328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bc867-ba19-4d4e-a1f3-a58a163c80ef admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:50.669328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c005d3f-55a7-47da-8f1f-e4b958c7dc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:50.669328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c005d3f-55a7-47da-8f1f-e4b958c7dc6d admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:50.669775 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c005d3f-55a7-47da-8f1f-e4b958c7dc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:50.669910 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c005d3f-55a7-47da-8f1f-e4b958c7dc6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:50.670592 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c005d3f-55a7-47da-8f1f-e4b958c7dc6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:50.672198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c005d3f-55a7-47da-8f1f-e4b958c7dc6d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:50.684970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1233/2510] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:07:50.689177 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ac263-eaad-4a11-8f56-7cdb5af03157 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:50.701901 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ac263-eaad-4a11-8f56-7cdb5af03157 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:50.706564 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92dcff0-7713-4002-af4e-ebb43bb1e13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:50.707235 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dcff0-7713-4002-af4e-ebb43bb1e13f admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:50.707567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dcff0-7713-4002-af4e-ebb43bb1e13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:50.707838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dcff0-7713-4002-af4e-ebb43bb1e13f admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:50.708603 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92dcff0-7713-4002-af4e-ebb43bb1e13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:50.710302 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92dcff0-7713-4002-af4e-ebb43bb1e13f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:50.723653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1278/2511] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:07:50.727519 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c005d3f-55a7-47da-8f1f-e4b958c7dc6d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:50.737781 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c005d3f-55a7-47da-8f1f-e4b958c7dc6d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:50.742335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55de206-06f3-4972-9228-49ba520c69b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:50.743705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55de206-06f3-4972-9228-49ba520c69b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:50.743982 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55de206-06f3-4972-9228-49ba520c69b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:50.744258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55de206-06f3-4972-9228-49ba520c69b9 admin admin] PATH_INFO: `/v3/projects/21152f748d68413ca8f807e5111ab8a3/users/a0c6d56f4960497b85e1e171db8a3065/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:50.759264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55de206-06f3-4972-9228-49ba520c69b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21152f748d68413ca8f807e5111ab8a3, user_id=a0c6d56f4960497b85e1e171db8a3065, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:50.762005 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55de206-06f3-4972-9228-49ba520c69b9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:50.898160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1234/2512] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:07:50 2022] PUT /identity/v3/projects/21152f748d68413ca8f807e5111ab8a3/users/a0c6d56f4960497b85e1e171db8a3065/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:50.908863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430f290-cc00-48e9-88d9-f3cd13030b73 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:50.909151 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430f290-cc00-48e9-88d9-f3cd13030b73 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:50.909428 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430f290-cc00-48e9-88d9-f3cd13030b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:50.937086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-2430f290-cc00-48e9-88d9-f3cd13030b73 None None] MFA Rules not processed for user `a0c6d56f4960497b85e1e171db8a3065`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:50.938643 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2430f290-cc00-48e9-88d9-f3cd13030b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:51.001790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1279/2513] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:07:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:51.012706 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55de206-06f3-4972-9228-49ba520c69b9 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:51.014396 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b55de206-06f3-4972-9228-49ba520c69b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:51.020938 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:51.086280 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55de206-06f3-4972-9228-49ba520c69b9 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:51.091955 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847ef32-e22c-47c9-85ce-1117ab93035a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:51.092612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847ef32-e22c-47c9-85ce-1117ab93035a service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:51.092902 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847ef32-e22c-47c9-85ce-1117ab93035a service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:51.093178 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847ef32-e22c-47c9-85ce-1117ab93035a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:51.100740 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847ef32-e22c-47c9-85ce-1117ab93035a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:51.102874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847ef32-e22c-47c9-85ce-1117ab93035a service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:51.111681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1235/2514] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:07:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:07:51.318217 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430f290-cc00-48e9-88d9-f3cd13030b73 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:51.379533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430f290-cc00-48e9-88d9-f3cd13030b73 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:51.384018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371946e7-192e-4e43-b1e4-1d539ffffbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:51.384914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371946e7-192e-4e43-b1e4-1d539ffffbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:51.385201 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371946e7-192e-4e43-b1e4-1d539ffffbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:51.385481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371946e7-192e-4e43-b1e4-1d539ffffbb3 admin admin] PATH_INFO: `/v3/users/a0c6d56f4960497b85e1e171db8a3065` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:51.386685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371946e7-192e-4e43-b1e4-1d539ffffbb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0c6d56f4960497b85e1e171db8a3065)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:51.388643 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371946e7-192e-4e43-b1e4-1d539ffffbb3 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:51.642377 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-371946e7-192e-4e43-b1e4-1d539ffffbb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0c6d56f4960497b85e1e171db8a3065'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:51.650706 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-371946e7-192e-4e43-b1e4-1d539ffffbb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0c6d56f4960497b85e1e171db8a3065'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:51.656165 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-371946e7-192e-4e43-b1e4-1d539ffffbb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0c6d56f4960497b85e1e171db8a3065'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:51.656165 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-371946e7-192e-4e43-b1e4-1d539ffffbb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0c6d56f4960497b85e1e171db8a3065'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:51.662934 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:51.665410 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-371946e7-192e-4e43-b1e4-1d539ffffbb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0c6d56f4960497b85e1e171db8a3065'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:51.764339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1280/2515] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:07:51 2022] DELETE /identity/v3/users/a0c6d56f4960497b85e1e171db8a3065 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:51.768973 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef38296-48aa-4b3b-a12e-78d9e58a2f44 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:51.769341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef38296-48aa-4b3b-a12e-78d9e58a2f44 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:51.769631 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef38296-48aa-4b3b-a12e-78d9e58a2f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:51.787186 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2ef38296-48aa-4b3b-a12e-78d9e58a2f44 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:51.788463 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2ef38296-48aa-4b3b-a12e-78d9e58a2f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:51.849665 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1236/2516] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:51.859798 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371946e7-192e-4e43-b1e4-1d539ffffbb3 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:51.861229 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-371946e7-192e-4e43-b1e4-1d539ffffbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:51.920328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371946e7-192e-4e43-b1e4-1d539ffffbb3 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:51.924135 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d432b6a-e277-46d4-89c4-d1390c88803c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:51.924823 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d432b6a-e277-46d4-89c4-d1390c88803c service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:51.925103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d432b6a-e277-46d4-89c4-d1390c88803c service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:51.925379 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d432b6a-e277-46d4-89c4-d1390c88803c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:51.936258 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d432b6a-e277-46d4-89c4-d1390c88803c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:51.937697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d432b6a-e277-46d4-89c4-d1390c88803c service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:51.948126 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1281/2517] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:07:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:07:52.424341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef38296-48aa-4b3b-a12e-78d9e58a2f44 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:52.425871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2ef38296-48aa-4b3b-a12e-78d9e58a2f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:52.438975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef38296-48aa-4b3b-a12e-78d9e58a2f44 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:52.444185 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f71f95-0f92-42cf-a71c-66b63f9c15a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:52.445353 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f71f95-0f92-42cf-a71c-66b63f9c15a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:52.445640 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f71f95-0f92-42cf-a71c-66b63f9c15a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:52.445978 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f71f95-0f92-42cf-a71c-66b63f9c15a7 admin admin] PATH_INFO: `/v3/projects/21152f748d68413ca8f807e5111ab8a3` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:52.447373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f71f95-0f92-42cf-a71c-66b63f9c15a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21152f748d68413ca8f807e5111ab8a3)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:52.449334 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f71f95-0f92-42cf-a71c-66b63f9c15a7 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:52.606868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e0f71f95-0f92-42cf-a71c-66b63f9c15a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21152f748d68413ca8f807e5111ab8a3', 'request_id': 'req-e0f71f95-0f92-42cf-a71c-66b63f9c15a7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:52.708082 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e0f71f95-0f92-42cf-a71c-66b63f9c15a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21152f748d68413ca8f807e5111ab8a3', 'request_id': 'req-e0f71f95-0f92-42cf-a71c-66b63f9c15a7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:52.715544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e0f71f95-0f92-42cf-a71c-66b63f9c15a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21152f748d68413ca8f807e5111ab8a3', 'request_id': 'req-e0f71f95-0f92-42cf-a71c-66b63f9c15a7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:52.726354 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e0f71f95-0f92-42cf-a71c-66b63f9c15a7 admin admin] The token cache is being invalidate because project 21152f748d68413ca8f807e5111ab8a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:07:52.726677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e0f71f95-0f92-42cf-a71c-66b63f9c15a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:52.727368 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e0f71f95-0f92-42cf-a71c-66b63f9c15a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:52.729584 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1237/2518] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:07:52 2022] DELETE /identity/v3/projects/21152f748d68413ca8f807e5111ab8a3 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:52.734697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fd23b-d5e6-4639-b5cd-c1e98c4fb6c9 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:52.735186 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fd23b-d5e6-4639-b5cd-c1e98c4fb6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:52.735285 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fd23b-d5e6-4639-b5cd-c1e98c4fb6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:52.753252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-d71fd23b-d5e6-4639-b5cd-c1e98c4fb6c9 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:52.757107 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d71fd23b-d5e6-4639-b5cd-c1e98c4fb6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:52.811742 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1282/2519] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:52.819581 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7866dae-80dd-4caf-9feb-c3d9b1ff4a29 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:52.819901 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7866dae-80dd-4caf-9feb-c3d9b1ff4a29 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:52.820183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7866dae-80dd-4caf-9feb-c3d9b1ff4a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:52.838823 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-a7866dae-80dd-4caf-9feb-c3d9b1ff4a29 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:52.840012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a7866dae-80dd-4caf-9feb-c3d9b1ff4a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:52.848241 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1238/2520] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:52.852719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71fd23b-d5e6-4639-b5cd-c1e98c4fb6c9 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:52.863374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71fd23b-d5e6-4639-b5cd-c1e98c4fb6c9 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:52.868181 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42136f85-a256-4526-8218-6d1012bd76ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:52.868970 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42136f85-a256-4526-8218-6d1012bd76ed admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:52.871967 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42136f85-a256-4526-8218-6d1012bd76ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:52.871967 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42136f85-a256-4526-8218-6d1012bd76ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:52.871967 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42136f85-a256-4526-8218-6d1012bd76ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:07:52.871967 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42136f85-a256-4526-8218-6d1012bd76ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:52.872466 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42136f85-a256-4526-8218-6d1012bd76ed admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:52.884503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1283/2521] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:07:52.888872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7866dae-80dd-4caf-9feb-c3d9b1ff4a29 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:52.898325 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7866dae-80dd-4caf-9feb-c3d9b1ff4a29 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:52.903539 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94440c-70d5-4ab0-8578-1237667b6b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:52.904194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94440c-70d5-4ab0-8578-1237667b6b8d admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:52.904505 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94440c-70d5-4ab0-8578-1237667b6b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:52.906497 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94440c-70d5-4ab0-8578-1237667b6b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:52.906497 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94440c-70d5-4ab0-8578-1237667b6b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:52.907395 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94440c-70d5-4ab0-8578-1237667b6b8d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:52.910737 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:53.004454 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1239/2522] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:07:52 2022] POST /identity/v3/projects => generated 403 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:07:53.005496 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42136f85-a256-4526-8218-6d1012bd76ed admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:53.015646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42136f85-a256-4526-8218-6d1012bd76ed admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:53.074535 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57516423-d998-4705-b64d-d8597adf1ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:53.075219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57516423-d998-4705-b64d-d8597adf1ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:53.075505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57516423-d998-4705-b64d-d8597adf1ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:53.075789 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57516423-d998-4705-b64d-d8597adf1ca0 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:53.076687 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57516423-d998-4705-b64d-d8597adf1ca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:53.078498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57516423-d998-4705-b64d-d8597adf1ca0 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:53.192131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1284/2523] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:07:53 2022] POST /identity/v3/users => generated 302 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:07:53.193661 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94440c-70d5-4ab0-8578-1237667b6b8d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:53.206701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94440c-70d5-4ab0-8578-1237667b6b8d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:53.211932 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a6474-73a3-44d8-a7c1-2dbb332afbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:53.213779 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a6474-73a3-44d8-a7c1-2dbb332afbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:53.214125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a6474-73a3-44d8-a7c1-2dbb332afbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:53.214473 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a6474-73a3-44d8-a7c1-2dbb332afbd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:53.215323 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a6474-73a3-44d8-a7c1-2dbb332afbd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:53.217036 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a6474-73a3-44d8-a7c1-2dbb332afbd1 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:53.228294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1240/2524] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:07:53.232403 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57516423-d998-4705-b64d-d8597adf1ca0 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:53.242712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57516423-d998-4705-b64d-d8597adf1ca0 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:53.247446 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff215ee-d2c1-4599-b516-2ee77065fc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:53.248227 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff215ee-d2c1-4599-b516-2ee77065fc96 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:53.253249 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff215ee-d2c1-4599-b516-2ee77065fc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:53.253249 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff215ee-d2c1-4599-b516-2ee77065fc96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:53.253249 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff215ee-d2c1-4599-b516-2ee77065fc96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:53.253249 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff215ee-d2c1-4599-b516-2ee77065fc96 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:53.253249 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:53.263429 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1285/2525] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:07:53.267825 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a6474-73a3-44d8-a7c1-2dbb332afbd1 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:53.278910 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a6474-73a3-44d8-a7c1-2dbb332afbd1 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:53.284555 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd90675-efb9-45ad-8a7f-be5a0d2e05cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:53.285483 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd90675-efb9-45ad-8a7f-be5a0d2e05cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:53.285766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd90675-efb9-45ad-8a7f-be5a0d2e05cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:53.286041 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd90675-efb9-45ad-8a7f-be5a0d2e05cf admin admin] PATH_INFO: `/v3/projects/cd00778fcfe3483f982c68cd63b47c8f/users/cb81ee95c39742b98b3dae3a40bdc7ec/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:53.301024 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd90675-efb9-45ad-8a7f-be5a0d2e05cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd00778fcfe3483f982c68cd63b47c8f, user_id=cb81ee95c39742b98b3dae3a40bdc7ec, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:53.303730 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd90675-efb9-45ad-8a7f-be5a0d2e05cf admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:53.387887 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1241/2526] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:07:53 2022] PUT /identity/v3/projects/cd00778fcfe3483f982c68cd63b47c8f/users/cb81ee95c39742b98b3dae3a40bdc7ec/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:53.393077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190a7e2-efd9-44d3-8a2f-c27751036318 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:53.393371 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190a7e2-efd9-44d3-8a2f-c27751036318 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:53.393653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190a7e2-efd9-44d3-8a2f-c27751036318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:53.411699 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-5190a7e2-efd9-44d3-8a2f-c27751036318 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:53.412945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5190a7e2-efd9-44d3-8a2f-c27751036318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:53.472905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1286/2527] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:53.482857 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd90675-efb9-45ad-8a7f-be5a0d2e05cf admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:53.489351 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7cd90675-efb9-45ad-8a7f-be5a0d2e05cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:53.542679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd90675-efb9-45ad-8a7f-be5a0d2e05cf admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:53.546536 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabddd0-9e00-477d-a08f-9f7530040953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:53.547177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabddd0-9e00-477d-a08f-9f7530040953 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:53.547460 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabddd0-9e00-477d-a08f-9f7530040953 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:53.547762 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabddd0-9e00-477d-a08f-9f7530040953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:53.557273 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabddd0-9e00-477d-a08f-9f7530040953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:53.558715 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabddd0-9e00-477d-a08f-9f7530040953 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:53.568254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1242/2528] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:07:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:07:55.047548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08354b-dfba-4f03-a336-f37dbc09f54c None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:55.048198 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08354b-dfba-4f03-a336-f37dbc09f54c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:55.048198 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08354b-dfba-4f03-a336-f37dbc09f54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:55.076245 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-9d08354b-dfba-4f03-a336-f37dbc09f54c None None] MFA Rules not processed for user `cb81ee95c39742b98b3dae3a40bdc7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:55.077509 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9d08354b-dfba-4f03-a336-f37dbc09f54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:55.143050 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1287/2529] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:07:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:55.147462 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabddd0-9e00-477d-a08f-9f7530040953 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:55.157371 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabddd0-9e00-477d-a08f-9f7530040953 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:55.161951 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07a850-4316-4ebc-8b0d-16ad87e229fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:55.162590 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07a850-4316-4ebc-8b0d-16ad87e229fd admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:55.162870 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07a850-4316-4ebc-8b0d-16ad87e229fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:55.163142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07a850-4316-4ebc-8b0d-16ad87e229fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:55.163828 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07a850-4316-4ebc-8b0d-16ad87e229fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:55.165831 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07a850-4316-4ebc-8b0d-16ad87e229fd admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:55.279503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1243/2530] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:07:55 2022] POST /identity/v3/projects => generated 405 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:07:55.283106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08354b-dfba-4f03-a336-f37dbc09f54c None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:55.294651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08354b-dfba-4f03-a336-f37dbc09f54c None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:55.349859 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272feba0-1ea6-4167-9c6b-891562d17bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:55.350528 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272feba0-1ea6-4167-9c6b-891562d17bda admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:55.350813 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272feba0-1ea6-4167-9c6b-891562d17bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:55.351092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272feba0-1ea6-4167-9c6b-891562d17bda admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:55.351790 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272feba0-1ea6-4167-9c6b-891562d17bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:55.354258 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272feba0-1ea6-4167-9c6b-891562d17bda admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:55.439009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1288/2531] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:07:55 2022] POST /identity/v3/users => generated 309 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:07:55.443013 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07a850-4316-4ebc-8b0d-16ad87e229fd admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:55.453585 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07a850-4316-4ebc-8b0d-16ad87e229fd admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:55.458198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21759338-d132-4c06-94d9-71312f0c7afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:55.458855 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21759338-d132-4c06-94d9-71312f0c7afe admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:55.459143 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21759338-d132-4c06-94d9-71312f0c7afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:55.459425 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21759338-d132-4c06-94d9-71312f0c7afe admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:55.460146 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21759338-d132-4c06-94d9-71312f0c7afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:55.461793 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21759338-d132-4c06-94d9-71312f0c7afe admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:55.472257 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1244/2532] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:07:55.476209 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272feba0-1ea6-4167-9c6b-891562d17bda admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:55.487070 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272feba0-1ea6-4167-9c6b-891562d17bda admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:55.491734 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69d622-386c-4a66-b7fc-4e3a0a0f31aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:55.492629 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69d622-386c-4a66-b7fc-4e3a0a0f31aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:55.492917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69d622-386c-4a66-b7fc-4e3a0a0f31aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:55.493811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69d622-386c-4a66-b7fc-4e3a0a0f31aa admin admin] PATH_INFO: `/v3/projects/f27be2351536495a8d8c7088052cc8f1/users/e89777c9768f4a008d9371bbd37e66d0/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:55.505579 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:55.508598 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69d622-386c-4a66-b7fc-4e3a0a0f31aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27be2351536495a8d8c7088052cc8f1, user_id=e89777c9768f4a008d9371bbd37e66d0, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:55.511351 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69d622-386c-4a66-b7fc-4e3a0a0f31aa admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:55.623338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1289/2533] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:07:55 2022] PUT /identity/v3/projects/f27be2351536495a8d8c7088052cc8f1/users/e89777c9768f4a008d9371bbd37e66d0/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:55.627291 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21759338-d132-4c06-94d9-71312f0c7afe admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:55.637252 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21759338-d132-4c06-94d9-71312f0c7afe admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:55.692752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37663cda-ceb0-48a6-bd4e-5646a3b77187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:55.693454 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37663cda-ceb0-48a6-bd4e-5646a3b77187 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:55.693751 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37663cda-ceb0-48a6-bd4e-5646a3b77187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:55.694036 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37663cda-ceb0-48a6-bd4e-5646a3b77187 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:55.694759 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37663cda-ceb0-48a6-bd4e-5646a3b77187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:55.696350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37663cda-ceb0-48a6-bd4e-5646a3b77187 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:55.706096 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1245/2534] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:07:55.710481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69d622-386c-4a66-b7fc-4e3a0a0f31aa admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:55.721586 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69d622-386c-4a66-b7fc-4e3a0a0f31aa admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:55.726260 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bf315-14c4-484e-8c02-4e37e008c99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:55.727142 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bf315-14c4-484e-8c02-4e37e008c99e admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:55.727428 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bf315-14c4-484e-8c02-4e37e008c99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:55.727704 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bf315-14c4-484e-8c02-4e37e008c99e admin admin] PATH_INFO: `/v3/projects/f27be2351536495a8d8c7088052cc8f1/users/e89777c9768f4a008d9371bbd37e66d0/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:55.730287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bf315-14c4-484e-8c02-4e37e008c99e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27be2351536495a8d8c7088052cc8f1, user_id=e89777c9768f4a008d9371bbd37e66d0, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:55.733380 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bf315-14c4-484e-8c02-4e37e008c99e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:55.743711 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1290/2535] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:07:55 2022] PUT /identity/v3/projects/f27be2351536495a8d8c7088052cc8f1/users/e89777c9768f4a008d9371bbd37e66d0/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:57.160125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf789b-68da-4eac-a43e-ff34ac853faa None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:57.160776 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf789b-68da-4eac-a43e-ff34ac853faa None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:57.161161 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf789b-68da-4eac-a43e-ff34ac853faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:57.188579 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-dabf789b-68da-4eac-a43e-ff34ac853faa None None] MFA Rules not processed for user `e89777c9768f4a008d9371bbd37e66d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:07:57.189868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-dabf789b-68da-4eac-a43e-ff34ac853faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:57.193866 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:57.261625 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1246/2536] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:07:57 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:07:57.836442 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bf315-14c4-484e-8c02-4e37e008c99e admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:57.838719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-257bf315-14c4-484e-8c02-4e37e008c99e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:57.911486 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bf315-14c4-484e-8c02-4e37e008c99e admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:57.916726 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1351f00-5fec-4e02-baf7-7c0212a8a4cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43b85b5c7b1e4d73b29fb96f4fa6db71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:57.917402 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1351f00-5fec-4e02-baf7-7c0212a8a4cd service placement] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:57.917684 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1351f00-5fec-4e02-baf7-7c0212a8a4cd service placement] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:57.917961 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1351f00-5fec-4e02-baf7-7c0212a8a4cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:57.919715 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b1351f00-5fec-4e02-baf7-7c0212a8a4cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:57.931538 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1351f00-5fec-4e02-baf7-7c0212a8a4cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:57.933140 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1351f00-5fec-4e02-baf7-7c0212a8a4cd service placement] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:57.942777 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1291/2537] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:07:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:07:58.658505 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf789b-68da-4eac-a43e-ff34ac853faa None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:58.721180 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf789b-68da-4eac-a43e-ff34ac853faa None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:58.725760 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec44e26-241d-4bca-83e0-95ba7bf7a71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:58.726678 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec44e26-241d-4bca-83e0-95ba7bf7a71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:58.726967 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec44e26-241d-4bca-83e0-95ba7bf7a71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:58.727250 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec44e26-241d-4bca-83e0-95ba7bf7a71e admin admin] PATH_INFO: `/v3/users/cb81ee95c39742b98b3dae3a40bdc7ec` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:58.728982 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec44e26-241d-4bca-83e0-95ba7bf7a71e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb81ee95c39742b98b3dae3a40bdc7ec)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:58.731228 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec44e26-241d-4bca-83e0-95ba7bf7a71e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:58.973015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8ec44e26-241d-4bca-83e0-95ba7bf7a71e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb81ee95c39742b98b3dae3a40bdc7ec'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:58.980319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8ec44e26-241d-4bca-83e0-95ba7bf7a71e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb81ee95c39742b98b3dae3a40bdc7ec'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:58.981271 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8ec44e26-241d-4bca-83e0-95ba7bf7a71e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb81ee95c39742b98b3dae3a40bdc7ec'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:58.981876 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8ec44e26-241d-4bca-83e0-95ba7bf7a71e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb81ee95c39742b98b3dae3a40bdc7ec'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:58.993849 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8ec44e26-241d-4bca-83e0-95ba7bf7a71e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb81ee95c39742b98b3dae3a40bdc7ec'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:59.079750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1247/2538] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:07:58 2022] DELETE /identity/v3/users/cb81ee95c39742b98b3dae3a40bdc7ec => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:59.326834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1351f00-5fec-4e02-baf7-7c0212a8a4cd service placement] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:59.339292 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1351f00-5fec-4e02-baf7-7c0212a8a4cd service placement] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:59.397254 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bed6c5-8503-49f4-9723-8e8dde537e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:59.398268 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bed6c5-8503-49f4-9723-8e8dde537e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:59.398552 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bed6c5-8503-49f4-9723-8e8dde537e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:59.398830 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bed6c5-8503-49f4-9723-8e8dde537e4d admin admin] PATH_INFO: `/v3/projects/cd00778fcfe3483f982c68cd63b47c8f` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:59.400608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bed6c5-8503-49f4-9723-8e8dde537e4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd00778fcfe3483f982c68cd63b47c8f)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:59.402538 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bed6c5-8503-49f4-9723-8e8dde537e4d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:59.541308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f0bed6c5-8503-49f4-9723-8e8dde537e4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd00778fcfe3483f982c68cd63b47c8f', 'request_id': 'req-f0bed6c5-8503-49f4-9723-8e8dde537e4d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:59.546782 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f0bed6c5-8503-49f4-9723-8e8dde537e4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd00778fcfe3483f982c68cd63b47c8f', 'request_id': 'req-f0bed6c5-8503-49f4-9723-8e8dde537e4d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:59.552891 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f0bed6c5-8503-49f4-9723-8e8dde537e4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd00778fcfe3483f982c68cd63b47c8f', 'request_id': 'req-f0bed6c5-8503-49f4-9723-8e8dde537e4d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:59.628632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:59.632909 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f0bed6c5-8503-49f4-9723-8e8dde537e4d admin admin] The token cache is being invalidate because project cd00778fcfe3483f982c68cd63b47c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:07:59.633200 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f0bed6c5-8503-49f4-9723-8e8dde537e4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:59.633841 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f0bed6c5-8503-49f4-9723-8e8dde537e4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:59.635984 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1292/2539] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:07:59 2022] DELETE /identity/v3/projects/cd00778fcfe3483f982c68cd63b47c8f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:07:59.640082 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec44e26-241d-4bca-83e0-95ba7bf7a71e admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:07:59.641743 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8ec44e26-241d-4bca-83e0-95ba7bf7a71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:07:59.655159 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec44e26-241d-4bca-83e0-95ba7bf7a71e admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:07:59.673327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:07:59.714818 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e82285-5813-4271-8de5-d90730720d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:07:59.715724 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e82285-5813-4271-8de5-d90730720d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:07:59.716038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e82285-5813-4271-8de5-d90730720d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:07:59.716317 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e82285-5813-4271-8de5-d90730720d33 admin admin] PATH_INFO: `/v3/users/e89777c9768f4a008d9371bbd37e66d0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:07:59.717527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e82285-5813-4271-8de5-d90730720d33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e89777c9768f4a008d9371bbd37e66d0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:07:59.719477 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e82285-5813-4271-8de5-d90730720d33 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:07:59.926921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d1e82285-5813-4271-8de5-d90730720d33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e89777c9768f4a008d9371bbd37e66d0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:59.934277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d1e82285-5813-4271-8de5-d90730720d33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e89777c9768f4a008d9371bbd37e66d0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:59.934953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d1e82285-5813-4271-8de5-d90730720d33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e89777c9768f4a008d9371bbd37e66d0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:59.935576 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d1e82285-5813-4271-8de5-d90730720d33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e89777c9768f4a008d9371bbd37e66d0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:07:59.947438 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d1e82285-5813-4271-8de5-d90730720d33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e89777c9768f4a008d9371bbd37e66d0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:00.038661 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1248/2540] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:07:59 2022] DELETE /identity/v3/users/e89777c9768f4a008d9371bbd37e66d0 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:00.315080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bed6c5-8503-49f4-9723-8e8dde537e4d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:00.316645 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f0bed6c5-8503-49f4-9723-8e8dde537e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:00.329413 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bed6c5-8503-49f4-9723-8e8dde537e4d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:00.387272 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1449963-3296-4803-b471-b73ad24acdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:00.388138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1449963-3296-4803-b471-b73ad24acdca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:00.388424 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1449963-3296-4803-b471-b73ad24acdca admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:00.388742 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1449963-3296-4803-b471-b73ad24acdca admin admin] PATH_INFO: `/v3/projects/f27be2351536495a8d8c7088052cc8f1` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:00.389926 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1449963-3296-4803-b471-b73ad24acdca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f27be2351536495a8d8c7088052cc8f1)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:00.391865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1449963-3296-4803-b471-b73ad24acdca admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:00.501842 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b1449963-3296-4803-b471-b73ad24acdca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f27be2351536495a8d8c7088052cc8f1', 'request_id': 'req-b1449963-3296-4803-b471-b73ad24acdca'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:00.507277 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b1449963-3296-4803-b471-b73ad24acdca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f27be2351536495a8d8c7088052cc8f1', 'request_id': 'req-b1449963-3296-4803-b471-b73ad24acdca'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:00.513897 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b1449963-3296-4803-b471-b73ad24acdca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f27be2351536495a8d8c7088052cc8f1', 'request_id': 'req-b1449963-3296-4803-b471-b73ad24acdca'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:00.632888 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b1449963-3296-4803-b471-b73ad24acdca admin admin] The token cache is being invalidate because project f27be2351536495a8d8c7088052cc8f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:00.638339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b1449963-3296-4803-b471-b73ad24acdca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:00.638339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b1449963-3296-4803-b471-b73ad24acdca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:00.638339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1293/2541] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:00 2022] DELETE /identity/v3/projects/f27be2351536495a8d8c7088052cc8f1 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:00.640924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f183d6-a96d-4ace-9100-994b48bd3bac None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:00.641218 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f183d6-a96d-4ace-9100-994b48bd3bac None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:00.641548 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f183d6-a96d-4ace-9100-994b48bd3bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:00.659970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-72f183d6-a96d-4ace-9100-994b48bd3bac None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:00.661601 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-72f183d6-a96d-4ace-9100-994b48bd3bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:00.720870 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1249/2542] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:00.728549 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbde19-c9d8-4809-937c-fd8426f59201 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:00.728864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbde19-c9d8-4809-937c-fd8426f59201 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:00.729252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbde19-c9d8-4809-937c-fd8426f59201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:00.748283 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-afdbde19-c9d8-4809-937c-fd8426f59201 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:00.749563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-afdbde19-c9d8-4809-937c-fd8426f59201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:00.757876 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1294/2543] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:00.762610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f183d6-a96d-4ace-9100-994b48bd3bac None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:00.772469 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f183d6-a96d-4ace-9100-994b48bd3bac None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:00.777706 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17637cc4-3dcf-48c0-8bfa-5777c4a48c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:00.778344 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17637cc4-3dcf-48c0-8bfa-5777c4a48c0d admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:00.778630 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17637cc4-3dcf-48c0-8bfa-5777c4a48c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:00.778911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17637cc4-3dcf-48c0-8bfa-5777c4a48c0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:00.779632 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17637cc4-3dcf-48c0-8bfa-5777c4a48c0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:08:00.779962 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17637cc4-3dcf-48c0-8bfa-5777c4a48c0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:00.781579 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17637cc4-3dcf-48c0-8bfa-5777c4a48c0d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:00.793205 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1250/2544] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 13:08:00.801841 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbde19-c9d8-4809-937c-fd8426f59201 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:00.810979 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbde19-c9d8-4809-937c-fd8426f59201 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:00.815745 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d9751-924b-4802-b39e-da42054cc3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:00.816504 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d9751-924b-4802-b39e-da42054cc3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:00.816827 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d9751-924b-4802-b39e-da42054cc3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:00.817098 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d9751-924b-4802-b39e-da42054cc3f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:00.817802 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d9751-924b-4802-b39e-da42054cc3f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:00.819726 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d9751-924b-4802-b39e-da42054cc3f4 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:00.949118 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1295/2545] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:00 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:00.953198 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17637cc4-3dcf-48c0-8bfa-5777c4a48c0d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:00.964132 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17637cc4-3dcf-48c0-8bfa-5777c4a48c0d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:00.989780 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:01.021550 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e5204-28b4-43d0-ba08-3aa9f51faa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:01.022309 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e5204-28b4-43d0-ba08-3aa9f51faa3d admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:01.022598 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e5204-28b4-43d0-ba08-3aa9f51faa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:01.022882 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e5204-28b4-43d0-ba08-3aa9f51faa3d admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:01.023571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e5204-28b4-43d0-ba08-3aa9f51faa3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:01.025702 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e5204-28b4-43d0-ba08-3aa9f51faa3d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:01.131035 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1251/2546] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:00 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:01.135754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d9751-924b-4802-b39e-da42054cc3f4 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:01.146120 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d9751-924b-4802-b39e-da42054cc3f4 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:01.150766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7eaa3-66dc-4e55-b006-4fab1cba74b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:01.151425 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7eaa3-66dc-4e55-b006-4fab1cba74b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:01.151710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7eaa3-66dc-4e55-b006-4fab1cba74b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:01.151985 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7eaa3-66dc-4e55-b006-4fab1cba74b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:01.152747 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7eaa3-66dc-4e55-b006-4fab1cba74b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:01.154355 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7eaa3-66dc-4e55-b006-4fab1cba74b1 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:01.164782 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1296/2547] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:01.168949 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e5204-28b4-43d0-ba08-3aa9f51faa3d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:01.179204 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e5204-28b4-43d0-ba08-3aa9f51faa3d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:01.184365 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652041a1-644e-4c11-b4ff-45caf81ac9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:01.185043 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652041a1-644e-4c11-b4ff-45caf81ac9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:01.185327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652041a1-644e-4c11-b4ff-45caf81ac9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:01.185602 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652041a1-644e-4c11-b4ff-45caf81ac9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:01.186325 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652041a1-644e-4c11-b4ff-45caf81ac9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:01.187930 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652041a1-644e-4c11-b4ff-45caf81ac9f9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:01.200073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1252/2548] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:01.203200 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7eaa3-66dc-4e55-b006-4fab1cba74b1 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:01.213076 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7eaa3-66dc-4e55-b006-4fab1cba74b1 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:01.217785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf6481-7b00-4e48-96b9-9b925ea036d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:01.219117 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf6481-7b00-4e48-96b9-9b925ea036d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:01.219630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf6481-7b00-4e48-96b9-9b925ea036d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:01.220057 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf6481-7b00-4e48-96b9-9b925ea036d0 admin admin] PATH_INFO: `/v3/projects/4ade439f866745aa81134a69c8901d9b/users/f0e8d33fd66e4baaaa82bd01ed74b558/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:01.234910 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf6481-7b00-4e48-96b9-9b925ea036d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ade439f866745aa81134a69c8901d9b, user_id=f0e8d33fd66e4baaaa82bd01ed74b558, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:01.237605 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf6481-7b00-4e48-96b9-9b925ea036d0 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:01.330375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1297/2549] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:01 2022] PUT /identity/v3/projects/4ade439f866745aa81134a69c8901d9b/users/f0e8d33fd66e4baaaa82bd01ed74b558/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:01.341428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1ce1a-f3f3-480b-acdf-6fc756c7a00e None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:01.341723 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1ce1a-f3f3-480b-acdf-6fc756c7a00e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:01.342006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1ce1a-f3f3-480b-acdf-6fc756c7a00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:01.370241 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-97c1ce1a-f3f3-480b-acdf-6fc756c7a00e None None] MFA Rules not processed for user `f0e8d33fd66e4baaaa82bd01ed74b558`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:01.371476 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-97c1ce1a-f3f3-480b-acdf-6fc756c7a00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:01.434178 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1253/2550] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:08:01.438618 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf6481-7b00-4e48-96b9-9b925ea036d0 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:01.465199 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:01.501267 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf6481-7b00-4e48-96b9-9b925ea036d0 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:01.505998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd0198-0b96-418e-b5c8-36c1bdda9572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:01.506657 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd0198-0b96-418e-b5c8-36c1bdda9572 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:01.506975 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd0198-0b96-418e-b5c8-36c1bdda9572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:01.507256 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd0198-0b96-418e-b5c8-36c1bdda9572 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:01.507953 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd0198-0b96-418e-b5c8-36c1bdda9572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:01.509951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd0198-0b96-418e-b5c8-36c1bdda9572 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:01.662957 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1298/2551] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:01 2022] POST /identity/v3/projects => generated 385 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:01.667678 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1ce1a-f3f3-480b-acdf-6fc756c7a00e None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:01.678288 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1ce1a-f3f3-480b-acdf-6fc756c7a00e None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:01.733874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5371348-31cc-475c-9dfd-3bdfd9b6d899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:01.734618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5371348-31cc-475c-9dfd-3bdfd9b6d899 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:01.734874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5371348-31cc-475c-9dfd-3bdfd9b6d899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:01.735152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5371348-31cc-475c-9dfd-3bdfd9b6d899 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:01.735838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5371348-31cc-475c-9dfd-3bdfd9b6d899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:01.737795 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5371348-31cc-475c-9dfd-3bdfd9b6d899 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:01.815765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1254/2552] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:01 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:01.819806 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd0198-0b96-418e-b5c8-36c1bdda9572 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:01.830453 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd0198-0b96-418e-b5c8-36c1bdda9572 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:01.834994 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdf904-bd4c-4e2e-9463-db4ac854a5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:01.840355 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdf904-bd4c-4e2e-9463-db4ac854a5aa admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:01.840355 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdf904-bd4c-4e2e-9463-db4ac854a5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:01.840355 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdf904-bd4c-4e2e-9463-db4ac854a5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:01.840355 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdf904-bd4c-4e2e-9463-db4ac854a5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:01.840355 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdf904-bd4c-4e2e-9463-db4ac854a5aa admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:01.850900 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1299/2553] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:01.854218 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5371348-31cc-475c-9dfd-3bdfd9b6d899 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:01.864531 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5371348-31cc-475c-9dfd-3bdfd9b6d899 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:01.869112 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bab2da-049e-4aa8-a315-4f6afac79455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:01.869993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bab2da-049e-4aa8-a315-4f6afac79455 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:01.870274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bab2da-049e-4aa8-a315-4f6afac79455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:01.870551 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bab2da-049e-4aa8-a315-4f6afac79455 admin admin] PATH_INFO: `/v3/projects/4a5b6ea67be44dccaaa59e4d645d4a3a/users/c022fefcf8694d80ac38e5fbd9a89b43/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:01.884892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bab2da-049e-4aa8-a315-4f6afac79455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a5b6ea67be44dccaaa59e4d645d4a3a, user_id=c022fefcf8694d80ac38e5fbd9a89b43, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:01.887603 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bab2da-049e-4aa8-a315-4f6afac79455 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:01.965537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:01.970249 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1255/2554] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:01 2022] PUT /identity/v3/projects/4a5b6ea67be44dccaaa59e4d645d4a3a/users/c022fefcf8694d80ac38e5fbd9a89b43/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:01.974239 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdf904-bd4c-4e2e-9463-db4ac854a5aa admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:01.986160 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdf904-bd4c-4e2e-9463-db4ac854a5aa admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:02.043019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008faa0-979d-4690-91fc-af2ec669d531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:02.043742 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008faa0-979d-4690-91fc-af2ec669d531 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:02.044027 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008faa0-979d-4690-91fc-af2ec669d531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:02.044303 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008faa0-979d-4690-91fc-af2ec669d531 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:02.045056 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008faa0-979d-4690-91fc-af2ec669d531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:02.046683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008faa0-979d-4690-91fc-af2ec669d531 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:02.057976 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1300/2555] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:02.062138 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bab2da-049e-4aa8-a315-4f6afac79455 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:02.073412 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bab2da-049e-4aa8-a315-4f6afac79455 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:02.077998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cded6a1-a54e-49d7-aa04-8a3becbe00a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:02.078873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cded6a1-a54e-49d7-aa04-8a3becbe00a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:02.079191 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cded6a1-a54e-49d7-aa04-8a3becbe00a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:02.079469 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cded6a1-a54e-49d7-aa04-8a3becbe00a5 admin admin] PATH_INFO: `/v3/projects/4a5b6ea67be44dccaaa59e4d645d4a3a/users/c022fefcf8694d80ac38e5fbd9a89b43/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:02.081472 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cded6a1-a54e-49d7-aa04-8a3becbe00a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a5b6ea67be44dccaaa59e4d645d4a3a, user_id=c022fefcf8694d80ac38e5fbd9a89b43, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:02.084161 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cded6a1-a54e-49d7-aa04-8a3becbe00a5 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:02.094923 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1256/2556] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:02 2022] PUT /identity/v3/projects/4a5b6ea67be44dccaaa59e4d645d4a3a/users/c022fefcf8694d80ac38e5fbd9a89b43/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:02.108343 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f6cc3-bad4-4916-9509-62df3a286c57 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:02.108666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f6cc3-bad4-4916-9509-62df3a286c57 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:02.108949 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f6cc3-bad4-4916-9509-62df3a286c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:02.135395 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-0d3f6cc3-bad4-4916-9509-62df3a286c57 None None] MFA Rules not processed for user `c022fefcf8694d80ac38e5fbd9a89b43`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:02.136620 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0d3f6cc3-bad4-4916-9509-62df3a286c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:02.204809 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1301/2557] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:02.216228 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cded6a1-a54e-49d7-aa04-8a3becbe00a5 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:02.217870 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7cded6a1-a54e-49d7-aa04-8a3becbe00a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:02.276863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cded6a1-a54e-49d7-aa04-8a3becbe00a5 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:02.280546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740bd28-c4fa-477d-940c-aebcb273f780 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:02.281306 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740bd28-c4fa-477d-940c-aebcb273f780 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:02.281585 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740bd28-c4fa-477d-940c-aebcb273f780 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:02.281860 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740bd28-c4fa-477d-940c-aebcb273f780 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:02.290836 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740bd28-c4fa-477d-940c-aebcb273f780 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:02.292264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740bd28-c4fa-477d-940c-aebcb273f780 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:02.301582 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1257/2558] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:02.328927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f6cc3-bad4-4916-9509-62df3a286c57 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:02.352169 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:02.393185 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f6cc3-bad4-4916-9509-62df3a286c57 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:02.397972 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeeb449-f6ab-4924-9689-6cf8af56c56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:02.401079 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeeb449-f6ab-4924-9689-6cf8af56c56a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:02.401079 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeeb449-f6ab-4924-9689-6cf8af56c56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:02.401079 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeeb449-f6ab-4924-9689-6cf8af56c56a admin admin] PATH_INFO: `/v3/users/f0e8d33fd66e4baaaa82bd01ed74b558` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:02.401447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeeb449-f6ab-4924-9689-6cf8af56c56a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0e8d33fd66e4baaaa82bd01ed74b558)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:02.403324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeeb449-f6ab-4924-9689-6cf8af56c56a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:02.647629 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-cdeeb449-f6ab-4924-9689-6cf8af56c56a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0e8d33fd66e4baaaa82bd01ed74b558'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:02.654695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-cdeeb449-f6ab-4924-9689-6cf8af56c56a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0e8d33fd66e4baaaa82bd01ed74b558'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:02.655375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-cdeeb449-f6ab-4924-9689-6cf8af56c56a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0e8d33fd66e4baaaa82bd01ed74b558'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:02.655974 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-cdeeb449-f6ab-4924-9689-6cf8af56c56a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0e8d33fd66e4baaaa82bd01ed74b558'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:02.668756 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-cdeeb449-f6ab-4924-9689-6cf8af56c56a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0e8d33fd66e4baaaa82bd01ed74b558'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:02.787961 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1302/2559] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:02 2022] DELETE /identity/v3/users/f0e8d33fd66e4baaaa82bd01ed74b558 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:02.793074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f01899-8602-4602-85ed-a4cbe8be022f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:02.793584 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f01899-8602-4602-85ed-a4cbe8be022f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:02.793684 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f01899-8602-4602-85ed-a4cbe8be022f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:02.811739 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-00f01899-8602-4602-85ed-a4cbe8be022f None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:02.813019 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-00f01899-8602-4602-85ed-a4cbe8be022f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:02.873083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1258/2560] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:02.882861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeeb449-f6ab-4924-9689-6cf8af56c56a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:02.884433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-cdeeb449-f6ab-4924-9689-6cf8af56c56a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:02.942874 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeeb449-f6ab-4924-9689-6cf8af56c56a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:02.946718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc5817-44b5-41c2-a382-2fd5608e52b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:02.947706 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc5817-44b5-41c2-a382-2fd5608e52b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:02.947706 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc5817-44b5-41c2-a382-2fd5608e52b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:02.948071 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc5817-44b5-41c2-a382-2fd5608e52b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:02.957773 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc5817-44b5-41c2-a382-2fd5608e52b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:02.959246 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc5817-44b5-41c2-a382-2fd5608e52b0 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:02.969396 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1303/2561] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:03.383504 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f01899-8602-4602-85ed-a4cbe8be022f None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:03.384979 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-00f01899-8602-4602-85ed-a4cbe8be022f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:03.399361 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f01899-8602-4602-85ed-a4cbe8be022f None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:03.404647 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c1ff6-cc72-45ec-8e6c-59f9cd0405cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:03.406086 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c1ff6-cc72-45ec-8e6c-59f9cd0405cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:03.406594 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c1ff6-cc72-45ec-8e6c-59f9cd0405cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:03.406969 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c1ff6-cc72-45ec-8e6c-59f9cd0405cd admin admin] PATH_INFO: `/v3/projects/4ade439f866745aa81134a69c8901d9b` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:03.408455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c1ff6-cc72-45ec-8e6c-59f9cd0405cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ade439f866745aa81134a69c8901d9b)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:03.410738 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c1ff6-cc72-45ec-8e6c-59f9cd0405cd admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:03.525777 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b52c1ff6-cc72-45ec-8e6c-59f9cd0405cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ade439f866745aa81134a69c8901d9b', 'request_id': 'req-b52c1ff6-cc72-45ec-8e6c-59f9cd0405cd'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:03.593267 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b52c1ff6-cc72-45ec-8e6c-59f9cd0405cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ade439f866745aa81134a69c8901d9b', 'request_id': 'req-b52c1ff6-cc72-45ec-8e6c-59f9cd0405cd'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:03.599723 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b52c1ff6-cc72-45ec-8e6c-59f9cd0405cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ade439f866745aa81134a69c8901d9b', 'request_id': 'req-b52c1ff6-cc72-45ec-8e6c-59f9cd0405cd'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:03.610224 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b52c1ff6-cc72-45ec-8e6c-59f9cd0405cd admin admin] The token cache is being invalidate because project 4ade439f866745aa81134a69c8901d9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:03.610512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b52c1ff6-cc72-45ec-8e6c-59f9cd0405cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:03.611145 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b52c1ff6-cc72-45ec-8e6c-59f9cd0405cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:03.612709 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1259/2562] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:03 2022] DELETE /identity/v3/projects/4ade439f866745aa81134a69c8901d9b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:03.616662 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc5817-44b5-41c2-a382-2fd5608e52b0 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:03.626251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc5817-44b5-41c2-a382-2fd5608e52b0 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:03.668545 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:03.684851 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf12676-9422-4d56-87d1-18496aaec9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:03.685825 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf12676-9422-4d56-87d1-18496aaec9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:03.686112 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf12676-9422-4d56-87d1-18496aaec9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:03.686388 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf12676-9422-4d56-87d1-18496aaec9f8 admin admin] PATH_INFO: `/v3/users/c022fefcf8694d80ac38e5fbd9a89b43` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:03.687585 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf12676-9422-4d56-87d1-18496aaec9f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c022fefcf8694d80ac38e5fbd9a89b43)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:03.689690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf12676-9422-4d56-87d1-18496aaec9f8 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:03.938627 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-4bf12676-9422-4d56-87d1-18496aaec9f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c022fefcf8694d80ac38e5fbd9a89b43'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:03.945383 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-4bf12676-9422-4d56-87d1-18496aaec9f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c022fefcf8694d80ac38e5fbd9a89b43'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:03.946036 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-4bf12676-9422-4d56-87d1-18496aaec9f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c022fefcf8694d80ac38e5fbd9a89b43'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:03.947395 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-4bf12676-9422-4d56-87d1-18496aaec9f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c022fefcf8694d80ac38e5fbd9a89b43'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:03.959654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-4bf12676-9422-4d56-87d1-18496aaec9f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c022fefcf8694d80ac38e5fbd9a89b43'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:04.056818 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1304/2563] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:03 2022] DELETE /identity/v3/users/c022fefcf8694d80ac38e5fbd9a89b43 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:04.562762 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c1ff6-cc72-45ec-8e6c-59f9cd0405cd admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:04.562762 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b52c1ff6-cc72-45ec-8e6c-59f9cd0405cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:04.578190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c1ff6-cc72-45ec-8e6c-59f9cd0405cd admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:04.588029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:04.638205 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8d741-ebc2-40ae-b0a6-b985ba908dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:04.639079 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8d741-ebc2-40ae-b0a6-b985ba908dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:04.639369 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8d741-ebc2-40ae-b0a6-b985ba908dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:04.639656 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8d741-ebc2-40ae-b0a6-b985ba908dd3 admin admin] PATH_INFO: `/v3/projects/4a5b6ea67be44dccaaa59e4d645d4a3a` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:04.640894 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8d741-ebc2-40ae-b0a6-b985ba908dd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a5b6ea67be44dccaaa59e4d645d4a3a)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:04.642823 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8d741-ebc2-40ae-b0a6-b985ba908dd3 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:04.822123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d9f8d741-ebc2-40ae-b0a6-b985ba908dd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a5b6ea67be44dccaaa59e4d645d4a3a', 'request_id': 'req-d9f8d741-ebc2-40ae-b0a6-b985ba908dd3'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:04.993293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d9f8d741-ebc2-40ae-b0a6-b985ba908dd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a5b6ea67be44dccaaa59e4d645d4a3a', 'request_id': 'req-d9f8d741-ebc2-40ae-b0a6-b985ba908dd3'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:05.000029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d9f8d741-ebc2-40ae-b0a6-b985ba908dd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a5b6ea67be44dccaaa59e4d645d4a3a', 'request_id': 'req-d9f8d741-ebc2-40ae-b0a6-b985ba908dd3'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:05.010911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d9f8d741-ebc2-40ae-b0a6-b985ba908dd3 admin admin] The token cache is being invalidate because project 4a5b6ea67be44dccaaa59e4d645d4a3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:05.011203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d9f8d741-ebc2-40ae-b0a6-b985ba908dd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:05.011841 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d9f8d741-ebc2-40ae-b0a6-b985ba908dd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:05.013440 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1260/2564] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:04 2022] DELETE /identity/v3/projects/4a5b6ea67be44dccaaa59e4d645d4a3a => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:05.018383 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801473b1-b842-45ee-ad40-607be8ee1ca3 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:05.021651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801473b1-b842-45ee-ad40-607be8ee1ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:05.021651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801473b1-b842-45ee-ad40-607be8ee1ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:05.037812 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-801473b1-b842-45ee-ad40-607be8ee1ca3 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:05.039036 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-801473b1-b842-45ee-ad40-607be8ee1ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:05.097854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1305/2565] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:05.105681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104a9da-62b4-4d9f-8d5e-c94edbcb4859 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:05.105980 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104a9da-62b4-4d9f-8d5e-c94edbcb4859 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:05.106263 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104a9da-62b4-4d9f-8d5e-c94edbcb4859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:05.124091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-5104a9da-62b4-4d9f-8d5e-c94edbcb4859 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:05.125374 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5104a9da-62b4-4d9f-8d5e-c94edbcb4859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:05.133222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1261/2566] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:08:05.137688 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801473b1-b842-45ee-ad40-607be8ee1ca3 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:05.147150 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801473b1-b842-45ee-ad40-607be8ee1ca3 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:05.152237 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e753bf-b068-4b66-bee8-d8f676840f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:05.152924 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e753bf-b068-4b66-bee8-d8f676840f88 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:05.153205 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e753bf-b068-4b66-bee8-d8f676840f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:05.153478 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e753bf-b068-4b66-bee8-d8f676840f88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:05.154203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e753bf-b068-4b66-bee8-d8f676840f88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:08:05.154510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e753bf-b068-4b66-bee8-d8f676840f88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:05.156114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e753bf-b068-4b66-bee8-d8f676840f88 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:05.167392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1306/2567] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:08:05.171543 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104a9da-62b4-4d9f-8d5e-c94edbcb4859 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:05.180613 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104a9da-62b4-4d9f-8d5e-c94edbcb4859 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:05.185226 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b845a3-4516-4416-8994-0ad6b3620cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:05.185869 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b845a3-4516-4416-8994-0ad6b3620cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:05.186155 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b845a3-4516-4416-8994-0ad6b3620cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:05.186434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b845a3-4516-4416-8994-0ad6b3620cb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:05.187120 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b845a3-4516-4416-8994-0ad6b3620cb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:05.189069 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b845a3-4516-4416-8994-0ad6b3620cb3 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:05.285791 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1262/2568] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:05 2022] POST /identity/v3/projects => generated 393 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:05.290028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e753bf-b068-4b66-bee8-d8f676840f88 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:05.299928 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e753bf-b068-4b66-bee8-d8f676840f88 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:05.343643 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:05.354910 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5ae5a-b8b4-4bd1-8218-c6ce8a6a1455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:05.355769 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5ae5a-b8b4-4bd1-8218-c6ce8a6a1455 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:05.356050 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5ae5a-b8b4-4bd1-8218-c6ce8a6a1455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:05.356327 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5ae5a-b8b4-4bd1-8218-c6ce8a6a1455 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:05.357051 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5ae5a-b8b4-4bd1-8218-c6ce8a6a1455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:05.358965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5ae5a-b8b4-4bd1-8218-c6ce8a6a1455 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:05.472917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1307/2569] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:05 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:05.476921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b845a3-4516-4416-8994-0ad6b3620cb3 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:05.487201 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b845a3-4516-4416-8994-0ad6b3620cb3 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:05.491727 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61f8ce-9622-4550-b756-e4e0e00f2b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:05.492374 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61f8ce-9622-4550-b756-e4e0e00f2b5a admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:05.492693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61f8ce-9622-4550-b756-e4e0e00f2b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:05.492971 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61f8ce-9622-4550-b756-e4e0e00f2b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:05.494205 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61f8ce-9622-4550-b756-e4e0e00f2b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:05.495793 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61f8ce-9622-4550-b756-e4e0e00f2b5a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:05.505961 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1263/2570] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:05.510206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5ae5a-b8b4-4bd1-8218-c6ce8a6a1455 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:05.520277 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5ae5a-b8b4-4bd1-8218-c6ce8a6a1455 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:05.525013 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b41165-0f28-4b91-8bb7-fde5b475f401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:05.529422 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b41165-0f28-4b91-8bb7-fde5b475f401 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:05.529422 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b41165-0f28-4b91-8bb7-fde5b475f401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:05.529422 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b41165-0f28-4b91-8bb7-fde5b475f401 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:05.529422 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b41165-0f28-4b91-8bb7-fde5b475f401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:05.529422 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b41165-0f28-4b91-8bb7-fde5b475f401 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:05.539096 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1308/2571] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:05.543002 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61f8ce-9622-4550-b756-e4e0e00f2b5a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:05.552882 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61f8ce-9622-4550-b756-e4e0e00f2b5a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:05.557957 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429bc37-e6fd-49d6-9f0c-e01bd2eee124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:05.558850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429bc37-e6fd-49d6-9f0c-e01bd2eee124 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:05.559134 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429bc37-e6fd-49d6-9f0c-e01bd2eee124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:05.559412 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429bc37-e6fd-49d6-9f0c-e01bd2eee124 admin admin] PATH_INFO: `/v3/projects/51793efef34544ee8a47179a308dab6d/users/23f7676b377e4bb584f940c6f699cdec/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:05.574404 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429bc37-e6fd-49d6-9f0c-e01bd2eee124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51793efef34544ee8a47179a308dab6d, user_id=23f7676b377e4bb584f940c6f699cdec, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:05.577168 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429bc37-e6fd-49d6-9f0c-e01bd2eee124 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:05.697841 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1264/2572] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:05 2022] PUT /identity/v3/projects/51793efef34544ee8a47179a308dab6d/users/23f7676b377e4bb584f940c6f699cdec/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:05.708853 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41254c2-eb51-4fb7-9489-3c4e23ab7c6f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:05.709195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41254c2-eb51-4fb7-9489-3c4e23ab7c6f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:05.709495 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41254c2-eb51-4fb7-9489-3c4e23ab7c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:05.735232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-c41254c2-eb51-4fb7-9489-3c4e23ab7c6f None None] MFA Rules not processed for user `23f7676b377e4bb584f940c6f699cdec`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:05.736454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c41254c2-eb51-4fb7-9489-3c4e23ab7c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:05.799683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1309/2573] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:08:05.804193 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429bc37-e6fd-49d6-9f0c-e01bd2eee124 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:05.846135 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:05.865467 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429bc37-e6fd-49d6-9f0c-e01bd2eee124 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:05.870813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f9391-d147-47af-ab28-6596a1bf1251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:05.871464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f9391-d147-47af-ab28-6596a1bf1251 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:05.871749 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f9391-d147-47af-ab28-6596a1bf1251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:05.872067 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f9391-d147-47af-ab28-6596a1bf1251 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:05.873067 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f9391-d147-47af-ab28-6596a1bf1251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:05.875746 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f9391-d147-47af-ab28-6596a1bf1251 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:05.994884 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1265/2574] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:05 2022] POST /identity/v3/projects => generated 393 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:05.998920 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41254c2-eb51-4fb7-9489-3c4e23ab7c6f None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:06.009613 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41254c2-eb51-4fb7-9489-3c4e23ab7c6f None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:06.070818 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc4373-0b6f-4d91-a7a8-0829210e7abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:06.071529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc4373-0b6f-4d91-a7a8-0829210e7abe admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:06.071812 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc4373-0b6f-4d91-a7a8-0829210e7abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:06.072087 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc4373-0b6f-4d91-a7a8-0829210e7abe admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:06.072825 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc4373-0b6f-4d91-a7a8-0829210e7abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:06.074752 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc4373-0b6f-4d91-a7a8-0829210e7abe admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:06.164178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1310/2575] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:05 2022] POST /identity/v3/users => generated 303 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:06.168782 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f9391-d147-47af-ab28-6596a1bf1251 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:06.179436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f9391-d147-47af-ab28-6596a1bf1251 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:06.184050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9c865-cf95-4f98-926e-7e306f6287d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:06.184742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9c865-cf95-4f98-926e-7e306f6287d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:06.185029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9c865-cf95-4f98-926e-7e306f6287d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:06.185310 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9c865-cf95-4f98-926e-7e306f6287d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:06.186033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9c865-cf95-4f98-926e-7e306f6287d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:06.187633 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9c865-cf95-4f98-926e-7e306f6287d0 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:06.198111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1266/2576] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:06.202046 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc4373-0b6f-4d91-a7a8-0829210e7abe admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:06.211787 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc4373-0b6f-4d91-a7a8-0829210e7abe admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:06.216840 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762f505-57dc-4247-85d4-2dfd646354a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:06.217710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762f505-57dc-4247-85d4-2dfd646354a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:06.217991 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762f505-57dc-4247-85d4-2dfd646354a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:06.218263 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762f505-57dc-4247-85d4-2dfd646354a3 admin admin] PATH_INFO: `/v3/projects/51ce49ca022a48939a7a3032cf7dc37f/users/7ff1fa9556c24671941d4d1a1889c472/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:06.233747 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762f505-57dc-4247-85d4-2dfd646354a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ce49ca022a48939a7a3032cf7dc37f, user_id=7ff1fa9556c24671941d4d1a1889c472, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:06.236548 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762f505-57dc-4247-85d4-2dfd646354a3 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:06.347842 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1311/2577] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:06 2022] PUT /identity/v3/projects/51ce49ca022a48939a7a3032cf7dc37f/users/7ff1fa9556c24671941d4d1a1889c472/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:06.351769 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9c865-cf95-4f98-926e-7e306f6287d0 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:06.362740 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9c865-cf95-4f98-926e-7e306f6287d0 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:06.418434 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57155547-ad2a-4fb2-a16e-511622d83864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:06.419096 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57155547-ad2a-4fb2-a16e-511622d83864 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:06.419382 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57155547-ad2a-4fb2-a16e-511622d83864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:06.419661 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57155547-ad2a-4fb2-a16e-511622d83864 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:06.420380 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57155547-ad2a-4fb2-a16e-511622d83864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:06.422011 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57155547-ad2a-4fb2-a16e-511622d83864 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:06.431696 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1267/2578] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:06.435770 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762f505-57dc-4247-85d4-2dfd646354a3 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:06.445988 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762f505-57dc-4247-85d4-2dfd646354a3 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:06.450686 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77240ba8-14be-4764-8856-40e3f14e8693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:06.451561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77240ba8-14be-4764-8856-40e3f14e8693 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:06.451845 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77240ba8-14be-4764-8856-40e3f14e8693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:06.452124 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77240ba8-14be-4764-8856-40e3f14e8693 admin admin] PATH_INFO: `/v3/projects/51ce49ca022a48939a7a3032cf7dc37f/users/7ff1fa9556c24671941d4d1a1889c472/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:06.454122 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77240ba8-14be-4764-8856-40e3f14e8693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ce49ca022a48939a7a3032cf7dc37f, user_id=7ff1fa9556c24671941d4d1a1889c472, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:06.456803 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77240ba8-14be-4764-8856-40e3f14e8693 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:06.467232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1312/2579] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:06 2022] PUT /identity/v3/projects/51ce49ca022a48939a7a3032cf7dc37f/users/7ff1fa9556c24671941d4d1a1889c472/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:06.477259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5ccb7-0ab6-42bf-b0e5-625697b866cd None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:06.477552 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5ccb7-0ab6-42bf-b0e5-625697b866cd None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:06.478458 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5ccb7-0ab6-42bf-b0e5-625697b866cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:06.508257 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-79e5ccb7-0ab6-42bf-b0e5-625697b866cd None None] MFA Rules not processed for user `7ff1fa9556c24671941d4d1a1889c472`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:06.510036 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-79e5ccb7-0ab6-42bf-b0e5-625697b866cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:06.576791 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1268/2580] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:06.588196 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77240ba8-14be-4764-8856-40e3f14e8693 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:06.589916 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-77240ba8-14be-4764-8856-40e3f14e8693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:06.600765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:06.646834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77240ba8-14be-4764-8856-40e3f14e8693 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:06.651142 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ab616-9e36-4666-b9c4-5b0dcc7b08c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:06.651781 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ab616-9e36-4666-b9c4-5b0dcc7b08c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:06.652064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ab616-9e36-4666-b9c4-5b0dcc7b08c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:06.652340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ab616-9e36-4666-b9c4-5b0dcc7b08c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:06.661287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ab616-9e36-4666-b9c4-5b0dcc7b08c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:06.663570 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ab616-9e36-4666-b9c4-5b0dcc7b08c3 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:06.673545 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1313/2581] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:06.718834 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5ccb7-0ab6-42bf-b0e5-625697b866cd None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:06.720242 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-79e5ccb7-0ab6-42bf-b0e5-625697b866cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:06.733019 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5ccb7-0ab6-42bf-b0e5-625697b866cd None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:06.736861 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec4206-eaab-45c4-82e8-2511f3634c45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:06.737532 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec4206-eaab-45c4-82e8-2511f3634c45 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:06.737818 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec4206-eaab-45c4-82e8-2511f3634c45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:06.738097 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec4206-eaab-45c4-82e8-2511f3634c45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:06.770633 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:06.795604 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec4206-eaab-45c4-82e8-2511f3634c45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:06.797088 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec4206-eaab-45c4-82e8-2511f3634c45 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:06.806798 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1269/2582] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:11.854184 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ab616-9e36-4666-b9c4-5b0dcc7b08c3 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:11.938939 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ab616-9e36-4666-b9c4-5b0dcc7b08c3 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:11.944774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696c6fd-a6ba-42bf-92ca-396e193a53a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:11.946105 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696c6fd-a6ba-42bf-92ca-396e193a53a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:11.947106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696c6fd-a6ba-42bf-92ca-396e193a53a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:11.947389 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696c6fd-a6ba-42bf-92ca-396e193a53a0 admin admin] PATH_INFO: `/v3/users/23f7676b377e4bb584f940c6f699cdec` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:11.948690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696c6fd-a6ba-42bf-92ca-396e193a53a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f7676b377e4bb584f940c6f699cdec)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:11.952456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696c6fd-a6ba-42bf-92ca-396e193a53a0 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:12.202648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-9696c6fd-a6ba-42bf-92ca-396e193a53a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f7676b377e4bb584f940c6f699cdec'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:12.210714 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-9696c6fd-a6ba-42bf-92ca-396e193a53a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f7676b377e4bb584f940c6f699cdec'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:12.211479 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-9696c6fd-a6ba-42bf-92ca-396e193a53a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f7676b377e4bb584f940c6f699cdec'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:12.212124 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-9696c6fd-a6ba-42bf-92ca-396e193a53a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f7676b377e4bb584f940c6f699cdec'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:12.224247 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-9696c6fd-a6ba-42bf-92ca-396e193a53a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f7676b377e4bb584f940c6f699cdec'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:12.411595 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1314/2583] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:11 2022] DELETE /identity/v3/users/23f7676b377e4bb584f940c6f699cdec => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:12.416123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd47a7-3386-44fa-8411-c13d2e89fa7a None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:12.420255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd47a7-3386-44fa-8411-c13d2e89fa7a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:12.420255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd47a7-3386-44fa-8411-c13d2e89fa7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:12.436554 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ffbd47a7-3386-44fa-8411-c13d2e89fa7a None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:12.437870 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ffbd47a7-3386-44fa-8411-c13d2e89fa7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:12.501166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1270/2584] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:12.511553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696c6fd-a6ba-42bf-92ca-396e193a53a0 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:12.513008 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9696c6fd-a6ba-42bf-92ca-396e193a53a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:12.547980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:12.572955 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696c6fd-a6ba-42bf-92ca-396e193a53a0 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:12.576747 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb0543-d074-4d8f-8456-1324b5d8191c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:12.577401 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb0543-d074-4d8f-8456-1324b5d8191c service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:12.577715 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb0543-d074-4d8f-8456-1324b5d8191c service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:12.578043 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb0543-d074-4d8f-8456-1324b5d8191c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:12.587509 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb0543-d074-4d8f-8456-1324b5d8191c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:12.589052 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb0543-d074-4d8f-8456-1324b5d8191c service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:12.599457 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1315/2585] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:13.038884 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd47a7-3386-44fa-8411-c13d2e89fa7a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:13.040344 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ffbd47a7-3386-44fa-8411-c13d2e89fa7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:13.058357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd47a7-3386-44fa-8411-c13d2e89fa7a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:13.067715 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f63bd-9568-4d0d-ae09-d87c99f4ee86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:13.068829 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f63bd-9568-4d0d-ae09-d87c99f4ee86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:13.069228 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f63bd-9568-4d0d-ae09-d87c99f4ee86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:13.069544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f63bd-9568-4d0d-ae09-d87c99f4ee86 admin admin] PATH_INFO: `/v3/projects/51793efef34544ee8a47179a308dab6d` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:13.071022 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f63bd-9568-4d0d-ae09-d87c99f4ee86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51793efef34544ee8a47179a308dab6d)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:13.074124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f63bd-9568-4d0d-ae09-d87c99f4ee86 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:13.205348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b46f63bd-9568-4d0d-ae09-d87c99f4ee86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51793efef34544ee8a47179a308dab6d', 'request_id': 'req-b46f63bd-9568-4d0d-ae09-d87c99f4ee86'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:13.313385 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b46f63bd-9568-4d0d-ae09-d87c99f4ee86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51793efef34544ee8a47179a308dab6d', 'request_id': 'req-b46f63bd-9568-4d0d-ae09-d87c99f4ee86'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:13.320148 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b46f63bd-9568-4d0d-ae09-d87c99f4ee86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51793efef34544ee8a47179a308dab6d', 'request_id': 'req-b46f63bd-9568-4d0d-ae09-d87c99f4ee86'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:13.331071 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b46f63bd-9568-4d0d-ae09-d87c99f4ee86 admin admin] The token cache is being invalidate because project 51793efef34544ee8a47179a308dab6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:13.331360 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b46f63bd-9568-4d0d-ae09-d87c99f4ee86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:13.332006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b46f63bd-9568-4d0d-ae09-d87c99f4ee86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:13.333589 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1271/2586] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:13 2022] DELETE /identity/v3/projects/51793efef34544ee8a47179a308dab6d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:13.338137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb0543-d074-4d8f-8456-1324b5d8191c service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:13.347811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb0543-d074-4d8f-8456-1324b5d8191c service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:13.405459 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37b5bd-b4e5-4a1f-889f-9ee1d5b73a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:13.406366 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37b5bd-b4e5-4a1f-889f-9ee1d5b73a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:13.406650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37b5bd-b4e5-4a1f-889f-9ee1d5b73a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:13.406929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37b5bd-b4e5-4a1f-889f-9ee1d5b73a9d admin admin] PATH_INFO: `/v3/users/7ff1fa9556c24671941d4d1a1889c472` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:13.408119 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37b5bd-b4e5-4a1f-889f-9ee1d5b73a9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ff1fa9556c24671941d4d1a1889c472)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:13.410131 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37b5bd-b4e5-4a1f-889f-9ee1d5b73a9d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:13.609128 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6d37b5bd-b4e5-4a1f-889f-9ee1d5b73a9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ff1fa9556c24671941d4d1a1889c472'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:13.616745 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6d37b5bd-b4e5-4a1f-889f-9ee1d5b73a9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ff1fa9556c24671941d4d1a1889c472'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:13.617433 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6d37b5bd-b4e5-4a1f-889f-9ee1d5b73a9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ff1fa9556c24671941d4d1a1889c472'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:13.618060 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6d37b5bd-b4e5-4a1f-889f-9ee1d5b73a9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ff1fa9556c24671941d4d1a1889c472'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:13.631735 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6d37b5bd-b4e5-4a1f-889f-9ee1d5b73a9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ff1fa9556c24671941d4d1a1889c472'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:13.736894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1316/2587] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:13 2022] DELETE /identity/v3/users/7ff1fa9556c24671941d4d1a1889c472 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:14.269125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f63bd-9568-4d0d-ae09-d87c99f4ee86 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:14.270634 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b46f63bd-9568-4d0d-ae09-d87c99f4ee86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:14.284667 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f63bd-9568-4d0d-ae09-d87c99f4ee86 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:14.336696 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:14.343248 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287c00b-39ff-41c1-9410-c1679b56e688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:14.344115 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287c00b-39ff-41c1-9410-c1679b56e688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:14.344402 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287c00b-39ff-41c1-9410-c1679b56e688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:14.344789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287c00b-39ff-41c1-9410-c1679b56e688 admin admin] PATH_INFO: `/v3/projects/51ce49ca022a48939a7a3032cf7dc37f` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:14.346008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287c00b-39ff-41c1-9410-c1679b56e688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51ce49ca022a48939a7a3032cf7dc37f)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:14.347963 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287c00b-39ff-41c1-9410-c1679b56e688 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:14.464732 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e287c00b-39ff-41c1-9410-c1679b56e688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ce49ca022a48939a7a3032cf7dc37f', 'request_id': 'req-e287c00b-39ff-41c1-9410-c1679b56e688'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:14.551700 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e287c00b-39ff-41c1-9410-c1679b56e688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ce49ca022a48939a7a3032cf7dc37f', 'request_id': 'req-e287c00b-39ff-41c1-9410-c1679b56e688'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:14.558834 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e287c00b-39ff-41c1-9410-c1679b56e688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ce49ca022a48939a7a3032cf7dc37f', 'request_id': 'req-e287c00b-39ff-41c1-9410-c1679b56e688'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:14.568918 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e287c00b-39ff-41c1-9410-c1679b56e688 admin admin] The token cache is being invalidate because project 51ce49ca022a48939a7a3032cf7dc37f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:14.569205 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e287c00b-39ff-41c1-9410-c1679b56e688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:14.569838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e287c00b-39ff-41c1-9410-c1679b56e688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:14.572120 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1272/2588] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:14 2022] DELETE /identity/v3/projects/51ce49ca022a48939a7a3032cf7dc37f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:14.577515 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dcfaa-83d4-4a18-a1e2-b6365c720881 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:14.577994 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dcfaa-83d4-4a18-a1e2-b6365c720881 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:14.578100 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dcfaa-83d4-4a18-a1e2-b6365c720881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:14.597436 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-7b2dcfaa-83d4-4a18-a1e2-b6365c720881 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:14.602232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7b2dcfaa-83d4-4a18-a1e2-b6365c720881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:14.647535 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:14.659464 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1317/2589] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:14.667229 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a4266-a504-4267-ad7f-1a743aaff088 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:14.667526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a4266-a504-4267-ad7f-1a743aaff088 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:14.667812 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a4266-a504-4267-ad7f-1a743aaff088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:14.687508 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-916a4266-a504-4267-ad7f-1a743aaff088 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:14.688810 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-916a4266-a504-4267-ad7f-1a743aaff088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:14.697614 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1273/2590] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:14.702089 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dcfaa-83d4-4a18-a1e2-b6365c720881 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:14.714156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dcfaa-83d4-4a18-a1e2-b6365c720881 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:14.719229 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827dcbba-cffa-4251-b5a1-c854256e7233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:14.719909 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dcbba-cffa-4251-b5a1-c854256e7233 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:14.720243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dcbba-cffa-4251-b5a1-c854256e7233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:14.720523 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dcbba-cffa-4251-b5a1-c854256e7233 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:14.721320 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827dcbba-cffa-4251-b5a1-c854256e7233 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:08:14.721637 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827dcbba-cffa-4251-b5a1-c854256e7233 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:14.723390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827dcbba-cffa-4251-b5a1-c854256e7233 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:14.737429 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1318/2591] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:08:14.742577 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a4266-a504-4267-ad7f-1a743aaff088 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:14.752525 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a4266-a504-4267-ad7f-1a743aaff088 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:14.762713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5c7eb-fbdb-4ba2-a4ef-34ec4323cd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:14.762713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5c7eb-fbdb-4ba2-a4ef-34ec4323cd6d admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:14.762713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5c7eb-fbdb-4ba2-a4ef-34ec4323cd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:14.762713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5c7eb-fbdb-4ba2-a4ef-34ec4323cd6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:14.763109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5c7eb-fbdb-4ba2-a4ef-34ec4323cd6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:14.763109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5c7eb-fbdb-4ba2-a4ef-34ec4323cd6d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:14.852919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1274/2592] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:14 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:14.856598 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827dcbba-cffa-4251-b5a1-c854256e7233 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:14.866900 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827dcbba-cffa-4251-b5a1-c854256e7233 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:14.922662 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701254a3-5c06-4501-af8b-7350c3b385bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:14.923266 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701254a3-5c06-4501-af8b-7350c3b385bd admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:14.923580 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701254a3-5c06-4501-af8b-7350c3b385bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:14.923858 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701254a3-5c06-4501-af8b-7350c3b385bd admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:14.924549 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701254a3-5c06-4501-af8b-7350c3b385bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:14.926518 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701254a3-5c06-4501-af8b-7350c3b385bd admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:15.066026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1319/2593] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:14 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:15.068188 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5c7eb-fbdb-4ba2-a4ef-34ec4323cd6d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:15.078470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5c7eb-fbdb-4ba2-a4ef-34ec4323cd6d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:15.082984 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81912e9b-763c-4df0-a3a0-2b4f42d94bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:15.083635 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81912e9b-763c-4df0-a3a0-2b4f42d94bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:15.083921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81912e9b-763c-4df0-a3a0-2b4f42d94bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:15.084200 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81912e9b-763c-4df0-a3a0-2b4f42d94bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:15.084963 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81912e9b-763c-4df0-a3a0-2b4f42d94bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:15.086563 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81912e9b-763c-4df0-a3a0-2b4f42d94bc7 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:15.097246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1275/2594] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:15.101429 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701254a3-5c06-4501-af8b-7350c3b385bd admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:15.112094 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701254a3-5c06-4501-af8b-7350c3b385bd admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:15.116661 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e0971-e9b3-4dec-b378-ccdf1283210e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:15.117317 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e0971-e9b3-4dec-b378-ccdf1283210e admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:15.117608 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e0971-e9b3-4dec-b378-ccdf1283210e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:15.117892 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e0971-e9b3-4dec-b378-ccdf1283210e admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:15.119181 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e0971-e9b3-4dec-b378-ccdf1283210e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:15.120793 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e0971-e9b3-4dec-b378-ccdf1283210e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:15.130738 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1320/2595] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:08:15.134854 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81912e9b-763c-4df0-a3a0-2b4f42d94bc7 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:15.144841 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81912e9b-763c-4df0-a3a0-2b4f42d94bc7 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:15.149904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ccd66-a47e-48cb-9b24-5bb824b31a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:15.150765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ccd66-a47e-48cb-9b24-5bb824b31a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:15.151050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ccd66-a47e-48cb-9b24-5bb824b31a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:15.151328 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ccd66-a47e-48cb-9b24-5bb824b31a0a admin admin] PATH_INFO: `/v3/projects/400d1f3cca894daa917c4a51f54d4fe9/users/a13a1b3dba0d4badb1a0360b2e607529/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:15.166195 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ccd66-a47e-48cb-9b24-5bb824b31a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=400d1f3cca894daa917c4a51f54d4fe9, user_id=a13a1b3dba0d4badb1a0360b2e607529, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:15.168884 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ccd66-a47e-48cb-9b24-5bb824b31a0a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:15.255713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1276/2596] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:15 2022] PUT /identity/v3/projects/400d1f3cca894daa917c4a51f54d4fe9/users/a13a1b3dba0d4badb1a0360b2e607529/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:15.267140 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ece8cb-8535-4594-bbf1-5ab03f0c86bc None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:15.267435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ece8cb-8535-4594-bbf1-5ab03f0c86bc None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:15.267759 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ece8cb-8535-4594-bbf1-5ab03f0c86bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:15.296679 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-95ece8cb-8535-4594-bbf1-5ab03f0c86bc None None] MFA Rules not processed for user `a13a1b3dba0d4badb1a0360b2e607529`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:15.297920 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-95ece8cb-8535-4594-bbf1-5ab03f0c86bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:15.361389 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1321/2597] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:15.372517 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ccd66-a47e-48cb-9b24-5bb824b31a0a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:15.374255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3c8ccd66-a47e-48cb-9b24-5bb824b31a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:15.430449 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ccd66-a47e-48cb-9b24-5bb824b31a0a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:15.434080 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6602e3-e8a8-43ad-9a9a-f4a7db66ffd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:15.434720 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6602e3-e8a8-43ad-9a9a-f4a7db66ffd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:15.435006 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6602e3-e8a8-43ad-9a9a-f4a7db66ffd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:15.435286 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6602e3-e8a8-43ad-9a9a-f4a7db66ffd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:15.443568 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6602e3-e8a8-43ad-9a9a-f4a7db66ffd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:15.445039 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6602e3-e8a8-43ad-9a9a-f4a7db66ffd6 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:15.453746 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1277/2598] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:17.296075 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ece8cb-8535-4594-bbf1-5ab03f0c86bc None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:17.297535 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-95ece8cb-8535-4594-bbf1-5ab03f0c86bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:17.351195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:17.354930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ece8cb-8535-4594-bbf1-5ab03f0c86bc None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:17.358811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42585ee1-95b7-417a-8548-f35876a07a5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:17.359454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42585ee1-95b7-417a-8548-f35876a07a5d service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:17.359742 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42585ee1-95b7-417a-8548-f35876a07a5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:17.360020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42585ee1-95b7-417a-8548-f35876a07a5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:17.361905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-42585ee1-95b7-417a-8548-f35876a07a5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:17.424947 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42585ee1-95b7-417a-8548-f35876a07a5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:17.426907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42585ee1-95b7-417a-8548-f35876a07a5d service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:17.437292 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1322/2599] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:21.108769 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6602e3-e8a8-43ad-9a9a-f4a7db66ffd6 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:21.110297 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5c6602e3-e8a8-43ad-9a9a-f4a7db66ffd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:21.124617 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6602e3-e8a8-43ad-9a9a-f4a7db66ffd6 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:21.129156 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a9213-8321-44f3-aca9-d6721d7b3e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:21.130032 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a9213-8321-44f3-aca9-d6721d7b3e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:21.130420 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a9213-8321-44f3-aca9-d6721d7b3e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:21.130697 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a9213-8321-44f3-aca9-d6721d7b3e6c admin admin] PATH_INFO: `/v3/users/475bac060a98475d858e6181eec7ce11` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:21.131889 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a9213-8321-44f3-aca9-d6721d7b3e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=475bac060a98475d858e6181eec7ce11)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:21.133880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a9213-8321-44f3-aca9-d6721d7b3e6c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:21.156150 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:21.335393 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-815a9213-8321-44f3-aca9-d6721d7b3e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '475bac060a98475d858e6181eec7ce11'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:21.343089 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-815a9213-8321-44f3-aca9-d6721d7b3e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '475bac060a98475d858e6181eec7ce11'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:21.343776 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-815a9213-8321-44f3-aca9-d6721d7b3e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '475bac060a98475d858e6181eec7ce11'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:21.344429 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-815a9213-8321-44f3-aca9-d6721d7b3e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '475bac060a98475d858e6181eec7ce11'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:21.358236 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-815a9213-8321-44f3-aca9-d6721d7b3e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '475bac060a98475d858e6181eec7ce11'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:21.644443 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1278/2600] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:21 2022] DELETE /identity/v3/users/475bac060a98475d858e6181eec7ce11 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:21.944127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42585ee1-95b7-417a-8548-f35876a07a5d service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:21.957353 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42585ee1-95b7-417a-8548-f35876a07a5d service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:22.016897 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a90601-05b6-4b0b-af27-ce293b0b8ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:22.017767 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a90601-05b6-4b0b-af27-ce293b0b8ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:22.018055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a90601-05b6-4b0b-af27-ce293b0b8ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:22.018367 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a90601-05b6-4b0b-af27-ce293b0b8ac7 admin admin] PATH_INFO: `/v3/projects/6c201d76ac4e4cc08fdc38e7165d4764` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:22.019796 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a90601-05b6-4b0b-af27-ce293b0b8ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c201d76ac4e4cc08fdc38e7165d4764)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:22.021745 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a90601-05b6-4b0b-af27-ce293b0b8ac7 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:22.197891 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f5a90601-05b6-4b0b-af27-ce293b0b8ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c201d76ac4e4cc08fdc38e7165d4764', 'request_id': 'req-f5a90601-05b6-4b0b-af27-ce293b0b8ac7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:22.203337 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f5a90601-05b6-4b0b-af27-ce293b0b8ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c201d76ac4e4cc08fdc38e7165d4764', 'request_id': 'req-f5a90601-05b6-4b0b-af27-ce293b0b8ac7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:22.214731 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f5a90601-05b6-4b0b-af27-ce293b0b8ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c201d76ac4e4cc08fdc38e7165d4764', 'request_id': 'req-f5a90601-05b6-4b0b-af27-ce293b0b8ac7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:22.313205 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f5a90601-05b6-4b0b-af27-ce293b0b8ac7 admin admin] The token cache is being invalidate because project 6c201d76ac4e4cc08fdc38e7165d4764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:22.317936 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f5a90601-05b6-4b0b-af27-ce293b0b8ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:22.317936 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-f5a90601-05b6-4b0b-af27-ce293b0b8ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:22.317936 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1323/2601] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:21 2022] DELETE /identity/v3/projects/6c201d76ac4e4cc08fdc38e7165d4764 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:22.321105 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c839d-3b06-4f71-928b-965e1ca80dbf None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:22.321594 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c839d-3b06-4f71-928b-965e1ca80dbf None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:22.321702 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c839d-3b06-4f71-928b-965e1ca80dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:22.341663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-8d5c839d-3b06-4f71-928b-965e1ca80dbf None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:22.342873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8d5c839d-3b06-4f71-928b-965e1ca80dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:22.402251 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1279/2602] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:22.410141 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71825852-8f31-4084-b240-843c88b879b4 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:22.410430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71825852-8f31-4084-b240-843c88b879b4 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:22.410707 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71825852-8f31-4084-b240-843c88b879b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:22.428949 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-71825852-8f31-4084-b240-843c88b879b4 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:22.430149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-71825852-8f31-4084-b240-843c88b879b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:22.438145 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1324/2603] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:22.442337 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c839d-3b06-4f71-928b-965e1ca80dbf None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:22.453293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c839d-3b06-4f71-928b-965e1ca80dbf None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:22.458347 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881d497-e25c-4643-bd90-f535746c30db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:22.459007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881d497-e25c-4643-bd90-f535746c30db admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:22.459296 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881d497-e25c-4643-bd90-f535746c30db admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:22.459578 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881d497-e25c-4643-bd90-f535746c30db admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:22.460401 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881d497-e25c-4643-bd90-f535746c30db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:08:22.460755 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881d497-e25c-4643-bd90-f535746c30db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:22.462418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881d497-e25c-4643-bd90-f535746c30db admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:22.477128 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1280/2604] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:08:22.482097 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71825852-8f31-4084-b240-843c88b879b4 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:22.498508 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71825852-8f31-4084-b240-843c88b879b4 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:22.503505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4596c1e-bbf5-459e-9d42-9ed98cce44ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:22.504160 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4596c1e-bbf5-459e-9d42-9ed98cce44ae admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:22.504492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4596c1e-bbf5-459e-9d42-9ed98cce44ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:22.504808 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4596c1e-bbf5-459e-9d42-9ed98cce44ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:22.505630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4596c1e-bbf5-459e-9d42-9ed98cce44ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:22.507578 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4596c1e-bbf5-459e-9d42-9ed98cce44ae admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:22.595224 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:22.604341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1325/2605] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:22 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:22.607282 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881d497-e25c-4643-bd90-f535746c30db admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:22.617573 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881d497-e25c-4643-bd90-f535746c30db admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:22.679876 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58373323-5024-495e-a191-f3fa0ee31c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:22.680673 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58373323-5024-495e-a191-f3fa0ee31c8b admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:22.680987 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58373323-5024-495e-a191-f3fa0ee31c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:22.681265 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58373323-5024-495e-a191-f3fa0ee31c8b admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:22.682494 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58373323-5024-495e-a191-f3fa0ee31c8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:22.684976 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58373323-5024-495e-a191-f3fa0ee31c8b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:22.874731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1281/2606] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:22 2022] POST /identity/v3/users => generated 283 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:08:22.879554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4596c1e-bbf5-459e-9d42-9ed98cce44ae admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:22.890515 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4596c1e-bbf5-459e-9d42-9ed98cce44ae admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:22.895374 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3ab4a-329b-4ddd-a0b2-6d6677d2665d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:22.896168 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3ab4a-329b-4ddd-a0b2-6d6677d2665d admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:22.896552 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3ab4a-329b-4ddd-a0b2-6d6677d2665d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:22.897035 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3ab4a-329b-4ddd-a0b2-6d6677d2665d admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:22.897844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3ab4a-329b-4ddd-a0b2-6d6677d2665d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:22.899482 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3ab4a-329b-4ddd-a0b2-6d6677d2665d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:22.910228 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1326/2607] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:22.914371 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58373323-5024-495e-a191-f3fa0ee31c8b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:22.924388 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58373323-5024-495e-a191-f3fa0ee31c8b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:22.929262 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce130a7-29db-416f-9a84-2e4b771c8c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:22.929874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce130a7-29db-416f-9a84-2e4b771c8c17 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:22.930820 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce130a7-29db-416f-9a84-2e4b771c8c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:22.930820 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce130a7-29db-416f-9a84-2e4b771c8c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:22.931123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce130a7-29db-416f-9a84-2e4b771c8c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:22.933261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce130a7-29db-416f-9a84-2e4b771c8c17 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:22.944356 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1282/2608] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:22.949149 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3ab4a-329b-4ddd-a0b2-6d6677d2665d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:22.961861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3ab4a-329b-4ddd-a0b2-6d6677d2665d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:22.966919 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8395d7-00a3-442c-9d91-b01f60c99f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:22.969323 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8395d7-00a3-442c-9d91-b01f60c99f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:22.974452 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8395d7-00a3-442c-9d91-b01f60c99f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:22.974452 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8395d7-00a3-442c-9d91-b01f60c99f5e admin admin] PATH_INFO: `/v3/projects/bb46a84ff4ff4635a5cf381d8d3c1bf7/users/cc6cca1f213b47c0a2eba74bca96d54f/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:22.986170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8395d7-00a3-442c-9d91-b01f60c99f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb46a84ff4ff4635a5cf381d8d3c1bf7, user_id=cc6cca1f213b47c0a2eba74bca96d54f, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:22.988869 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8395d7-00a3-442c-9d91-b01f60c99f5e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:23.085730 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1327/2609] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:22 2022] PUT /identity/v3/projects/bb46a84ff4ff4635a5cf381d8d3c1bf7/users/cc6cca1f213b47c0a2eba74bca96d54f/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:23.095535 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b9a59-6526-4a46-99ae-62a7308daa80 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:23.095892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b9a59-6526-4a46-99ae-62a7308daa80 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:23.096366 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b9a59-6526-4a46-99ae-62a7308daa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:23.104205 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:23.128262 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-160b9a59-6526-4a46-99ae-62a7308daa80 None None] MFA Rules not processed for user `cc6cca1f213b47c0a2eba74bca96d54f`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:23.128813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-160b9a59-6526-4a46-99ae-62a7308daa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:23.192256 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1283/2610] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:23.196695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8395d7-00a3-442c-9d91-b01f60c99f5e admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:23.260188 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8395d7-00a3-442c-9d91-b01f60c99f5e admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:23.265206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2b331-14c8-4ffc-ba7e-2ed2cb8126bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:23.265984 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2b331-14c8-4ffc-ba7e-2ed2cb8126bb admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:23.266328 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2b331-14c8-4ffc-ba7e-2ed2cb8126bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:23.266571 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2b331-14c8-4ffc-ba7e-2ed2cb8126bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:23.267247 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2b331-14c8-4ffc-ba7e-2ed2cb8126bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:23.269297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2b331-14c8-4ffc-ba7e-2ed2cb8126bb admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:23.390053 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1328/2611] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:23 2022] POST /identity/v3/projects => generated 365 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:23.394189 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b9a59-6526-4a46-99ae-62a7308daa80 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:23.404939 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b9a59-6526-4a46-99ae-62a7308daa80 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:23.464701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29582649-e500-4722-aa05-e95e2eeafec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:23.465715 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29582649-e500-4722-aa05-e95e2eeafec2 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:23.466152 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29582649-e500-4722-aa05-e95e2eeafec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:23.466583 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29582649-e500-4722-aa05-e95e2eeafec2 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:23.467595 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29582649-e500-4722-aa05-e95e2eeafec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:23.469603 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29582649-e500-4722-aa05-e95e2eeafec2 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:23.658291 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1284/2612] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:23 2022] POST /identity/v3/users => generated 289 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:23.661203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2b331-14c8-4ffc-ba7e-2ed2cb8126bb admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:23.671454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2b331-14c8-4ffc-ba7e-2ed2cb8126bb admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:23.676108 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c647470-aaf3-46fe-ba29-d58f641ec622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:23.676804 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c647470-aaf3-46fe-ba29-d58f641ec622 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:23.677165 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c647470-aaf3-46fe-ba29-d58f641ec622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:23.677400 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c647470-aaf3-46fe-ba29-d58f641ec622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:23.678158 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c647470-aaf3-46fe-ba29-d58f641ec622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:23.679782 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c647470-aaf3-46fe-ba29-d58f641ec622 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:23.691031 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1329/2613] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:23.695460 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29582649-e500-4722-aa05-e95e2eeafec2 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:23.706944 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29582649-e500-4722-aa05-e95e2eeafec2 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:23.711622 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa682045-1a9f-45ca-9c41-fc50ed76b879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:23.715814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa682045-1a9f-45ca-9c41-fc50ed76b879 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:23.715814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa682045-1a9f-45ca-9c41-fc50ed76b879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:23.715814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa682045-1a9f-45ca-9c41-fc50ed76b879 admin admin] PATH_INFO: `/v3/projects/75f7f876c2b04af1a22c9a09f8064d48/users/c9ed68b92b2643669bc2302ee51853bf/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:23.728062 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa682045-1a9f-45ca-9c41-fc50ed76b879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75f7f876c2b04af1a22c9a09f8064d48, user_id=c9ed68b92b2643669bc2302ee51853bf, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:23.731510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa682045-1a9f-45ca-9c41-fc50ed76b879 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:23.849110 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1285/2614] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:23 2022] PUT /identity/v3/projects/75f7f876c2b04af1a22c9a09f8064d48/users/c9ed68b92b2643669bc2302ee51853bf/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:23.853226 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c647470-aaf3-46fe-ba29-d58f641ec622 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:23.864940 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c647470-aaf3-46fe-ba29-d58f641ec622 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:23.920707 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d3303-734c-4571-8d26-e0ff902099c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:23.921308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d3303-734c-4571-8d26-e0ff902099c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:23.921591 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d3303-734c-4571-8d26-e0ff902099c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:23.921870 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d3303-734c-4571-8d26-e0ff902099c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:23.922596 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d3303-734c-4571-8d26-e0ff902099c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:23.924203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d3303-734c-4571-8d26-e0ff902099c4 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:23.934426 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1330/2615] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:23.938754 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa682045-1a9f-45ca-9c41-fc50ed76b879 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:23.950014 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa682045-1a9f-45ca-9c41-fc50ed76b879 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:23.954560 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0127df1-beff-462c-800e-6caa95e7e0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:23.955430 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0127df1-beff-462c-800e-6caa95e7e0dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:23.955708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0127df1-beff-462c-800e-6caa95e7e0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:23.956029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0127df1-beff-462c-800e-6caa95e7e0dc admin admin] PATH_INFO: `/v3/projects/75f7f876c2b04af1a22c9a09f8064d48/users/c9ed68b92b2643669bc2302ee51853bf/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:23.958028 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0127df1-beff-462c-800e-6caa95e7e0dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=75f7f876c2b04af1a22c9a09f8064d48, user_id=c9ed68b92b2643669bc2302ee51853bf, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:23.960706 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0127df1-beff-462c-800e-6caa95e7e0dc admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:23.971616 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1286/2616] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:23 2022] PUT /identity/v3/projects/75f7f876c2b04af1a22c9a09f8064d48/users/c9ed68b92b2643669bc2302ee51853bf/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:23.983670 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26c054-300a-47e2-b627-e6b40dc1c742 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:23.984188 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26c054-300a-47e2-b627-e6b40dc1c742 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:23.984308 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26c054-300a-47e2-b627-e6b40dc1c742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:24.011510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-bb26c054-300a-47e2-b627-e6b40dc1c742 None None] MFA Rules not processed for user `c9ed68b92b2643669bc2302ee51853bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:24.012740 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-bb26c054-300a-47e2-b627-e6b40dc1c742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:24.038782 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:24.085373 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1331/2617] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:23 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:24.097286 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0127df1-beff-462c-800e-6caa95e7e0dc admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:24.098985 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a0127df1-beff-462c-800e-6caa95e7e0dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:24.159776 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:24.165009 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0127df1-beff-462c-800e-6caa95e7e0dc admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:24.168793 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e0256-99d2-44c9-ac75-6fe64e6bf6b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:24.169678 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e0256-99d2-44c9-ac75-6fe64e6bf6b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:24.170034 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e0256-99d2-44c9-ac75-6fe64e6bf6b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:24.170500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e0256-99d2-44c9-ac75-6fe64e6bf6b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:24.180053 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e0256-99d2-44c9-ac75-6fe64e6bf6b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:24.181445 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e0256-99d2-44c9-ac75-6fe64e6bf6b6 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:24.191635 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1287/2618] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:24 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:25.228330 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26c054-300a-47e2-b627-e6b40dc1c742 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:25.299838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26c054-300a-47e2-b627-e6b40dc1c742 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:25.305733 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545dea7-c6e6-46de-825c-bdbfea4356ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:25.306650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545dea7-c6e6-46de-825c-bdbfea4356ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:25.306935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545dea7-c6e6-46de-825c-bdbfea4356ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:25.307208 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545dea7-c6e6-46de-825c-bdbfea4356ef admin admin] PATH_INFO: `/v3/users/cc6cca1f213b47c0a2eba74bca96d54f` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:25.308425 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545dea7-c6e6-46de-825c-bdbfea4356ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc6cca1f213b47c0a2eba74bca96d54f)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:25.310389 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545dea7-c6e6-46de-825c-bdbfea4356ef admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:25.518118 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3545dea7-c6e6-46de-825c-bdbfea4356ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc6cca1f213b47c0a2eba74bca96d54f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:25.526679 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3545dea7-c6e6-46de-825c-bdbfea4356ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc6cca1f213b47c0a2eba74bca96d54f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:25.527357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3545dea7-c6e6-46de-825c-bdbfea4356ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc6cca1f213b47c0a2eba74bca96d54f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:25.527969 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3545dea7-c6e6-46de-825c-bdbfea4356ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc6cca1f213b47c0a2eba74bca96d54f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:25.540240 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3545dea7-c6e6-46de-825c-bdbfea4356ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc6cca1f213b47c0a2eba74bca96d54f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:25.662719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1332/2619] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:25 2022] DELETE /identity/v3/users/cc6cca1f213b47c0a2eba74bca96d54f => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:25.667259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e38bbb-a7f6-437b-b7ac-e410c8ac9913 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:25.667756 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e38bbb-a7f6-437b-b7ac-e410c8ac9913 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:25.667887 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e38bbb-a7f6-437b-b7ac-e410c8ac9913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:25.687589 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-40e38bbb-a7f6-437b-b7ac-e410c8ac9913 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:25.688849 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-40e38bbb-a7f6-437b-b7ac-e410c8ac9913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:25.749602 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1288/2620] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:25.761028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545dea7-c6e6-46de-825c-bdbfea4356ef admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:25.762447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3545dea7-c6e6-46de-825c-bdbfea4356ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:25.810746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:25.824914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545dea7-c6e6-46de-825c-bdbfea4356ef admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:25.828481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310c5fe-e478-4efa-8d11-6bf9855c31c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:25.829162 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310c5fe-e478-4efa-8d11-6bf9855c31c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:25.829449 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310c5fe-e478-4efa-8d11-6bf9855c31c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:25.829736 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310c5fe-e478-4efa-8d11-6bf9855c31c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:25.838718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310c5fe-e478-4efa-8d11-6bf9855c31c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:25.840167 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310c5fe-e478-4efa-8d11-6bf9855c31c8 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:25.849743 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1333/2621] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:26.024418 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e38bbb-a7f6-437b-b7ac-e410c8ac9913 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:26.025979 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-40e38bbb-a7f6-437b-b7ac-e410c8ac9913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:26.038467 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e38bbb-a7f6-437b-b7ac-e410c8ac9913 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:26.043783 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7529eb-8b79-4411-9310-d1c64f352a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:26.044770 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7529eb-8b79-4411-9310-d1c64f352a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:26.045056 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7529eb-8b79-4411-9310-d1c64f352a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:26.045327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7529eb-8b79-4411-9310-d1c64f352a7d admin admin] PATH_INFO: `/v3/users/a13a1b3dba0d4badb1a0360b2e607529` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:26.046572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7529eb-8b79-4411-9310-d1c64f352a7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a13a1b3dba0d4badb1a0360b2e607529)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:26.048874 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7529eb-8b79-4411-9310-d1c64f352a7d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:26.292959 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-7d7529eb-8b79-4411-9310-d1c64f352a7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a13a1b3dba0d4badb1a0360b2e607529'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:26.299799 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-7d7529eb-8b79-4411-9310-d1c64f352a7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a13a1b3dba0d4badb1a0360b2e607529'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:26.300456 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-7d7529eb-8b79-4411-9310-d1c64f352a7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a13a1b3dba0d4badb1a0360b2e607529'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:26.301093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-7d7529eb-8b79-4411-9310-d1c64f352a7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a13a1b3dba0d4badb1a0360b2e607529'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:26.313764 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-7d7529eb-8b79-4411-9310-d1c64f352a7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a13a1b3dba0d4badb1a0360b2e607529'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:26.321564 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310c5fe-e478-4efa-8d11-6bf9855c31c8 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:26.323287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0310c5fe-e478-4efa-8d11-6bf9855c31c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:26.339559 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310c5fe-e478-4efa-8d11-6bf9855c31c8 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:26.344114 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4f3d9-3d53-493f-bce5-ccbdd55aca23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:26.345011 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4f3d9-3d53-493f-bce5-ccbdd55aca23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:26.346031 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4f3d9-3d53-493f-bce5-ccbdd55aca23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:26.346659 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4f3d9-3d53-493f-bce5-ccbdd55aca23 admin admin] PATH_INFO: `/v3/projects/bb46a84ff4ff4635a5cf381d8d3c1bf7` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:26.347867 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4f3d9-3d53-493f-bce5-ccbdd55aca23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb46a84ff4ff4635a5cf381d8d3c1bf7)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:26.349885 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4f3d9-3d53-493f-bce5-ccbdd55aca23 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:26.410346 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1289/2622] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:26 2022] DELETE /identity/v3/users/a13a1b3dba0d4badb1a0360b2e607529 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:26.414563 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873379f-65f9-46b0-b8ba-82389464b945 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:26.414896 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873379f-65f9-46b0-b8ba-82389464b945 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:26.415177 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873379f-65f9-46b0-b8ba-82389464b945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:26.432040 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-4873379f-65f9-46b0-b8ba-82389464b945 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:26.433275 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4873379f-65f9-46b0-b8ba-82389464b945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:26.493402 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1290/2623] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:08:26.503091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873379f-65f9-46b0-b8ba-82389464b945 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:26.505680 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4873379f-65f9-46b0-b8ba-82389464b945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:26.513468 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:26.518088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3cc4f3d9-3d53-493f-bce5-ccbdd55aca23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb46a84ff4ff4635a5cf381d8d3c1bf7', 'request_id': 'req-3cc4f3d9-3d53-493f-bce5-ccbdd55aca23'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:26.523998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3cc4f3d9-3d53-493f-bce5-ccbdd55aca23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb46a84ff4ff4635a5cf381d8d3c1bf7', 'request_id': 'req-3cc4f3d9-3d53-493f-bce5-ccbdd55aca23'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:26.531454 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3cc4f3d9-3d53-493f-bce5-ccbdd55aca23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb46a84ff4ff4635a5cf381d8d3c1bf7', 'request_id': 'req-3cc4f3d9-3d53-493f-bce5-ccbdd55aca23'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:26.569981 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873379f-65f9-46b0-b8ba-82389464b945 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:26.620482 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacab84-f40f-449e-9140-7e386d8c0fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:26.621175 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacab84-f40f-449e-9140-7e386d8c0fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:26.621463 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacab84-f40f-449e-9140-7e386d8c0fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:26.621746 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacab84-f40f-449e-9140-7e386d8c0fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:26.629275 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3cc4f3d9-3d53-493f-bce5-ccbdd55aca23 admin admin] The token cache is being invalidate because project bb46a84ff4ff4635a5cf381d8d3c1bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:26.632257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3cc4f3d9-3d53-493f-bce5-ccbdd55aca23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:26.632257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3cc4f3d9-3d53-493f-bce5-ccbdd55aca23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:26.632257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1334/2624] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:26 2022] DELETE /identity/v3/projects/bb46a84ff4ff4635a5cf381d8d3c1bf7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:26.635842 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4f3d9-3d53-493f-bce5-ccbdd55aca23 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:26.637271 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3cc4f3d9-3d53-493f-bce5-ccbdd55aca23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:26.687459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acacab84-f40f-449e-9140-7e386d8c0fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:26.688998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acacab84-f40f-449e-9140-7e386d8c0fe6 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:26.698940 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1291/2625] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:08:26.712082 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4f3d9-3d53-493f-bce5-ccbdd55aca23 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:26.717834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d7d23-bca0-4521-9951-01afa35fd3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:26.718722 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d7d23-bca0-4521-9951-01afa35fd3a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:26.719008 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d7d23-bca0-4521-9951-01afa35fd3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:26.719314 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d7d23-bca0-4521-9951-01afa35fd3a5 admin admin] PATH_INFO: `/v3/users/c9ed68b92b2643669bc2302ee51853bf` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:26.720562 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d7d23-bca0-4521-9951-01afa35fd3a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ed68b92b2643669bc2302ee51853bf)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:26.722611 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d7d23-bca0-4521-9951-01afa35fd3a5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:27.037268 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5f4d7d23-bca0-4521-9951-01afa35fd3a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ed68b92b2643669bc2302ee51853bf'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:27.038922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5f4d7d23-bca0-4521-9951-01afa35fd3a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ed68b92b2643669bc2302ee51853bf'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:27.039685 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5f4d7d23-bca0-4521-9951-01afa35fd3a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ed68b92b2643669bc2302ee51853bf'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:27.040246 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5f4d7d23-bca0-4521-9951-01afa35fd3a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ed68b92b2643669bc2302ee51853bf'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:27.053176 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:27.058489 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5f4d7d23-bca0-4521-9951-01afa35fd3a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ed68b92b2643669bc2302ee51853bf'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:27.226173 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1335/2626] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:26 2022] DELETE /identity/v3/users/c9ed68b92b2643669bc2302ee51853bf => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:27.265615 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacab84-f40f-449e-9140-7e386d8c0fe6 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:27.267187 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-acacab84-f40f-449e-9140-7e386d8c0fe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:27.280263 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacab84-f40f-449e-9140-7e386d8c0fe6 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:27.352151 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2c13a-b516-44c5-8654-5301ca54e0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:27.353057 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2c13a-b516-44c5-8654-5301ca54e0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:27.353369 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2c13a-b516-44c5-8654-5301ca54e0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:27.353644 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2c13a-b516-44c5-8654-5301ca54e0a5 admin admin] PATH_INFO: `/v3/projects/400d1f3cca894daa917c4a51f54d4fe9` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:27.354826 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2c13a-b516-44c5-8654-5301ca54e0a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=400d1f3cca894daa917c4a51f54d4fe9)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:27.357264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2c13a-b516-44c5-8654-5301ca54e0a5 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:27.367626 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:27.534593 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b2e2c13a-b516-44c5-8654-5301ca54e0a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '400d1f3cca894daa917c4a51f54d4fe9', 'request_id': 'req-b2e2c13a-b516-44c5-8654-5301ca54e0a5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:27.650179 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b2e2c13a-b516-44c5-8654-5301ca54e0a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '400d1f3cca894daa917c4a51f54d4fe9', 'request_id': 'req-b2e2c13a-b516-44c5-8654-5301ca54e0a5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:27.657393 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b2e2c13a-b516-44c5-8654-5301ca54e0a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '400d1f3cca894daa917c4a51f54d4fe9', 'request_id': 'req-b2e2c13a-b516-44c5-8654-5301ca54e0a5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:27.668727 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b2e2c13a-b516-44c5-8654-5301ca54e0a5 admin admin] The token cache is being invalidate because project 400d1f3cca894daa917c4a51f54d4fe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:27.669022 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b2e2c13a-b516-44c5-8654-5301ca54e0a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:27.669673 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b2e2c13a-b516-44c5-8654-5301ca54e0a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:27.671209 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1292/2627] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:27 2022] DELETE /identity/v3/projects/400d1f3cca894daa917c4a51f54d4fe9 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:27.676066 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58abb63-83ac-4cd9-b0d0-c5524ad7edf6 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:27.676544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58abb63-83ac-4cd9-b0d0-c5524ad7edf6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:27.676712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58abb63-83ac-4cd9-b0d0-c5524ad7edf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:27.694203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2c13a-b516-44c5-8654-5301ca54e0a5 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:27.695421 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b2e2c13a-b516-44c5-8654-5301ca54e0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:27.696965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-f58abb63-83ac-4cd9-b0d0-c5524ad7edf6 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:27.698244 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f58abb63-83ac-4cd9-b0d0-c5524ad7edf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:27.770789 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1336/2628] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:27.781431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c26e53-9514-4551-9024-75ecbcd3bcb3 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:27.785885 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c26e53-9514-4551-9024-75ecbcd3bcb3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:27.785885 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c26e53-9514-4551-9024-75ecbcd3bcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:27.792475 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2c13a-b516-44c5-8654-5301ca54e0a5 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:27.797371 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aff1f3-eb38-4a17-9d1b-fe8a135c8d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:27.798422 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aff1f3-eb38-4a17-9d1b-fe8a135c8d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:27.798773 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aff1f3-eb38-4a17-9d1b-fe8a135c8d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:27.799120 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aff1f3-eb38-4a17-9d1b-fe8a135c8d08 admin admin] PATH_INFO: `/v3/projects/75f7f876c2b04af1a22c9a09f8064d48` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:27.800398 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aff1f3-eb38-4a17-9d1b-fe8a135c8d08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75f7f876c2b04af1a22c9a09f8064d48)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:27.802607 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aff1f3-eb38-4a17-9d1b-fe8a135c8d08 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:27.806213 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-f7c26e53-9514-4551-9024-75ecbcd3bcb3 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:27.808073 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f7c26e53-9514-4551-9024-75ecbcd3bcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:27.819607 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1337/2629] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:27.821446 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c26e53-9514-4551-9024-75ecbcd3bcb3 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:27.833434 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c26e53-9514-4551-9024-75ecbcd3bcb3 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:27.838769 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f08e6-12e1-423b-8b43-10e0b277c631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:27.839430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f08e6-12e1-423b-8b43-10e0b277c631 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:27.839716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f08e6-12e1-423b-8b43-10e0b277c631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:27.843232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f08e6-12e1-423b-8b43-10e0b277c631 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:27.843232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f08e6-12e1-423b-8b43-10e0b277c631 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:08:27.843232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f08e6-12e1-423b-8b43-10e0b277c631 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:27.843232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f08e6-12e1-423b-8b43-10e0b277c631 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:27.859469 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1338/2630] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:08:27.863777 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f08e6-12e1-423b-8b43-10e0b277c631 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:27.873672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f08e6-12e1-423b-8b43-10e0b277c631 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:27.878592 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613dc76-2a70-491a-be7c-59bdaa16d8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:27.879245 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613dc76-2a70-491a-be7c-59bdaa16d8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:27.879536 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613dc76-2a70-491a-be7c-59bdaa16d8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:27.879817 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613dc76-2a70-491a-be7c-59bdaa16d8d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:27.880509 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3613dc76-2a70-491a-be7c-59bdaa16d8d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:27.882516 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3613dc76-2a70-491a-be7c-59bdaa16d8d4 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:27.936133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f6aff1f3-eb38-4a17-9d1b-fe8a135c8d08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75f7f876c2b04af1a22c9a09f8064d48', 'request_id': 'req-f6aff1f3-eb38-4a17-9d1b-fe8a135c8d08'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:28.034553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1339/2631] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:27 2022] POST /identity/v3/projects => generated 381 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:28.038785 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613dc76-2a70-491a-be7c-59bdaa16d8d4 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:28.071709 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f6aff1f3-eb38-4a17-9d1b-fe8a135c8d08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75f7f876c2b04af1a22c9a09f8064d48', 'request_id': 'req-f6aff1f3-eb38-4a17-9d1b-fe8a135c8d08'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:28.080144 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f6aff1f3-eb38-4a17-9d1b-fe8a135c8d08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75f7f876c2b04af1a22c9a09f8064d48', 'request_id': 'req-f6aff1f3-eb38-4a17-9d1b-fe8a135c8d08'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:28.094823 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f6aff1f3-eb38-4a17-9d1b-fe8a135c8d08 admin admin] The token cache is being invalidate because project 75f7f876c2b04af1a22c9a09f8064d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:28.095123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f6aff1f3-eb38-4a17-9d1b-fe8a135c8d08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:28.095914 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f6aff1f3-eb38-4a17-9d1b-fe8a135c8d08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:28.097541 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1293/2632] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:27 2022] DELETE /identity/v3/projects/75f7f876c2b04af1a22c9a09f8064d48 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:28.102357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebea79-e05b-4c08-8b69-88c131fc792e None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:28.102650 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebea79-e05b-4c08-8b69-88c131fc792e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:28.102928 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebea79-e05b-4c08-8b69-88c131fc792e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:28.115201 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613dc76-2a70-491a-be7c-59bdaa16d8d4 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:28.119906 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e2d42-503a-4099-af8c-1fde8cb94ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:28.120577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e2d42-503a-4099-af8c-1fde8cb94ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:28.120887 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e2d42-503a-4099-af8c-1fde8cb94ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:28.121164 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e2d42-503a-4099-af8c-1fde8cb94ed1 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:28.121849 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e2d42-503a-4099-af8c-1fde8cb94ed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:28.122622 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-5bebea79-e05b-4c08-8b69-88c131fc792e None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:28.123788 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e2d42-503a-4099-af8c-1fde8cb94ed1 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:28.123905 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5bebea79-e05b-4c08-8b69-88c131fc792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:28.131711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1294/2633] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:08:28.139092 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e67be1-a61a-4e3f-9431-5b8a010336e0 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:28.139447 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e67be1-a61a-4e3f-9431-5b8a010336e0 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:28.139734 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e67be1-a61a-4e3f-9431-5b8a010336e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:28.157762 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-30e67be1-a61a-4e3f-9431-5b8a010336e0 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:28.158951 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-30e67be1-a61a-4e3f-9431-5b8a010336e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:28.167526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1295/2634] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:08:28.173301 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e67be1-a61a-4e3f-9431-5b8a010336e0 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:28.183221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e67be1-a61a-4e3f-9431-5b8a010336e0 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:28.188171 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b7c46-3cc8-4d9a-b966-e069c1dbd3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:28.188673 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b7c46-3cc8-4d9a-b966-e069c1dbd3fc admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:28.188964 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b7c46-3cc8-4d9a-b966-e069c1dbd3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:28.189246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b7c46-3cc8-4d9a-b966-e069c1dbd3fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:28.190016 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b7c46-3cc8-4d9a-b966-e069c1dbd3fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:08:28.190334 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b7c46-3cc8-4d9a-b966-e069c1dbd3fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:28.191944 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b7c46-3cc8-4d9a-b966-e069c1dbd3fc admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:28.203686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1296/2635] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 13:08:28.207821 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b7c46-3cc8-4d9a-b966-e069c1dbd3fc admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:28.213384 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:28.215492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1340/2636] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:28 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:08:28.218581 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b7c46-3cc8-4d9a-b966-e069c1dbd3fc admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:28.219335 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e2d42-503a-4099-af8c-1fde8cb94ed1 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:28.220951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-de3e2d42-503a-4099-af8c-1fde8cb94ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:28.223270 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68799de-ff42-4e3f-b040-78d99d968b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:28.224183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68799de-ff42-4e3f-b040-78d99d968b9d admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:28.224468 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68799de-ff42-4e3f-b040-78d99d968b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:28.228265 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68799de-ff42-4e3f-b040-78d99d968b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:28.228265 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68799de-ff42-4e3f-b040-78d99d968b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:28.228265 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68799de-ff42-4e3f-b040-78d99d968b9d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:28.234554 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e2d42-503a-4099-af8c-1fde8cb94ed1 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:28.239331 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb257e-a410-4f6a-97c3-7b8baff58b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:28.239997 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb257e-a410-4f6a-97c3-7b8baff58b8c admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:28.240280 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb257e-a410-4f6a-97c3-7b8baff58b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:28.240560 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb257e-a410-4f6a-97c3-7b8baff58b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:28.241339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb257e-a410-4f6a-97c3-7b8baff58b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:28.242985 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb257e-a410-4f6a-97c3-7b8baff58b8c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:28.253354 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1341/2637] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:08:28.257306 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb257e-a410-4f6a-97c3-7b8baff58b8c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:28.267801 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb257e-a410-4f6a-97c3-7b8baff58b8c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:28.272426 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b511f-5378-45f9-aa62-494b693761a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:28.273099 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b511f-5378-45f9-aa62-494b693761a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:28.273402 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b511f-5378-45f9-aa62-494b693761a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:28.273665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b511f-5378-45f9-aa62-494b693761a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:28.274376 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b511f-5378-45f9-aa62-494b693761a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:28.276639 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b511f-5378-45f9-aa62-494b693761a0 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:28.286352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1342/2638] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:08:28.290116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b511f-5378-45f9-aa62-494b693761a0 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:28.299644 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b511f-5378-45f9-aa62-494b693761a0 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:28.304229 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275df39-f802-4c79-9300-06ed89c2f4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:28.305096 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275df39-f802-4c79-9300-06ed89c2f4f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:28.305370 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275df39-f802-4c79-9300-06ed89c2f4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:28.305697 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275df39-f802-4c79-9300-06ed89c2f4f0 admin admin] PATH_INFO: `/v3/projects/8461fdd34eef42d089eb3c3d7d607518/users/3212553bb4ae401d9d56f311c779f035/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:28.314134 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:28.320335 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275df39-f802-4c79-9300-06ed89c2f4f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8461fdd34eef42d089eb3c3d7d607518, user_id=3212553bb4ae401d9d56f311c779f035, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:28.323565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275df39-f802-4c79-9300-06ed89c2f4f0 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:28.326763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1297/2639] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:28 2022] POST /identity/v3/projects => generated 355 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:28.330867 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68799de-ff42-4e3f-b040-78d99d968b9d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:28.391565 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68799de-ff42-4e3f-b040-78d99d968b9d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:28.396228 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4d967-5b33-487c-abd4-a4b7f68b3d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:28.396923 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4d967-5b33-487c-abd4-a4b7f68b3d55 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:28.397214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4d967-5b33-487c-abd4-a4b7f68b3d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:28.397528 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4d967-5b33-487c-abd4-a4b7f68b3d55 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:28.398216 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4d967-5b33-487c-abd4-a4b7f68b3d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:28.400166 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4d967-5b33-487c-abd4-a4b7f68b3d55 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:28.456461 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1343/2640] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:28 2022] PUT /identity/v3/projects/8461fdd34eef42d089eb3c3d7d607518/users/3212553bb4ae401d9d56f311c779f035/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:28.461384 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4248a-8d1d-42b2-a12f-2ca2e386a94b None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:28.461673 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4248a-8d1d-42b2-a12f-2ca2e386a94b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:28.461950 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4248a-8d1d-42b2-a12f-2ca2e386a94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:28.479203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-6de4248a-8d1d-42b2-a12f-2ca2e386a94b None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:28.480399 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6de4248a-8d1d-42b2-a12f-2ca2e386a94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:28.517058 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1298/2641] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:28 2022] POST /identity/v3/users => generated 278 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:08:28.518158 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4d967-5b33-487c-abd4-a4b7f68b3d55 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:28.528564 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4d967-5b33-487c-abd4-a4b7f68b3d55 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:28.538438 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1344/2642] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:08:28.548050 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4248a-8d1d-42b2-a12f-2ca2e386a94b None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:28.549445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6de4248a-8d1d-42b2-a12f-2ca2e386a94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:28.586906 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04039359-0a30-4540-806f-c235da1924c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:28.587576 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04039359-0a30-4540-806f-c235da1924c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:28.588427 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04039359-0a30-4540-806f-c235da1924c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:28.588746 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04039359-0a30-4540-806f-c235da1924c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:28.589472 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04039359-0a30-4540-806f-c235da1924c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:28.591115 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04039359-0a30-4540-806f-c235da1924c0 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:28.601370 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1299/2643] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:28.605562 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04039359-0a30-4540-806f-c235da1924c0 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:28.608618 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4248a-8d1d-42b2-a12f-2ca2e386a94b None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:28.612633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec1324-97a0-4260-9c42-328a0ff1f8f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:28.613287 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec1324-97a0-4260-9c42-328a0ff1f8f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:28.613572 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec1324-97a0-4260-9c42-328a0ff1f8f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:28.613848 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec1324-97a0-4260-9c42-328a0ff1f8f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:28.616707 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04039359-0a30-4540-806f-c235da1924c0 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:28.621869 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bd18c-a1a5-4fc5-871d-73e3e501ff63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:28.622521 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bd18c-a1a5-4fc5-871d-73e3e501ff63 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:28.622807 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bd18c-a1a5-4fc5-871d-73e3e501ff63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:28.623094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bd18c-a1a5-4fc5-871d-73e3e501ff63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:28.623814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bd18c-a1a5-4fc5-871d-73e3e501ff63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:28.624118 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec1324-97a0-4260-9c42-328a0ff1f8f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:28.625442 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bd18c-a1a5-4fc5-871d-73e3e501ff63 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:28.625560 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec1324-97a0-4260-9c42-328a0ff1f8f4 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:28.635904 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1345/2644] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:08:28.636302 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1300/2645] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:08:28.636746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec1324-97a0-4260-9c42-328a0ff1f8f4 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:28.641049 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bd18c-a1a5-4fc5-871d-73e3e501ff63 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:28.645270 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec1324-97a0-4260-9c42-328a0ff1f8f4 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:28.650121 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0491c6d-daf1-4c42-90c2-c6aded53310d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:28.650810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0491c6d-daf1-4c42-90c2-c6aded53310d service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:28.651101 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0491c6d-daf1-4c42-90c2-c6aded53310d service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:28.651757 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0491c6d-daf1-4c42-90c2-c6aded53310d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:28.651953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bd18c-a1a5-4fc5-871d-73e3e501ff63 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:28.653528 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b0491c6d-daf1-4c42-90c2-c6aded53310d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:28.657245 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceea17f-f5c4-4c23-a649-d523fd726cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:28.658131 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceea17f-f5c4-4c23-a649-d523fd726cf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:28.658612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceea17f-f5c4-4c23-a649-d523fd726cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:28.658838 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceea17f-f5c4-4c23-a649-d523fd726cf8 admin admin] PATH_INFO: `/v3/projects/49ba952d7aae44098299156d27a1f8c7/users/1043513b20b94ba0a6df3a895c211e43/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:28.674537 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceea17f-f5c4-4c23-a649-d523fd726cf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49ba952d7aae44098299156d27a1f8c7, user_id=1043513b20b94ba0a6df3a895c211e43, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:28.677286 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceea17f-f5c4-4c23-a649-d523fd726cf8 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:28.715955 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0491c6d-daf1-4c42-90c2-c6aded53310d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:28.717359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0491c6d-daf1-4c42-90c2-c6aded53310d service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:28.726765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1346/2646] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:28.763745 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1301/2647] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:28 2022] PUT /identity/v3/projects/49ba952d7aae44098299156d27a1f8c7/users/1043513b20b94ba0a6df3a895c211e43/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:28.776964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30af444-88a3-413e-8fda-b2b37dc55ec4 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:28.777253 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30af444-88a3-413e-8fda-b2b37dc55ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:28.777527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30af444-88a3-413e-8fda-b2b37dc55ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:28.804352 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a30af444-88a3-413e-8fda-b2b37dc55ec4 None None] MFA Rules not processed for user `1043513b20b94ba0a6df3a895c211e43`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:28.805673 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a30af444-88a3-413e-8fda-b2b37dc55ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:28.823870 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:28.874508 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1347/2648] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:28 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:28.879550 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceea17f-f5c4-4c23-a649-d523fd726cf8 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:28.922127 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:28.951648 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceea17f-f5c4-4c23-a649-d523fd726cf8 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:28.956508 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c392ce-0711-4387-8ca8-6ef07c6dd30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:28.957242 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c392ce-0711-4387-8ca8-6ef07c6dd30b admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:28.957561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c392ce-0711-4387-8ca8-6ef07c6dd30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:28.957841 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c392ce-0711-4387-8ca8-6ef07c6dd30b admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:28.958547 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c392ce-0711-4387-8ca8-6ef07c6dd30b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:28.960477 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c392ce-0711-4387-8ca8-6ef07c6dd30b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:29.066803 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1302/2649] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:28 2022] POST /identity/v3/projects => generated 355 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:29.068015 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30af444-88a3-413e-8fda-b2b37dc55ec4 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:29.079444 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30af444-88a3-413e-8fda-b2b37dc55ec4 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:29.137964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd446205-ac78-4b24-bbc7-f5badea674ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:29.138681 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd446205-ac78-4b24-bbc7-f5badea674ce admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:29.138969 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd446205-ac78-4b24-bbc7-f5badea674ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:29.139248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd446205-ac78-4b24-bbc7-f5badea674ce admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:29.140696 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd446205-ac78-4b24-bbc7-f5badea674ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:29.143520 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd446205-ac78-4b24-bbc7-f5badea674ce admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:29.242439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1348/2650] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:29 2022] POST /identity/v3/users => generated 284 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:29.243808 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c392ce-0711-4387-8ca8-6ef07c6dd30b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:29.254417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c392ce-0711-4387-8ca8-6ef07c6dd30b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:29.260575 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a53d36-2ba8-4c1a-aa89-478d2ccbd31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:29.261399 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a53d36-2ba8-4c1a-aa89-478d2ccbd31c admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:29.261753 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a53d36-2ba8-4c1a-aa89-478d2ccbd31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:29.262040 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a53d36-2ba8-4c1a-aa89-478d2ccbd31c admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:29.262753 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a53d36-2ba8-4c1a-aa89-478d2ccbd31c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:29.264346 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a53d36-2ba8-4c1a-aa89-478d2ccbd31c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:29.277147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1303/2651] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:29.281239 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd446205-ac78-4b24-bbc7-f5badea674ce admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:29.291665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd446205-ac78-4b24-bbc7-f5badea674ce admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:29.296292 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ccde5-2ce6-461c-92c5-c85a9fba5182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:29.297347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ccde5-2ce6-461c-92c5-c85a9fba5182 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:29.297497 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ccde5-2ce6-461c-92c5-c85a9fba5182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:29.297772 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ccde5-2ce6-461c-92c5-c85a9fba5182 admin admin] PATH_INFO: `/v3/projects/e20b1ce89a1c47ecbc93d7b7e0c730b6/users/339650c0560a4d06a378dafbd83c3399/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:29.312718 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ccde5-2ce6-461c-92c5-c85a9fba5182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20b1ce89a1c47ecbc93d7b7e0c730b6, user_id=339650c0560a4d06a378dafbd83c3399, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:29.315399 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ccde5-2ce6-461c-92c5-c85a9fba5182 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:29.427955 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1349/2652] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:29 2022] PUT /identity/v3/projects/e20b1ce89a1c47ecbc93d7b7e0c730b6/users/339650c0560a4d06a378dafbd83c3399/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:29.432604 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a53d36-2ba8-4c1a-aa89-478d2ccbd31c admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:29.443093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a53d36-2ba8-4c1a-aa89-478d2ccbd31c admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:29.503327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d5938-566c-49d5-ae7f-261ee3df129b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:29.504167 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d5938-566c-49d5-ae7f-261ee3df129b admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:29.504478 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d5938-566c-49d5-ae7f-261ee3df129b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:29.504819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d5938-566c-49d5-ae7f-261ee3df129b admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:29.505598 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d5938-566c-49d5-ae7f-261ee3df129b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:29.507210 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d5938-566c-49d5-ae7f-261ee3df129b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:29.521419 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1304/2653] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:29.522395 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ccde5-2ce6-461c-92c5-c85a9fba5182 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:29.534877 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ccde5-2ce6-461c-92c5-c85a9fba5182 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:29.540141 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53115e-ee30-464c-a2a4-0a83b01ff781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:29.541209 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53115e-ee30-464c-a2a4-0a83b01ff781 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:29.541568 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53115e-ee30-464c-a2a4-0a83b01ff781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:29.541924 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53115e-ee30-464c-a2a4-0a83b01ff781 admin admin] PATH_INFO: `/v3/projects/e20b1ce89a1c47ecbc93d7b7e0c730b6/users/339650c0560a4d06a378dafbd83c3399/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:29.544054 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53115e-ee30-464c-a2a4-0a83b01ff781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20b1ce89a1c47ecbc93d7b7e0c730b6, user_id=339650c0560a4d06a378dafbd83c3399, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:29.546976 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53115e-ee30-464c-a2a4-0a83b01ff781 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:29.561443 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1350/2654] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:29 2022] PUT /identity/v3/projects/e20b1ce89a1c47ecbc93d7b7e0c730b6/users/339650c0560a4d06a378dafbd83c3399/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:08:29.571254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5540a-6753-41b7-be8d-c91c0df30615 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:29.574327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5540a-6753-41b7-be8d-c91c0df30615 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:29.574327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5540a-6753-41b7-be8d-c91c0df30615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:29.602665 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-bed5540a-6753-41b7-be8d-c91c0df30615 None None] MFA Rules not processed for user `339650c0560a4d06a378dafbd83c3399`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:29.603940 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-bed5540a-6753-41b7-be8d-c91c0df30615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:29.678837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1305/2655] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:29 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:29.692302 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53115e-ee30-464c-a2a4-0a83b01ff781 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:29.695732 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2a53115e-ee30-464c-a2a4-0a83b01ff781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:29.770152 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53115e-ee30-464c-a2a4-0a83b01ff781 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:29.773984 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea1b4b-9022-4af9-a137-6273a33d5d20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:29.774663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea1b4b-9022-4af9-a137-6273a33d5d20 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:29.774945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea1b4b-9022-4af9-a137-6273a33d5d20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:29.775362 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea1b4b-9022-4af9-a137-6273a33d5d20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:29.786505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea1b4b-9022-4af9-a137-6273a33d5d20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:29.787979 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea1b4b-9022-4af9-a137-6273a33d5d20 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:29.799953 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1351/2656] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:29 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:30.034832 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5540a-6753-41b7-be8d-c91c0df30615 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:30.045683 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5540a-6753-41b7-be8d-c91c0df30615 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:30.049528 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fe764-43fd-4f16-9fe3-4d1bf381bf8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:30.050400 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fe764-43fd-4f16-9fe3-4d1bf381bf8e service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:30.050930 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fe764-43fd-4f16-9fe3-4d1bf381bf8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:30.051214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fe764-43fd-4f16-9fe3-4d1bf381bf8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:30.082029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:30.118635 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88fe764-43fd-4f16-9fe3-4d1bf381bf8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:30.120101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88fe764-43fd-4f16-9fe3-4d1bf381bf8e service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:30.129703 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1306/2657] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:30 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:30.353028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac23093-62b2-472b-bdb5-6009d78a935d None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:30.353889 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac23093-62b2-472b-bdb5-6009d78a935d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:30.354174 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac23093-62b2-472b-bdb5-6009d78a935d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:30.381182 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:30.385405 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-4ac23093-62b2-472b-bdb5-6009d78a935d None None] MFA Rules not processed for user `3212553bb4ae401d9d56f311c779f035`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:30.388830 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4ac23093-62b2-472b-bdb5-6009d78a935d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:30.495542 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1352/2658] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:30.508047 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fe764-43fd-4f16-9fe3-4d1bf381bf8e service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:30.510871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b88fe764-43fd-4f16-9fe3-4d1bf381bf8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:30.525045 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fe764-43fd-4f16-9fe3-4d1bf381bf8e service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:30.530013 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4446d-a686-49da-97c2-e623002f7311 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:30.530959 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4446d-a686-49da-97c2-e623002f7311 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:30.531350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4446d-a686-49da-97c2-e623002f7311 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:30.531943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4446d-a686-49da-97c2-e623002f7311 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:30.552263 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4446d-a686-49da-97c2-e623002f7311 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:30.553908 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4446d-a686-49da-97c2-e623002f7311 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:30.566772 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1307/2659] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:08:32.459882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5957bb-be98-4d3f-b3ff-a4e25cd74e5c None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:32.460428 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5957bb-be98-4d3f-b3ff-a4e25cd74e5c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:32.460576 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5957bb-be98-4d3f-b3ff-a4e25cd74e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:32.479886 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-fc5957bb-be98-4d3f-b3ff-a4e25cd74e5c None None] MFA Rules not processed for user `3212553bb4ae401d9d56f311c779f035`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:32.481745 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-fc5957bb-be98-4d3f-b3ff-a4e25cd74e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:32.489282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1353/2660] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:32.807654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4446d-a686-49da-97c2-e623002f7311 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:32.864497 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4446d-a686-49da-97c2-e623002f7311 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:32.869586 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6aadf-1bc9-4d53-b81b-2c696e96493d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:32.870187 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6aadf-1bc9-4d53-b81b-2c696e96493d service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:32.870470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6aadf-1bc9-4d53-b81b-2c696e96493d service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:32.870748 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6aadf-1bc9-4d53-b81b-2c696e96493d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:32.872616 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c2f6aadf-1bc9-4d53-b81b-2c696e96493d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:32.882833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6aadf-1bc9-4d53-b81b-2c696e96493d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:32.884326 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6aadf-1bc9-4d53-b81b-2c696e96493d service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:32.893008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1308/2661] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:35.851153 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5957bb-be98-4d3f-b3ff-a4e25cd74e5c None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:35.852579 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-fc5957bb-be98-4d3f-b3ff-a4e25cd74e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:35.865716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5957bb-be98-4d3f-b3ff-a4e25cd74e5c None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:35.869372 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1acdb-1392-49f4-a91b-0e8b9bec1961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:35.870025 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1acdb-1392-49f4-a91b-0e8b9bec1961 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:35.870311 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1acdb-1392-49f4-a91b-0e8b9bec1961 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:35.870692 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1acdb-1392-49f4-a91b-0e8b9bec1961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:35.872534 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1ae1acdb-1392-49f4-a91b-0e8b9bec1961 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:35.940989 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1acdb-1392-49f4-a91b-0e8b9bec1961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:35.942435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1acdb-1392-49f4-a91b-0e8b9bec1961 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:35.952888 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1354/2662] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:42.894631 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=48 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:44.033667 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6aadf-1bc9-4d53-b81b-2c696e96493d service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:44.035313 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c2f6aadf-1bc9-4d53-b81b-2c696e96493d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:44.052295 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6aadf-1bc9-4d53-b81b-2c696e96493d service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:44.057607 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c25182-cb88-4e62-964a-26ec00d458ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:44.058522 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c25182-cb88-4e62-964a-26ec00d458ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:44.058831 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c25182-cb88-4e62-964a-26ec00d458ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:44.059277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c25182-cb88-4e62-964a-26ec00d458ae admin admin] PATH_INFO: `/v3/users/4cf000835f1f48cca0a46b233e52c8b9` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:44.060358 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c25182-cb88-4e62-964a-26ec00d458ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cf000835f1f48cca0a46b233e52c8b9)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:44.062402 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c25182-cb88-4e62-964a-26ec00d458ae admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:44.381093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e7c25182-cb88-4e62-964a-26ec00d458ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cf000835f1f48cca0a46b233e52c8b9'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:44.391079 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e7c25182-cb88-4e62-964a-26ec00d458ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cf000835f1f48cca0a46b233e52c8b9'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:44.391955 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e7c25182-cb88-4e62-964a-26ec00d458ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cf000835f1f48cca0a46b233e52c8b9'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:44.392693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e7c25182-cb88-4e62-964a-26ec00d458ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cf000835f1f48cca0a46b233e52c8b9'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:44.406468 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e7c25182-cb88-4e62-964a-26ec00d458ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cf000835f1f48cca0a46b233e52c8b9'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:44.520018 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1309/2663] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:44 2022] DELETE /identity/v3/users/4cf000835f1f48cca0a46b233e52c8b9 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:44.786843 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1acdb-1392-49f4-a91b-0e8b9bec1961 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:44.802995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1acdb-1392-49f4-a91b-0e8b9bec1961 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:44.875696 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5240fb-d24e-4765-97c7-cda69a6f53e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:44.876964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5240fb-d24e-4765-97c7-cda69a6f53e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:44.877445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5240fb-d24e-4765-97c7-cda69a6f53e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:44.877895 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5240fb-d24e-4765-97c7-cda69a6f53e9 admin admin] PATH_INFO: `/v3/projects/ec699c3dd1ab470c8cc0685e6e9f766a` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:44.879411 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5240fb-d24e-4765-97c7-cda69a6f53e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec699c3dd1ab470c8cc0685e6e9f766a)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:44.881565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5240fb-d24e-4765-97c7-cda69a6f53e9 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:45.020815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:45.032706 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bb5240fb-d24e-4765-97c7-cda69a6f53e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'request_id': 'req-bb5240fb-d24e-4765-97c7-cda69a6f53e9'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:45.038379 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bb5240fb-d24e-4765-97c7-cda69a6f53e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'request_id': 'req-bb5240fb-d24e-4765-97c7-cda69a6f53e9'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:45.045310 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bb5240fb-d24e-4765-97c7-cda69a6f53e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec699c3dd1ab470c8cc0685e6e9f766a', 'request_id': 'req-bb5240fb-d24e-4765-97c7-cda69a6f53e9'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:45.168313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bb5240fb-d24e-4765-97c7-cda69a6f53e9 admin admin] The token cache is being invalidate because project ec699c3dd1ab470c8cc0685e6e9f766a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:45.168642 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bb5240fb-d24e-4765-97c7-cda69a6f53e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:45.169592 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bb5240fb-d24e-4765-97c7-cda69a6f53e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:45.171539 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1355/2664] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:44 2022] DELETE /identity/v3/projects/ec699c3dd1ab470c8cc0685e6e9f766a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:45.175614 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c25182-cb88-4e62-964a-26ec00d458ae admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:45.177078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e7c25182-cb88-4e62-964a-26ec00d458ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:45.190841 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c25182-cb88-4e62-964a-26ec00d458ae admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:45.247946 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf59a3-5ef5-402b-acc4-7923a8a7468d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:45.248783 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf59a3-5ef5-402b-acc4-7923a8a7468d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:45.249092 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf59a3-5ef5-402b-acc4-7923a8a7468d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:45.249354 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf59a3-5ef5-402b-acc4-7923a8a7468d admin admin] PATH_INFO: `/v3/users/a99127a018ce4ba18a1546a0f056382e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:45.250650 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf59a3-5ef5-402b-acc4-7923a8a7468d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a99127a018ce4ba18a1546a0f056382e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:45.252578 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf59a3-5ef5-402b-acc4-7923a8a7468d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:45.482018 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0aaf59a3-5ef5-402b-acc4-7923a8a7468d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a99127a018ce4ba18a1546a0f056382e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:45.490412 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0aaf59a3-5ef5-402b-acc4-7923a8a7468d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a99127a018ce4ba18a1546a0f056382e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:45.491571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0aaf59a3-5ef5-402b-acc4-7923a8a7468d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a99127a018ce4ba18a1546a0f056382e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:45.492197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0aaf59a3-5ef5-402b-acc4-7923a8a7468d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a99127a018ce4ba18a1546a0f056382e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:45.506861 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0aaf59a3-5ef5-402b-acc4-7923a8a7468d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a99127a018ce4ba18a1546a0f056382e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:45.508570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:45.632435 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1310/2665] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:45 2022] DELETE /identity/v3/users/a99127a018ce4ba18a1546a0f056382e => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:46.045024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5240fb-d24e-4765-97c7-cda69a6f53e9 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:46.046964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-bb5240fb-d24e-4765-97c7-cda69a6f53e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:46.083975 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5240fb-d24e-4765-97c7-cda69a6f53e9 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:46.126519 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e042c-cc4a-4fc1-a213-9acbd81aa283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:46.127897 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e042c-cc4a-4fc1-a213-9acbd81aa283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:46.128757 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e042c-cc4a-4fc1-a213-9acbd81aa283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:46.128757 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e042c-cc4a-4fc1-a213-9acbd81aa283 admin admin] PATH_INFO: `/v3/projects/e2b4475abb414735b37f5d7ba42078b2` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:46.130122 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e042c-cc4a-4fc1-a213-9acbd81aa283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b4475abb414735b37f5d7ba42078b2)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:46.132319 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e042c-cc4a-4fc1-a213-9acbd81aa283 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:46.305273 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e82e042c-cc4a-4fc1-a213-9acbd81aa283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b4475abb414735b37f5d7ba42078b2', 'request_id': 'req-e82e042c-cc4a-4fc1-a213-9acbd81aa283'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:46.311336 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e82e042c-cc4a-4fc1-a213-9acbd81aa283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b4475abb414735b37f5d7ba42078b2', 'request_id': 'req-e82e042c-cc4a-4fc1-a213-9acbd81aa283'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:46.318393 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e82e042c-cc4a-4fc1-a213-9acbd81aa283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b4475abb414735b37f5d7ba42078b2', 'request_id': 'req-e82e042c-cc4a-4fc1-a213-9acbd81aa283'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:46.439370 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e82e042c-cc4a-4fc1-a213-9acbd81aa283 admin admin] The token cache is being invalidate because project e2b4475abb414735b37f5d7ba42078b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:46.439669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e82e042c-cc4a-4fc1-a213-9acbd81aa283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:46.440313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e82e042c-cc4a-4fc1-a213-9acbd81aa283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:46.441975 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1356/2666] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:46 2022] DELETE /identity/v3/projects/e2b4475abb414735b37f5d7ba42078b2 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:50.129658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf59a3-5ef5-402b-acc4-7923a8a7468d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:50.131125 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0aaf59a3-5ef5-402b-acc4-7923a8a7468d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:50.144515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf59a3-5ef5-402b-acc4-7923a8a7468d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:50.205984 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a82d2a-8497-416c-be83-c9c8373ebe8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:50.206873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a82d2a-8497-416c-be83-c9c8373ebe8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:50.207160 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a82d2a-8497-416c-be83-c9c8373ebe8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:50.207439 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a82d2a-8497-416c-be83-c9c8373ebe8b admin admin] PATH_INFO: `/v3/users/1043513b20b94ba0a6df3a895c211e43` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:50.208660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a82d2a-8497-416c-be83-c9c8373ebe8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1043513b20b94ba0a6df3a895c211e43)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:50.210607 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a82d2a-8497-416c-be83-c9c8373ebe8b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:50.452694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-74a82d2a-8497-416c-be83-c9c8373ebe8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1043513b20b94ba0a6df3a895c211e43'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:50.459857 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-74a82d2a-8497-416c-be83-c9c8373ebe8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1043513b20b94ba0a6df3a895c211e43'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:50.460553 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-74a82d2a-8497-416c-be83-c9c8373ebe8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1043513b20b94ba0a6df3a895c211e43'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:50.461203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-74a82d2a-8497-416c-be83-c9c8373ebe8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1043513b20b94ba0a6df3a895c211e43'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:50.474507 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-74a82d2a-8497-416c-be83-c9c8373ebe8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1043513b20b94ba0a6df3a895c211e43'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:50.574595 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1311/2667] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:50 2022] DELETE /identity/v3/users/1043513b20b94ba0a6df3a895c211e43 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:50.579315 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17742b2e-13ab-4e1c-a712-36504741c081 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:50.579854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17742b2e-13ab-4e1c-a712-36504741c081 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:50.579854 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17742b2e-13ab-4e1c-a712-36504741c081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:50.597719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-17742b2e-13ab-4e1c-a712-36504741c081 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:50.599378 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-17742b2e-13ab-4e1c-a712-36504741c081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:50.644300 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:50.658982 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1357/2668] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:50.669610 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a82d2a-8497-416c-be83-c9c8373ebe8b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:50.671090 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-74a82d2a-8497-416c-be83-c9c8373ebe8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:50.730495 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a82d2a-8497-416c-be83-c9c8373ebe8b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:50.734571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40472a7e-3433-43da-bd51-afa01bba83e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:50.735364 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40472a7e-3433-43da-bd51-afa01bba83e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:50.735656 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40472a7e-3433-43da-bd51-afa01bba83e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:50.736066 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40472a7e-3433-43da-bd51-afa01bba83e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:50.746999 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40472a7e-3433-43da-bd51-afa01bba83e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:50.748445 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40472a7e-3433-43da-bd51-afa01bba83e2 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:50.758251 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1312/2669] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:51.240364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17742b2e-13ab-4e1c-a712-36504741c081 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:51.242027 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-17742b2e-13ab-4e1c-a712-36504741c081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:51.255826 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17742b2e-13ab-4e1c-a712-36504741c081 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:51.261300 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6665e-c022-48d1-b36d-83c41a70b16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:51.262219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6665e-c022-48d1-b36d-83c41a70b16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:51.262539 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6665e-c022-48d1-b36d-83c41a70b16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:51.262823 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6665e-c022-48d1-b36d-83c41a70b16e admin admin] PATH_INFO: `/v3/projects/49ba952d7aae44098299156d27a1f8c7` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:51.264026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6665e-c022-48d1-b36d-83c41a70b16e admin admin] RBAC: Authorizing `identity:delete_project(project_id=49ba952d7aae44098299156d27a1f8c7)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:51.265998 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6665e-c022-48d1-b36d-83c41a70b16e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:51.417351 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-59a6665e-c022-48d1-b36d-83c41a70b16e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49ba952d7aae44098299156d27a1f8c7', 'request_id': 'req-59a6665e-c022-48d1-b36d-83c41a70b16e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:51.423295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-59a6665e-c022-48d1-b36d-83c41a70b16e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49ba952d7aae44098299156d27a1f8c7', 'request_id': 'req-59a6665e-c022-48d1-b36d-83c41a70b16e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:51.429471 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-59a6665e-c022-48d1-b36d-83c41a70b16e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49ba952d7aae44098299156d27a1f8c7', 'request_id': 'req-59a6665e-c022-48d1-b36d-83c41a70b16e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:51.518712 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-59a6665e-c022-48d1-b36d-83c41a70b16e admin admin] The token cache is being invalidate because project 49ba952d7aae44098299156d27a1f8c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:51.518946 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-59a6665e-c022-48d1-b36d-83c41a70b16e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:51.519582 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-59a6665e-c022-48d1-b36d-83c41a70b16e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:51.521480 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1358/2670] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:51 2022] DELETE /identity/v3/projects/49ba952d7aae44098299156d27a1f8c7 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:51.525311 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40472a7e-3433-43da-bd51-afa01bba83e2 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:51.536245 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40472a7e-3433-43da-bd51-afa01bba83e2 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:51.547919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:51.599484 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0997d-5966-4549-a8ac-d1c919f26637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:51.600352 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0997d-5966-4549-a8ac-d1c919f26637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:51.600667 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0997d-5966-4549-a8ac-d1c919f26637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:51.600950 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0997d-5966-4549-a8ac-d1c919f26637 admin admin] PATH_INFO: `/v3/users/339650c0560a4d06a378dafbd83c3399` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:51.602134 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0997d-5966-4549-a8ac-d1c919f26637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=339650c0560a4d06a378dafbd83c3399)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:51.604631 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0997d-5966-4549-a8ac-d1c919f26637 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:51.846388 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b7c0997d-5966-4549-a8ac-d1c919f26637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '339650c0560a4d06a378dafbd83c3399'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:51.853952 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b7c0997d-5966-4549-a8ac-d1c919f26637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '339650c0560a4d06a378dafbd83c3399'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:51.854638 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b7c0997d-5966-4549-a8ac-d1c919f26637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '339650c0560a4d06a378dafbd83c3399'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:51.855250 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b7c0997d-5966-4549-a8ac-d1c919f26637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '339650c0560a4d06a378dafbd83c3399'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:51.867079 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b7c0997d-5966-4549-a8ac-d1c919f26637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '339650c0560a4d06a378dafbd83c3399'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:51.953209 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1313/2671] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:08:51 2022] DELETE /identity/v3/users/339650c0560a4d06a378dafbd83c3399 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:52.572182 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6665e-c022-48d1-b36d-83c41a70b16e admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:52.573792 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-59a6665e-c022-48d1-b36d-83c41a70b16e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:52.592156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6665e-c022-48d1-b36d-83c41a70b16e admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:52.649725 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bac55b-4402-45d1-aa69-67bf785d22c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:52.650687 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bac55b-4402-45d1-aa69-67bf785d22c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:52.650972 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bac55b-4402-45d1-aa69-67bf785d22c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:52.651323 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bac55b-4402-45d1-aa69-67bf785d22c6 admin admin] PATH_INFO: `/v3/projects/e20b1ce89a1c47ecbc93d7b7e0c730b6` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:52.652609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bac55b-4402-45d1-aa69-67bf785d22c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e20b1ce89a1c47ecbc93d7b7e0c730b6)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:52.654573 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bac55b-4402-45d1-aa69-67bf785d22c6 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:52.761602 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-86bac55b-4402-45d1-aa69-67bf785d22c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e20b1ce89a1c47ecbc93d7b7e0c730b6', 'request_id': 'req-86bac55b-4402-45d1-aa69-67bf785d22c6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:52.767186 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-86bac55b-4402-45d1-aa69-67bf785d22c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e20b1ce89a1c47ecbc93d7b7e0c730b6', 'request_id': 'req-86bac55b-4402-45d1-aa69-67bf785d22c6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:52.773558 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-86bac55b-4402-45d1-aa69-67bf785d22c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e20b1ce89a1c47ecbc93d7b7e0c730b6', 'request_id': 'req-86bac55b-4402-45d1-aa69-67bf785d22c6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:52.910799 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-86bac55b-4402-45d1-aa69-67bf785d22c6 admin admin] The token cache is being invalidate because project e20b1ce89a1c47ecbc93d7b7e0c730b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:08:52.911026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-86bac55b-4402-45d1-aa69-67bf785d22c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:52.911631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-86bac55b-4402-45d1-aa69-67bf785d22c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:08:52.913428 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1359/2672] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:08:52 2022] DELETE /identity/v3/projects/e20b1ce89a1c47ecbc93d7b7e0c730b6 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:52.918688 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a1903-fe85-4de7-9d25-c784d8d3a49f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:52.919238 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a1903-fe85-4de7-9d25-c784d8d3a49f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:52.919238 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a1903-fe85-4de7-9d25-c784d8d3a49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:52.937329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-650a1903-fe85-4de7-9d25-c784d8d3a49f None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:52.938771 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-650a1903-fe85-4de7-9d25-c784d8d3a49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:53.001224 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1314/2673] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:53.009053 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997d4f4-17e3-4691-a4c0-137c43366727 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:53.013083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997d4f4-17e3-4691-a4c0-137c43366727 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:53.013083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997d4f4-17e3-4691-a4c0-137c43366727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:53.019363 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:53.030738 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-7997d4f4-17e3-4691-a4c0-137c43366727 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:53.032038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7997d4f4-17e3-4691-a4c0-137c43366727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:53.041175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1360/2674] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:53.045554 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a1903-fe85-4de7-9d25-c784d8d3a49f None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:53.056409 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a1903-fe85-4de7-9d25-c784d8d3a49f None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:53.061098 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c4598-e76a-4654-ad6a-349362cecc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:53.061782 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c4598-e76a-4654-ad6a-349362cecc11 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:53.062065 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c4598-e76a-4654-ad6a-349362cecc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:53.062455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c4598-e76a-4654-ad6a-349362cecc11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:53.063182 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c4598-e76a-4654-ad6a-349362cecc11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:08:53.063657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c4598-e76a-4654-ad6a-349362cecc11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:53.065552 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c4598-e76a-4654-ad6a-349362cecc11 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:53.078759 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1315/2675] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:08:53.082952 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997d4f4-17e3-4691-a4c0-137c43366727 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:53.092047 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997d4f4-17e3-4691-a4c0-137c43366727 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:53.096773 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86f978-01eb-473b-8928-62fbf577a085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:53.097597 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86f978-01eb-473b-8928-62fbf577a085 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:53.097882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86f978-01eb-473b-8928-62fbf577a085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:53.098157 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86f978-01eb-473b-8928-62fbf577a085 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:53.098981 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86f978-01eb-473b-8928-62fbf577a085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:53.101235 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86f978-01eb-473b-8928-62fbf577a085 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:53.229919 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1361/2676] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:53 2022] POST /identity/v3/projects => generated 407 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:53.234197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c4598-e76a-4654-ad6a-349362cecc11 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:53.245122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c4598-e76a-4654-ad6a-349362cecc11 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:53.263144 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:53.301831 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae569bb-f938-4cd7-8903-ea9ca196aa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:53.302503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae569bb-f938-4cd7-8903-ea9ca196aa79 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:53.302809 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae569bb-f938-4cd7-8903-ea9ca196aa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:53.303083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae569bb-f938-4cd7-8903-ea9ca196aa79 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:53.303785 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae569bb-f938-4cd7-8903-ea9ca196aa79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:53.306353 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae569bb-f938-4cd7-8903-ea9ca196aa79 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:53.422842 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1316/2677] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:53 2022] POST /identity/v3/users => generated 304 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:08:53.426958 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86f978-01eb-473b-8928-62fbf577a085 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:53.437498 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86f978-01eb-473b-8928-62fbf577a085 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:53.442373 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71acf7b-2b96-4c89-b3a4-d0c5adac7211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:53.443202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71acf7b-2b96-4c89-b3a4-d0c5adac7211 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:53.443409 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71acf7b-2b96-4c89-b3a4-d0c5adac7211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:53.443673 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71acf7b-2b96-4c89-b3a4-d0c5adac7211 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:53.444405 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71acf7b-2b96-4c89-b3a4-d0c5adac7211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:53.446100 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71acf7b-2b96-4c89-b3a4-d0c5adac7211 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:53.457476 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1362/2678] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:53.461312 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae569bb-f938-4cd7-8903-ea9ca196aa79 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:53.472002 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae569bb-f938-4cd7-8903-ea9ca196aa79 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:53.476686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e2ebc-8a6b-4c96-85a2-9e0d89238583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:53.477371 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e2ebc-8a6b-4c96-85a2-9e0d89238583 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:53.478238 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e2ebc-8a6b-4c96-85a2-9e0d89238583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:53.478526 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e2ebc-8a6b-4c96-85a2-9e0d89238583 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:53.479262 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e2ebc-8a6b-4c96-85a2-9e0d89238583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:53.481230 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e2ebc-8a6b-4c96-85a2-9e0d89238583 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:53.491893 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1317/2679] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:53.495914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71acf7b-2b96-4c89-b3a4-d0c5adac7211 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:53.505792 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71acf7b-2b96-4c89-b3a4-d0c5adac7211 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:53.510340 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4fd506-b6cc-4a53-9265-6c01d40773a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:53.511297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fd506-b6cc-4a53-9265-6c01d40773a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:53.511583 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fd506-b6cc-4a53-9265-6c01d40773a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:53.511859 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fd506-b6cc-4a53-9265-6c01d40773a3 admin admin] PATH_INFO: `/v3/projects/35dbf7afc5dd4d07b279f20a5902429b/users/35e66aec64ea46e2a8c5b9bcad8b182f/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:53.527897 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4fd506-b6cc-4a53-9265-6c01d40773a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35dbf7afc5dd4d07b279f20a5902429b, user_id=35e66aec64ea46e2a8c5b9bcad8b182f, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:53.530605 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4fd506-b6cc-4a53-9265-6c01d40773a3 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:53.666761 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1363/2680] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:53 2022] PUT /identity/v3/projects/35dbf7afc5dd4d07b279f20a5902429b/users/35e66aec64ea46e2a8c5b9bcad8b182f/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:53.689791 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3d80c-b37a-4666-9b2a-70ac2edf2d56 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:53.690084 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3d80c-b37a-4666-9b2a-70ac2edf2d56 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:53.690366 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3d80c-b37a-4666-9b2a-70ac2edf2d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:53.718631 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-45b3d80c-b37a-4666-9b2a-70ac2edf2d56 None None] MFA Rules not processed for user `35e66aec64ea46e2a8c5b9bcad8b182f`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:53.726623 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-45b3d80c-b37a-4666-9b2a-70ac2edf2d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:53.788329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1318/2681] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:53 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:08:53.792813 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4fd506-b6cc-4a53-9265-6c01d40773a3 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:53.856839 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4fd506-b6cc-4a53-9265-6c01d40773a3 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:53.861642 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381368a1-9844-4c31-a11d-00ad74381eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:53.862316 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381368a1-9844-4c31-a11d-00ad74381eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:53.862644 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381368a1-9844-4c31-a11d-00ad74381eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:53.862927 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381368a1-9844-4c31-a11d-00ad74381eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:53.863636 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381368a1-9844-4c31-a11d-00ad74381eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:53.865647 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381368a1-9844-4c31-a11d-00ad74381eb7 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:53.949663 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1364/2682] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:08:53 2022] POST /identity/v3/projects => generated 409 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:53.954190 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3d80c-b37a-4666-9b2a-70ac2edf2d56 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:53.965674 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3d80c-b37a-4666-9b2a-70ac2edf2d56 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:54.023131 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f69437-2d65-4bbc-ad6e-a24d4ed36402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:54.023814 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f69437-2d65-4bbc-ad6e-a24d4ed36402 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:54.024103 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f69437-2d65-4bbc-ad6e-a24d4ed36402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:54.024376 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f69437-2d65-4bbc-ad6e-a24d4ed36402 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:54.025695 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f69437-2d65-4bbc-ad6e-a24d4ed36402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:54.027619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f69437-2d65-4bbc-ad6e-a24d4ed36402 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:54.137239 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1319/2683] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:08:53 2022] POST /identity/v3/users => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:08:54.141486 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381368a1-9844-4c31-a11d-00ad74381eb7 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:54.151781 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381368a1-9844-4c31-a11d-00ad74381eb7 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:54.156365 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a7595-c763-4697-bcee-4bfe3a083b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:54.157059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a7595-c763-4697-bcee-4bfe3a083b88 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:54.157338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a7595-c763-4697-bcee-4bfe3a083b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:54.157610 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a7595-c763-4697-bcee-4bfe3a083b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:54.158327 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a7595-c763-4697-bcee-4bfe3a083b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:54.159914 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a7595-c763-4697-bcee-4bfe3a083b88 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:54.171696 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1365/2684] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:54.175232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f69437-2d65-4bbc-ad6e-a24d4ed36402 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:54.186071 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f69437-2d65-4bbc-ad6e-a24d4ed36402 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:54.190701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7d329-7558-494d-b0c9-7fb51a8b6533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:54.191577 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7d329-7558-494d-b0c9-7fb51a8b6533 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:54.191866 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7d329-7558-494d-b0c9-7fb51a8b6533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:54.192147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7d329-7558-494d-b0c9-7fb51a8b6533 admin admin] PATH_INFO: `/v3/projects/d9cadf8cf2154ad08e4a7b2d965a4219/users/0c07f4592e3144e2b40dc4ca786e5e66/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:54.208767 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7d329-7558-494d-b0c9-7fb51a8b6533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9cadf8cf2154ad08e4a7b2d965a4219, user_id=0c07f4592e3144e2b40dc4ca786e5e66, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:54.211719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7d329-7558-494d-b0c9-7fb51a8b6533 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:54.214126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:54.326218 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1320/2685] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:54 2022] PUT /identity/v3/projects/d9cadf8cf2154ad08e4a7b2d965a4219/users/0c07f4592e3144e2b40dc4ca786e5e66/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:54.330769 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a7595-c763-4697-bcee-4bfe3a083b88 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:54.340991 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a7595-c763-4697-bcee-4bfe3a083b88 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:54.400935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e43899-a141-48f0-9599-1483a3d62160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:54.401618 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e43899-a141-48f0-9599-1483a3d62160 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:54.401904 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e43899-a141-48f0-9599-1483a3d62160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:54.402181 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e43899-a141-48f0-9599-1483a3d62160 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:54.402996 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e43899-a141-48f0-9599-1483a3d62160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:54.404709 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e43899-a141-48f0-9599-1483a3d62160 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:54.415694 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1366/2686] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:08:54.420010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7d329-7558-494d-b0c9-7fb51a8b6533 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:54.430261 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7d329-7558-494d-b0c9-7fb51a8b6533 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:54.435619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570863e-3304-4f8e-b908-231134ec7ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:54.436497 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570863e-3304-4f8e-b908-231134ec7ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:54.436816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570863e-3304-4f8e-b908-231134ec7ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:54.437094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570863e-3304-4f8e-b908-231134ec7ba5 admin admin] PATH_INFO: `/v3/projects/d9cadf8cf2154ad08e4a7b2d965a4219/users/0c07f4592e3144e2b40dc4ca786e5e66/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:54.439263 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570863e-3304-4f8e-b908-231134ec7ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9cadf8cf2154ad08e4a7b2d965a4219, user_id=0c07f4592e3144e2b40dc4ca786e5e66, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:54.442015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570863e-3304-4f8e-b908-231134ec7ba5 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:54.454606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1321/2687] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:08:54 2022] PUT /identity/v3/projects/d9cadf8cf2154ad08e4a7b2d965a4219/users/0c07f4592e3144e2b40dc4ca786e5e66/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:08:54.464963 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dab31-ab77-4035-a4c7-2561ac3f3508 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:54.465256 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dab31-ab77-4035-a4c7-2561ac3f3508 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:54.465535 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dab31-ab77-4035-a4c7-2561ac3f3508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:54.486458 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:08:54.494821 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-905dab31-ab77-4035-a4c7-2561ac3f3508 None None] MFA Rules not processed for user `0c07f4592e3144e2b40dc4ca786e5e66`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:08:54.496175 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-905dab31-ab77-4035-a4c7-2561ac3f3508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:54.570441 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1367/2688] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:08:54 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:08:54.582215 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570863e-3304-4f8e-b908-231134ec7ba5 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:54.583877 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e570863e-3304-4f8e-b908-231134ec7ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:08:54.643327 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570863e-3304-4f8e-b908-231134ec7ba5 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:54.649329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0ca16-3cbd-4622-9a00-31e70779cebf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:54.649329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0ca16-3cbd-4622-9a00-31e70779cebf service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:54.649329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0ca16-3cbd-4622-9a00-31e70779cebf service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:54.649329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0ca16-3cbd-4622-9a00-31e70779cebf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:54.659159 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0ca16-3cbd-4622-9a00-31e70779cebf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:54.660637 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0ca16-3cbd-4622-9a00-31e70779cebf service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:54.672142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1322/2689] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:54 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:08:55.063978 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905dab31-ab77-4035-a4c7-2561ac3f3508 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:08:55.072091 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905dab31-ab77-4035-a4c7-2561ac3f3508 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:08:55.075692 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4fde8-fe4b-44bd-9841-97bb15f5b2ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:08:55.076341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4fde8-fe4b-44bd-9841-97bb15f5b2ee service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:08:55.076649 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4fde8-fe4b-44bd-9841-97bb15f5b2ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:08:55.076928 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4fde8-fe4b-44bd-9841-97bb15f5b2ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:08:55.135586 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4fde8-fe4b-44bd-9841-97bb15f5b2ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:08:55.137334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4fde8-fe4b-44bd-9841-97bb15f5b2ee service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:08:55.147204 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1368/2690] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:08:55 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:04.667345 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:INSERT=2,keystone:SELECT=33 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:05.142579 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=57 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:05.286197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0ca16-3cbd-4622-9a00-31e70779cebf service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:05.346776 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0ca16-3cbd-4622-9a00-31e70779cebf service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:05.351147 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef47a9-8dac-4d89-b05f-7047199f24dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:05.352002 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef47a9-8dac-4d89-b05f-7047199f24dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:05.352310 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef47a9-8dac-4d89-b05f-7047199f24dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:05.352611 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef47a9-8dac-4d89-b05f-7047199f24dc admin admin] PATH_INFO: `/v3/users/35e66aec64ea46e2a8c5b9bcad8b182f` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:05.353779 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef47a9-8dac-4d89-b05f-7047199f24dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=35e66aec64ea46e2a8c5b9bcad8b182f)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:05.356667 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef47a9-8dac-4d89-b05f-7047199f24dc admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:05.555175 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-dfef47a9-8dac-4d89-b05f-7047199f24dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35e66aec64ea46e2a8c5b9bcad8b182f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:05.562747 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-dfef47a9-8dac-4d89-b05f-7047199f24dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35e66aec64ea46e2a8c5b9bcad8b182f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:05.563416 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-dfef47a9-8dac-4d89-b05f-7047199f24dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35e66aec64ea46e2a8c5b9bcad8b182f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:05.564112 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-dfef47a9-8dac-4d89-b05f-7047199f24dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35e66aec64ea46e2a8c5b9bcad8b182f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:05.576351 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-dfef47a9-8dac-4d89-b05f-7047199f24dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35e66aec64ea46e2a8c5b9bcad8b182f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:05.661026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1323/2691] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:09:05 2022] DELETE /identity/v3/users/35e66aec64ea46e2a8c5b9bcad8b182f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:05.665559 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c654a65-d9ac-43f6-82ff-00f064378ea9 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:05.665849 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c654a65-d9ac-43f6-82ff-00f064378ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:05.666127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c654a65-d9ac-43f6-82ff-00f064378ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:05.683278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-6c654a65-d9ac-43f6-82ff-00f064378ea9 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:05.684483 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6c654a65-d9ac-43f6-82ff-00f064378ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:05.745026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1369/2692] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:05.754703 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef47a9-8dac-4d89-b05f-7047199f24dc admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:05.756126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-dfef47a9-8dac-4d89-b05f-7047199f24dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:05.813859 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef47a9-8dac-4d89-b05f-7047199f24dc admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:05.817834 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cd46c-8b90-4fb5-8151-51944526fe2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:05.818481 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cd46c-8b90-4fb5-8151-51944526fe2e service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:05.818764 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cd46c-8b90-4fb5-8151-51944526fe2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:05.819060 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cd46c-8b90-4fb5-8151-51944526fe2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:05.829073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65cd46c-8b90-4fb5-8151-51944526fe2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:05.830507 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65cd46c-8b90-4fb5-8151-51944526fe2e service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:05.840747 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1324/2693] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:06.249304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c654a65-d9ac-43f6-82ff-00f064378ea9 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:06.250731 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6c654a65-d9ac-43f6-82ff-00f064378ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:06.263999 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c654a65-d9ac-43f6-82ff-00f064378ea9 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:06.269321 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49deff93-6054-4466-b8f6-43912f1fef99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:06.274338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49deff93-6054-4466-b8f6-43912f1fef99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:06.274338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49deff93-6054-4466-b8f6-43912f1fef99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:06.274338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49deff93-6054-4466-b8f6-43912f1fef99 admin admin] PATH_INFO: `/v3/projects/35dbf7afc5dd4d07b279f20a5902429b` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:06.274338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49deff93-6054-4466-b8f6-43912f1fef99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35dbf7afc5dd4d07b279f20a5902429b)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:06.274338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49deff93-6054-4466-b8f6-43912f1fef99 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:06.403972 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-49deff93-6054-4466-b8f6-43912f1fef99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35dbf7afc5dd4d07b279f20a5902429b', 'request_id': 'req-49deff93-6054-4466-b8f6-43912f1fef99'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:06.409639 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-49deff93-6054-4466-b8f6-43912f1fef99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35dbf7afc5dd4d07b279f20a5902429b', 'request_id': 'req-49deff93-6054-4466-b8f6-43912f1fef99'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:06.415954 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-49deff93-6054-4466-b8f6-43912f1fef99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35dbf7afc5dd4d07b279f20a5902429b', 'request_id': 'req-49deff93-6054-4466-b8f6-43912f1fef99'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:06.489121 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-49deff93-6054-4466-b8f6-43912f1fef99 admin admin] The token cache is being invalidate because project 35dbf7afc5dd4d07b279f20a5902429b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:09:06.489350 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-49deff93-6054-4466-b8f6-43912f1fef99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:06.489978 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-49deff93-6054-4466-b8f6-43912f1fef99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:06.491578 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1370/2694] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:09:06 2022] DELETE /identity/v3/projects/35dbf7afc5dd4d07b279f20a5902429b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:06.495805 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cd46c-8b90-4fb5-8151-51944526fe2e service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:06.505991 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cd46c-8b90-4fb5-8151-51944526fe2e service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:06.523664 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:06.564433 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf1397-a6c1-45e6-9824-9fa9f8ede746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:06.565396 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf1397-a6c1-45e6-9824-9fa9f8ede746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:06.565742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf1397-a6c1-45e6-9824-9fa9f8ede746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:06.566071 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf1397-a6c1-45e6-9824-9fa9f8ede746 admin admin] PATH_INFO: `/v3/users/0c07f4592e3144e2b40dc4ca786e5e66` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:06.567326 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf1397-a6c1-45e6-9824-9fa9f8ede746 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c07f4592e3144e2b40dc4ca786e5e66)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:06.569489 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf1397-a6c1-45e6-9824-9fa9f8ede746 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:06.806515 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-cbbf1397-a6c1-45e6-9824-9fa9f8ede746 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c07f4592e3144e2b40dc4ca786e5e66'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:06.813159 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-cbbf1397-a6c1-45e6-9824-9fa9f8ede746 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c07f4592e3144e2b40dc4ca786e5e66'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:06.813826 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-cbbf1397-a6c1-45e6-9824-9fa9f8ede746 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c07f4592e3144e2b40dc4ca786e5e66'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:06.814433 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-cbbf1397-a6c1-45e6-9824-9fa9f8ede746 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c07f4592e3144e2b40dc4ca786e5e66'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:06.825774 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-cbbf1397-a6c1-45e6-9824-9fa9f8ede746 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c07f4592e3144e2b40dc4ca786e5e66'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:06.936047 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1325/2695] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:09:06 2022] DELETE /identity/v3/users/0c07f4592e3144e2b40dc4ca786e5e66 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:07.617147 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49deff93-6054-4466-b8f6-43912f1fef99 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:07.618652 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-49deff93-6054-4466-b8f6-43912f1fef99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:07.632661 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49deff93-6054-4466-b8f6-43912f1fef99 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:07.693588 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ece74-9b25-4343-8d88-11704f5313bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:07.697490 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ece74-9b25-4343-8d88-11704f5313bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:07.697490 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ece74-9b25-4343-8d88-11704f5313bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:07.697490 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ece74-9b25-4343-8d88-11704f5313bb admin admin] PATH_INFO: `/v3/projects/d9cadf8cf2154ad08e4a7b2d965a4219` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:07.697490 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ece74-9b25-4343-8d88-11704f5313bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9cadf8cf2154ad08e4a7b2d965a4219)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:07.698538 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ece74-9b25-4343-8d88-11704f5313bb admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:07.828738 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:07.846151 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-340ece74-9b25-4343-8d88-11704f5313bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9cadf8cf2154ad08e4a7b2d965a4219', 'request_id': 'req-340ece74-9b25-4343-8d88-11704f5313bb'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:07.851607 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-340ece74-9b25-4343-8d88-11704f5313bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9cadf8cf2154ad08e4a7b2d965a4219', 'request_id': 'req-340ece74-9b25-4343-8d88-11704f5313bb'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:07.858965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-340ece74-9b25-4343-8d88-11704f5313bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9cadf8cf2154ad08e4a7b2d965a4219', 'request_id': 'req-340ece74-9b25-4343-8d88-11704f5313bb'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:07.957289 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-340ece74-9b25-4343-8d88-11704f5313bb admin admin] The token cache is being invalidate because project d9cadf8cf2154ad08e4a7b2d965a4219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:09:07.957507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-340ece74-9b25-4343-8d88-11704f5313bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:07.958119 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-340ece74-9b25-4343-8d88-11704f5313bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:07.959673 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1371/2696] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:09:07 2022] DELETE /identity/v3/projects/d9cadf8cf2154ad08e4a7b2d965a4219 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:07.964869 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755181f-b474-48ee-ba56-dc0e23935a00 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:07.966333 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755181f-b474-48ee-ba56-dc0e23935a00 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:07.966623 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755181f-b474-48ee-ba56-dc0e23935a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:07.985336 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-7755181f-b474-48ee-ba56-dc0e23935a00 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:07.986594 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7755181f-b474-48ee-ba56-dc0e23935a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:08.047511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1326/2697] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:08.056417 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303e0b6-3955-4f40-8044-e0efca9caee0 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:08.056734 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303e0b6-3955-4f40-8044-e0efca9caee0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:08.057018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303e0b6-3955-4f40-8044-e0efca9caee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:08.076405 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-f303e0b6-3955-4f40-8044-e0efca9caee0 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:08.077804 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f303e0b6-3955-4f40-8044-e0efca9caee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:08.086079 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1372/2698] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:08.090408 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755181f-b474-48ee-ba56-dc0e23935a00 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:08.101331 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755181f-b474-48ee-ba56-dc0e23935a00 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:08.106258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc8f7b-ebab-4da2-a44b-813b1202b5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:08.106949 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc8f7b-ebab-4da2-a44b-813b1202b5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:08.107236 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc8f7b-ebab-4da2-a44b-813b1202b5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:08.107514 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc8f7b-ebab-4da2-a44b-813b1202b5e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:08.108279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc8f7b-ebab-4da2-a44b-813b1202b5e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:09:08.108609 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc8f7b-ebab-4da2-a44b-813b1202b5e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:08.110223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc8f7b-ebab-4da2-a44b-813b1202b5e3 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:08.122218 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1327/2699] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:09:08.126480 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303e0b6-3955-4f40-8044-e0efca9caee0 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:08.136245 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303e0b6-3955-4f40-8044-e0efca9caee0 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:08.141574 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d56d5-15c9-4c3b-aea2-9896b0974755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:08.144965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d56d5-15c9-4c3b-aea2-9896b0974755 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:08.144965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d56d5-15c9-4c3b-aea2-9896b0974755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:08.144965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d56d5-15c9-4c3b-aea2-9896b0974755 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:08.144965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d56d5-15c9-4c3b-aea2-9896b0974755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:08.145444 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d56d5-15c9-4c3b-aea2-9896b0974755 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:08.256980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1373/2700] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:09:08 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:09:08.261509 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc8f7b-ebab-4da2-a44b-813b1202b5e3 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:08.272424 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc8f7b-ebab-4da2-a44b-813b1202b5e3 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:08.298855 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:08.330496 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9341e57-e245-431d-831e-fdbc576ba2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:08.331173 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9341e57-e245-431d-831e-fdbc576ba2dc admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:08.331461 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9341e57-e245-431d-831e-fdbc576ba2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:08.331742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9341e57-e245-431d-831e-fdbc576ba2dc admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:08.332657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9341e57-e245-431d-831e-fdbc576ba2dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:08.334604 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9341e57-e245-431d-831e-fdbc576ba2dc admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:08.438639 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1328/2701] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:09:08 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:09:08.442710 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d56d5-15c9-4c3b-aea2-9896b0974755 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:08.453534 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d56d5-15c9-4c3b-aea2-9896b0974755 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:08.458312 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e4161-2745-4d61-b968-adbb6e113a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:08.458978 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e4161-2745-4d61-b968-adbb6e113a1a admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:08.459262 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e4161-2745-4d61-b968-adbb6e113a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:08.459538 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e4161-2745-4d61-b968-adbb6e113a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:08.460265 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e4161-2745-4d61-b968-adbb6e113a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:08.461925 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e4161-2745-4d61-b968-adbb6e113a1a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:08.472677 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1374/2702] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:08.478530 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9341e57-e245-431d-831e-fdbc576ba2dc admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:08.488776 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9341e57-e245-431d-831e-fdbc576ba2dc admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:08.493398 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24283f4f-5c23-4c60-89bf-b7dd4b75cd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:08.494038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24283f4f-5c23-4c60-89bf-b7dd4b75cd12 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:08.494521 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24283f4f-5c23-4c60-89bf-b7dd4b75cd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:08.494958 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24283f4f-5c23-4c60-89bf-b7dd4b75cd12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:08.496024 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24283f4f-5c23-4c60-89bf-b7dd4b75cd12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:08.498183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24283f4f-5c23-4c60-89bf-b7dd4b75cd12 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:08.508189 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1329/2703] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:08.511762 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e4161-2745-4d61-b968-adbb6e113a1a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:08.522254 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e4161-2745-4d61-b968-adbb6e113a1a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:08.526872 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cea44-0b5f-4c6b-90c3-e1bbc737168e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:08.527742 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cea44-0b5f-4c6b-90c3-e1bbc737168e admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:08.528022 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cea44-0b5f-4c6b-90c3-e1bbc737168e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:08.528304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cea44-0b5f-4c6b-90c3-e1bbc737168e admin admin] PATH_INFO: `/v3/projects/80d399e4a90c42cf84c7ed9a259e6ae1/users/bcc0851f8a5d4905b73a267690aa084c/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:08.542511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cea44-0b5f-4c6b-90c3-e1bbc737168e admin admin] RBAC: Authorizing `identity:create_grant(project_id=80d399e4a90c42cf84c7ed9a259e6ae1, user_id=bcc0851f8a5d4905b73a267690aa084c, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:08.545206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cea44-0b5f-4c6b-90c3-e1bbc737168e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:08.672766 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1375/2704] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:09:08 2022] PUT /identity/v3/projects/80d399e4a90c42cf84c7ed9a259e6ae1/users/bcc0851f8a5d4905b73a267690aa084c/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:08.682959 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e1e75-c11b-4092-a154-f582f13c938e None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:08.683249 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e1e75-c11b-4092-a154-f582f13c938e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:08.683527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e1e75-c11b-4092-a154-f582f13c938e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:08.709971 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b55e1e75-c11b-4092-a154-f582f13c938e None None] MFA Rules not processed for user `bcc0851f8a5d4905b73a267690aa084c`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:08.711196 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b55e1e75-c11b-4092-a154-f582f13c938e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:08.775976 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1330/2705] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:09:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:09:08.780418 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cea44-0b5f-4c6b-90c3-e1bbc737168e admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:08.840779 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cea44-0b5f-4c6b-90c3-e1bbc737168e admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:08.845350 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fb0b8-45e6-45c4-81d6-ca2bc33661da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:08.846001 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fb0b8-45e6-45c4-81d6-ca2bc33661da admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:08.846285 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fb0b8-45e6-45c4-81d6-ca2bc33661da admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:08.846564 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fb0b8-45e6-45c4-81d6-ca2bc33661da admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:08.847253 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54fb0b8-45e6-45c4-81d6-ca2bc33661da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:08.849221 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54fb0b8-45e6-45c4-81d6-ca2bc33661da admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:08.931667 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1376/2706] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:09:08 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:09:08.935965 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e1e75-c11b-4092-a154-f582f13c938e None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:08.946730 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e1e75-c11b-4092-a154-f582f13c938e None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:09.002350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bf46a-1b15-44c7-bd45-4f905c90e92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:09.003033 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bf46a-1b15-44c7-bd45-4f905c90e92b admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:09.003284 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bf46a-1b15-44c7-bd45-4f905c90e92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:09.003560 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bf46a-1b15-44c7-bd45-4f905c90e92b admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:09.004255 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8bf46a-1b15-44c7-bd45-4f905c90e92b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:09.006220 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8bf46a-1b15-44c7-bd45-4f905c90e92b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:09.101850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1331/2707] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:09:08 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:09:09.105546 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fb0b8-45e6-45c4-81d6-ca2bc33661da admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:09.116842 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fb0b8-45e6-45c4-81d6-ca2bc33661da admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:09.121445 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1da8ab-99ee-47f2-b877-2b93785f6da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:09.122103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1da8ab-99ee-47f2-b877-2b93785f6da8 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:09.122390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1da8ab-99ee-47f2-b877-2b93785f6da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:09.122671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1da8ab-99ee-47f2-b877-2b93785f6da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:09.123398 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1da8ab-99ee-47f2-b877-2b93785f6da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:09.125063 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1da8ab-99ee-47f2-b877-2b93785f6da8 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:09.135476 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1377/2708] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:09.139442 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bf46a-1b15-44c7-bd45-4f905c90e92b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:09.149277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bf46a-1b15-44c7-bd45-4f905c90e92b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:09.154381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f735267-036e-40a2-9f2d-27bcd62198ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:09.155249 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f735267-036e-40a2-9f2d-27bcd62198ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:09.155529 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f735267-036e-40a2-9f2d-27bcd62198ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:09.155805 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f735267-036e-40a2-9f2d-27bcd62198ac admin admin] PATH_INFO: `/v3/projects/463aee67b86846f98808c733eb0f37ef/users/75fade5e765949148664aeeb365aa598/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:09.170606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f735267-036e-40a2-9f2d-27bcd62198ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=463aee67b86846f98808c733eb0f37ef, user_id=75fade5e765949148664aeeb365aa598, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:09.173283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f735267-036e-40a2-9f2d-27bcd62198ac admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:09.289361 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1332/2709] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:09:09 2022] PUT /identity/v3/projects/463aee67b86846f98808c733eb0f37ef/users/75fade5e765949148664aeeb365aa598/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:09.293285 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1da8ab-99ee-47f2-b877-2b93785f6da8 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:09.303875 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1da8ab-99ee-47f2-b877-2b93785f6da8 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:09.323388 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:09.361782 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5058bd-278a-4dbc-9ce5-25f86844e02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:09.362643 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5058bd-278a-4dbc-9ce5-25f86844e02c admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:09.362928 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5058bd-278a-4dbc-9ce5-25f86844e02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:09.363207 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5058bd-278a-4dbc-9ce5-25f86844e02c admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:09.363923 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5058bd-278a-4dbc-9ce5-25f86844e02c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:09.365578 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5058bd-278a-4dbc-9ce5-25f86844e02c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:09.376981 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1378/2710] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:09.381206 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f735267-036e-40a2-9f2d-27bcd62198ac admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:09.388905 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:09.392945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f735267-036e-40a2-9f2d-27bcd62198ac admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:09.397841 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce271e-46ba-4d6e-a7e6-e2e69fd2e966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:09.398714 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce271e-46ba-4d6e-a7e6-e2e69fd2e966 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:09.398998 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce271e-46ba-4d6e-a7e6-e2e69fd2e966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:09.399305 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce271e-46ba-4d6e-a7e6-e2e69fd2e966 admin admin] PATH_INFO: `/v3/projects/463aee67b86846f98808c733eb0f37ef/users/75fade5e765949148664aeeb365aa598/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:09.401241 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce271e-46ba-4d6e-a7e6-e2e69fd2e966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=463aee67b86846f98808c733eb0f37ef, user_id=75fade5e765949148664aeeb365aa598, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:09.404619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce271e-46ba-4d6e-a7e6-e2e69fd2e966 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:09.419590 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1333/2711] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:09:09 2022] PUT /identity/v3/projects/463aee67b86846f98808c733eb0f37ef/users/75fade5e765949148664aeeb365aa598/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:09:09.425427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bd487-75f6-4dd6-8044-3fbb86849fef None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:09.425721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bd487-75f6-4dd6-8044-3fbb86849fef None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:09.426003 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bd487-75f6-4dd6-8044-3fbb86849fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:09.451980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-4b8bd487-75f6-4dd6-8044-3fbb86849fef None None] MFA Rules not processed for user `75fade5e765949148664aeeb365aa598`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:09.453270 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4b8bd487-75f6-4dd6-8044-3fbb86849fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:09.520422 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1379/2712] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:09:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:09.532232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce271e-46ba-4d6e-a7e6-e2e69fd2e966 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:09.533895 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d3ce271e-46ba-4d6e-a7e6-e2e69fd2e966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:09.589611 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce271e-46ba-4d6e-a7e6-e2e69fd2e966 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:09.593693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997692aa-9bb2-486a-93ac-fcc13d1e0fb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:09.594334 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997692aa-9bb2-486a-93ac-fcc13d1e0fb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:09.594618 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997692aa-9bb2-486a-93ac-fcc13d1e0fb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:09.594898 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997692aa-9bb2-486a-93ac-fcc13d1e0fb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:09.603709 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997692aa-9bb2-486a-93ac-fcc13d1e0fb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:09.605171 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997692aa-9bb2-486a-93ac-fcc13d1e0fb6 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:09.614773 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1334/2713] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:09.771708 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bd487-75f6-4dd6-8044-3fbb86849fef None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:09.781418 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bd487-75f6-4dd6-8044-3fbb86849fef None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:09.784978 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3753beb-d568-4128-a9be-280ba057ec13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:09.785633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3753beb-d568-4128-a9be-280ba057ec13 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:09.785919 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3753beb-d568-4128-a9be-280ba057ec13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:09.786198 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3753beb-d568-4128-a9be-280ba057ec13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:09.843453 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3753beb-d568-4128-a9be-280ba057ec13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:09.845701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3753beb-d568-4128-a9be-280ba057ec13 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:09.856843 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1380/2714] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:10.338929 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997692aa-9bb2-486a-93ac-fcc13d1e0fb6 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:10.400574 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997692aa-9bb2-486a-93ac-fcc13d1e0fb6 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:10.405108 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd6889-e73b-46ff-996b-94bb078ea664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:10.405974 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd6889-e73b-46ff-996b-94bb078ea664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:10.406258 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd6889-e73b-46ff-996b-94bb078ea664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:10.406536 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd6889-e73b-46ff-996b-94bb078ea664 admin admin] PATH_INFO: `/v3/users/bcc0851f8a5d4905b73a267690aa084c` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:10.407705 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd6889-e73b-46ff-996b-94bb078ea664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc0851f8a5d4905b73a267690aa084c)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:10.409761 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd6889-e73b-46ff-996b-94bb078ea664 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:10.604355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a4fd6889-e73b-46ff-996b-94bb078ea664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc0851f8a5d4905b73a267690aa084c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:10.612146 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a4fd6889-e73b-46ff-996b-94bb078ea664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc0851f8a5d4905b73a267690aa084c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:10.612850 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a4fd6889-e73b-46ff-996b-94bb078ea664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc0851f8a5d4905b73a267690aa084c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:10.613468 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a4fd6889-e73b-46ff-996b-94bb078ea664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc0851f8a5d4905b73a267690aa084c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:10.625406 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a4fd6889-e73b-46ff-996b-94bb078ea664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc0851f8a5d4905b73a267690aa084c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:10.735789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1335/2715] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:09:10 2022] DELETE /identity/v3/users/bcc0851f8a5d4905b73a267690aa084c => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:10.740229 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1b7ac-a882-4ecc-b4ec-1f23367f9770 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:10.740518 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1b7ac-a882-4ecc-b4ec-1f23367f9770 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:10.740838 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1b7ac-a882-4ecc-b4ec-1f23367f9770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:10.757862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-e9d1b7ac-a882-4ecc-b4ec-1f23367f9770 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:10.759182 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e9d1b7ac-a882-4ecc-b4ec-1f23367f9770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:10.798489 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:10.816559 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1381/2716] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:10.829091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd6889-e73b-46ff-996b-94bb078ea664 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:10.829091 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a4fd6889-e73b-46ff-996b-94bb078ea664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:10.841704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:10.885029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd6889-e73b-46ff-996b-94bb078ea664 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:10.889411 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe39786-48b0-4689-87ee-f76d62141cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:10.890407 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe39786-48b0-4689-87ee-f76d62141cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:10.890738 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe39786-48b0-4689-87ee-f76d62141cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:10.891013 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe39786-48b0-4689-87ee-f76d62141cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:10.899794 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe39786-48b0-4689-87ee-f76d62141cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:10.901260 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe39786-48b0-4689-87ee-f76d62141cc2 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:10.911677 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1336/2717] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:11.353488 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1b7ac-a882-4ecc-b4ec-1f23367f9770 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:11.354995 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e9d1b7ac-a882-4ecc-b4ec-1f23367f9770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:11.368232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1b7ac-a882-4ecc-b4ec-1f23367f9770 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:11.373887 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04765b3-0d48-4770-b02d-f1ee7922deb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:11.374748 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04765b3-0d48-4770-b02d-f1ee7922deb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:11.375026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04765b3-0d48-4770-b02d-f1ee7922deb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:11.375299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04765b3-0d48-4770-b02d-f1ee7922deb4 admin admin] PATH_INFO: `/v3/projects/80d399e4a90c42cf84c7ed9a259e6ae1` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:11.376543 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04765b3-0d48-4770-b02d-f1ee7922deb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80d399e4a90c42cf84c7ed9a259e6ae1)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:11.378413 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04765b3-0d48-4770-b02d-f1ee7922deb4 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:11.515057 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d04765b3-0d48-4770-b02d-f1ee7922deb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80d399e4a90c42cf84c7ed9a259e6ae1', 'request_id': 'req-d04765b3-0d48-4770-b02d-f1ee7922deb4'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:11.520917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d04765b3-0d48-4770-b02d-f1ee7922deb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80d399e4a90c42cf84c7ed9a259e6ae1', 'request_id': 'req-d04765b3-0d48-4770-b02d-f1ee7922deb4'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:11.527360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d04765b3-0d48-4770-b02d-f1ee7922deb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80d399e4a90c42cf84c7ed9a259e6ae1', 'request_id': 'req-d04765b3-0d48-4770-b02d-f1ee7922deb4'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:11.603626 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d04765b3-0d48-4770-b02d-f1ee7922deb4 admin admin] The token cache is being invalidate because project 80d399e4a90c42cf84c7ed9a259e6ae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:09:11.603879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d04765b3-0d48-4770-b02d-f1ee7922deb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:11.604510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d04765b3-0d48-4770-b02d-f1ee7922deb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:11.606901 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1382/2718] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:09:11 2022] DELETE /identity/v3/projects/80d399e4a90c42cf84c7ed9a259e6ae1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:11.610902 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe39786-48b0-4689-87ee-f76d62141cc2 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:11.620765 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe39786-48b0-4689-87ee-f76d62141cc2 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:11.677991 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f28d67-a2f1-40cc-8914-54d90a2ff082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:11.678917 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f28d67-a2f1-40cc-8914-54d90a2ff082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:11.679145 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f28d67-a2f1-40cc-8914-54d90a2ff082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:11.679423 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f28d67-a2f1-40cc-8914-54d90a2ff082 admin admin] PATH_INFO: `/v3/users/75fade5e765949148664aeeb365aa598` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:11.680637 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f28d67-a2f1-40cc-8914-54d90a2ff082 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75fade5e765949148664aeeb365aa598)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:11.682571 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f28d67-a2f1-40cc-8914-54d90a2ff082 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:11.890794 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d8f28d67-a2f1-40cc-8914-54d90a2ff082 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75fade5e765949148664aeeb365aa598'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:11.898280 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d8f28d67-a2f1-40cc-8914-54d90a2ff082 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75fade5e765949148664aeeb365aa598'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:11.899025 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d8f28d67-a2f1-40cc-8914-54d90a2ff082 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75fade5e765949148664aeeb365aa598'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:11.899633 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d8f28d67-a2f1-40cc-8914-54d90a2ff082 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75fade5e765949148664aeeb365aa598'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:11.912698 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d8f28d67-a2f1-40cc-8914-54d90a2ff082 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75fade5e765949148664aeeb365aa598'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:12.002843 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1337/2719] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:09:11 2022] DELETE /identity/v3/users/75fade5e765949148664aeeb365aa598 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:12.598322 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04765b3-0d48-4770-b02d-f1ee7922deb4 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:12.599806 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d04765b3-0d48-4770-b02d-f1ee7922deb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:12.614992 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04765b3-0d48-4770-b02d-f1ee7922deb4 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:12.672533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927772fc-c289-42cc-88b1-5bcc406af9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:12.673431 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927772fc-c289-42cc-88b1-5bcc406af9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:12.673716 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927772fc-c289-42cc-88b1-5bcc406af9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:12.673994 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927772fc-c289-42cc-88b1-5bcc406af9fd admin admin] PATH_INFO: `/v3/projects/463aee67b86846f98808c733eb0f37ef` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:12.675206 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927772fc-c289-42cc-88b1-5bcc406af9fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=463aee67b86846f98808c733eb0f37ef)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:12.677351 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927772fc-c289-42cc-88b1-5bcc406af9fd admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:12.798078 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-927772fc-c289-42cc-88b1-5bcc406af9fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '463aee67b86846f98808c733eb0f37ef', 'request_id': 'req-927772fc-c289-42cc-88b1-5bcc406af9fd'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:12.803469 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-927772fc-c289-42cc-88b1-5bcc406af9fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '463aee67b86846f98808c733eb0f37ef', 'request_id': 'req-927772fc-c289-42cc-88b1-5bcc406af9fd'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:12.810053 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-927772fc-c289-42cc-88b1-5bcc406af9fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '463aee67b86846f98808c733eb0f37ef', 'request_id': 'req-927772fc-c289-42cc-88b1-5bcc406af9fd'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:12.888969 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:12.893599 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-927772fc-c289-42cc-88b1-5bcc406af9fd admin admin] The token cache is being invalidate because project 463aee67b86846f98808c733eb0f37ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:09:12.893887 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-927772fc-c289-42cc-88b1-5bcc406af9fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:12.894507 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-927772fc-c289-42cc-88b1-5bcc406af9fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:12.896028 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1383/2720] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:09:12 2022] DELETE /identity/v3/projects/463aee67b86846f98808c733eb0f37ef => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:12.901675 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705e09c-b0e0-4f78-ad96-be09e2ff3b6e None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:12.902144 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705e09c-b0e0-4f78-ad96-be09e2ff3b6e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:12.902264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705e09c-b0e0-4f78-ad96-be09e2ff3b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:12.919341 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c705e09c-b0e0-4f78-ad96-be09e2ff3b6e None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:12.920688 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c705e09c-b0e0-4f78-ad96-be09e2ff3b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:12.952487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:12.982496 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1338/2721] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:12.991363 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6394b3d-4560-49ae-93b2-26fd4807948b None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:12.991657 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6394b3d-4560-49ae-93b2-26fd4807948b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:12.991943 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6394b3d-4560-49ae-93b2-26fd4807948b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:13.011778 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a6394b3d-4560-49ae-93b2-26fd4807948b None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:13.016666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a6394b3d-4560-49ae-93b2-26fd4807948b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:13.021620 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1384/2722] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:13.025893 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705e09c-b0e0-4f78-ad96-be09e2ff3b6e None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:13.035655 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705e09c-b0e0-4f78-ad96-be09e2ff3b6e None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:13.040398 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abfd3d-ed46-4fca-bb60-c9c4b8840015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:13.041081 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abfd3d-ed46-4fca-bb60-c9c4b8840015 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:13.041373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abfd3d-ed46-4fca-bb60-c9c4b8840015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:13.041654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abfd3d-ed46-4fca-bb60-c9c4b8840015 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:13.042383 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abfd3d-ed46-4fca-bb60-c9c4b8840015 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:09:13.043026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abfd3d-ed46-4fca-bb60-c9c4b8840015 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:13.044703 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abfd3d-ed46-4fca-bb60-c9c4b8840015 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:13.059546 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1339/2723] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:09:13.062835 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6394b3d-4560-49ae-93b2-26fd4807948b None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:13.072600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6394b3d-4560-49ae-93b2-26fd4807948b None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:13.078078 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63d959-4231-4f56-a8ff-fa3ad4ccbfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:13.078734 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63d959-4231-4f56-a8ff-fa3ad4ccbfc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:13.079019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63d959-4231-4f56-a8ff-fa3ad4ccbfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:13.079299 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63d959-4231-4f56-a8ff-fa3ad4ccbfc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:13.080000 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63d959-4231-4f56-a8ff-fa3ad4ccbfc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:13.082027 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63d959-4231-4f56-a8ff-fa3ad4ccbfc1 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:13.182737 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1385/2724] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:09:13 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:09:13.186884 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abfd3d-ed46-4fca-bb60-c9c4b8840015 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:13.196915 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abfd3d-ed46-4fca-bb60-c9c4b8840015 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:13.257617 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576da273-7b3c-496a-884b-1aa4ed009e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:13.258294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576da273-7b3c-496a-884b-1aa4ed009e1e admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:13.258686 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576da273-7b3c-496a-884b-1aa4ed009e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:13.258987 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576da273-7b3c-496a-884b-1aa4ed009e1e admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:13.259697 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576da273-7b3c-496a-884b-1aa4ed009e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:13.261679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576da273-7b3c-496a-884b-1aa4ed009e1e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:13.409956 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1340/2725] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:09:13 2022] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:09:13.414196 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63d959-4231-4f56-a8ff-fa3ad4ccbfc1 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:13.425196 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63d959-4231-4f56-a8ff-fa3ad4ccbfc1 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:13.429765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e8626-302d-4824-a957-7a1ef58d46f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:13.430419 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e8626-302d-4824-a957-7a1ef58d46f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:13.430700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e8626-302d-4824-a957-7a1ef58d46f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:13.430974 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e8626-302d-4824-a957-7a1ef58d46f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:13.431696 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e8626-302d-4824-a957-7a1ef58d46f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:13.433342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e8626-302d-4824-a957-7a1ef58d46f2 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:13.444294 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1386/2726] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:13.448246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576da273-7b3c-496a-884b-1aa4ed009e1e admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:13.460230 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576da273-7b3c-496a-884b-1aa4ed009e1e admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:13.464951 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f450e-cfe0-4d2f-a6d9-dd899f12975c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:13.465638 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f450e-cfe0-4d2f-a6d9-dd899f12975c admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:13.465938 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f450e-cfe0-4d2f-a6d9-dd899f12975c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:13.466223 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f450e-cfe0-4d2f-a6d9-dd899f12975c admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:13.466952 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f450e-cfe0-4d2f-a6d9-dd899f12975c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:13.468609 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f450e-cfe0-4d2f-a6d9-dd899f12975c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:13.478496 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1341/2727] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:13.483272 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e8626-302d-4824-a957-7a1ef58d46f2 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:13.493230 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e8626-302d-4824-a957-7a1ef58d46f2 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:13.498257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76998b88-cbff-4d1d-8d1d-59f62445faa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:13.499137 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76998b88-cbff-4d1d-8d1d-59f62445faa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:13.499423 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76998b88-cbff-4d1d-8d1d-59f62445faa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:13.499703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76998b88-cbff-4d1d-8d1d-59f62445faa9 admin admin] PATH_INFO: `/v3/projects/367ca3a05f5f40a28cb931542557d390/users/0e32c562d88e427ab9f987d5c17d996f/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:13.514129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76998b88-cbff-4d1d-8d1d-59f62445faa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=367ca3a05f5f40a28cb931542557d390, user_id=0e32c562d88e427ab9f987d5c17d996f, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:13.516815 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76998b88-cbff-4d1d-8d1d-59f62445faa9 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:13.626963 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1387/2728] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:09:13 2022] PUT /identity/v3/projects/367ca3a05f5f40a28cb931542557d390/users/0e32c562d88e427ab9f987d5c17d996f/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:13.637037 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b733b-b079-4738-876e-b730f762f389 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:13.637334 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b733b-b079-4738-876e-b730f762f389 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:13.637619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b733b-b079-4738-876e-b730f762f389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:13.666584 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-df5b733b-b079-4738-876e-b730f762f389 None None] MFA Rules not processed for user `0e32c562d88e427ab9f987d5c17d996f`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:13.667753 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-df5b733b-b079-4738-876e-b730f762f389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:13.733411 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1342/2729] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:09:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:13.744298 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76998b88-cbff-4d1d-8d1d-59f62445faa9 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:13.746044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-76998b88-cbff-4d1d-8d1d-59f62445faa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:13.822798 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76998b88-cbff-4d1d-8d1d-59f62445faa9 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:13.826513 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6af1d-0ede-419b-8d13-6f66a0a7e9c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e7c4b0bd50c474996a21b69bde4e227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:13.827161 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6af1d-0ede-419b-8d13-6f66a0a7e9c1 service glance] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:13.827464 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6af1d-0ede-419b-8d13-6f66a0a7e9c1 service glance] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:13.827725 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6af1d-0ede-419b-8d13-6f66a0a7e9c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:13.835977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6af1d-0ede-419b-8d13-6f66a0a7e9c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:13.837455 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6af1d-0ede-419b-8d13-6f66a0a7e9c1 service glance] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:13.847208 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1388/2730] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:23.729567 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:23.843203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=63,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:32.651637 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b733b-b079-4738-876e-b730f762f389 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:32.653133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-df5b733b-b079-4738-876e-b730f762f389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:32.710741 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b733b-b079-4738-876e-b730f762f389 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:32.714679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa490a-38a0-4d5c-bcff-d9c5274b1374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:32.715335 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa490a-38a0-4d5c-bcff-d9c5274b1374 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:32.715623 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa490a-38a0-4d5c-bcff-d9c5274b1374 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:32.715904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa490a-38a0-4d5c-bcff-d9c5274b1374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:32.717700 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-08aa490a-38a0-4d5c-bcff-d9c5274b1374 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:32.776513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa490a-38a0-4d5c-bcff-d9c5274b1374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:32.777984 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa490a-38a0-4d5c-bcff-d9c5274b1374 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:32.787585 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1343/2731] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:37.351363 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6af1d-0ede-419b-8d13-6f66a0a7e9c1 service glance] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:37.418132 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6af1d-0ede-419b-8d13-6f66a0a7e9c1 service glance] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:37.422702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977a300-14fb-4a66-b9f5-654189dbf288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:37.423582 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977a300-14fb-4a66-b9f5-654189dbf288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:37.430092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977a300-14fb-4a66-b9f5-654189dbf288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:37.430092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977a300-14fb-4a66-b9f5-654189dbf288 admin admin] PATH_INFO: `/v3/users/0e32c562d88e427ab9f987d5c17d996f` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:37.430092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c977a300-14fb-4a66-b9f5-654189dbf288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e32c562d88e427ab9f987d5c17d996f)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:37.430092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c977a300-14fb-4a66-b9f5-654189dbf288 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:37.657646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c977a300-14fb-4a66-b9f5-654189dbf288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e32c562d88e427ab9f987d5c17d996f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:37.664775 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c977a300-14fb-4a66-b9f5-654189dbf288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e32c562d88e427ab9f987d5c17d996f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:37.665462 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c977a300-14fb-4a66-b9f5-654189dbf288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e32c562d88e427ab9f987d5c17d996f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:37.666077 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c977a300-14fb-4a66-b9f5-654189dbf288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e32c562d88e427ab9f987d5c17d996f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:37.679876 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c977a300-14fb-4a66-b9f5-654189dbf288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e32c562d88e427ab9f987d5c17d996f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:37.774834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1389/2732] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:09:37 2022] DELETE /identity/v3/users/0e32c562d88e427ab9f987d5c17d996f => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:37.779357 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48ec77-ef1d-42c3-885e-e816d77570ed None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:37.779835 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48ec77-ef1d-42c3-885e-e816d77570ed None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:37.779937 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48ec77-ef1d-42c3-885e-e816d77570ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:37.797228 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-1d48ec77-ef1d-42c3-885e-e816d77570ed None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:37.798426 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1d48ec77-ef1d-42c3-885e-e816d77570ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:37.861655 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1344/2733] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:37.869278 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977a300-14fb-4a66-b9f5-654189dbf288 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:37.870732 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c977a300-14fb-4a66-b9f5-654189dbf288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:37.928703 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977a300-14fb-4a66-b9f5-654189dbf288 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:37.932198 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401afc4-03d4-4014-a69d-d2f216f3640d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:37.932882 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401afc4-03d4-4014-a69d-d2f216f3640d service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:37.933164 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401afc4-03d4-4014-a69d-d2f216f3640d service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:37.933439 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401afc4-03d4-4014-a69d-d2f216f3640d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:37.942862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401afc4-03d4-4014-a69d-d2f216f3640d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:37.944333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401afc4-03d4-4014-a69d-d2f216f3640d service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:37.954065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1390/2734] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:38.374857 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48ec77-ef1d-42c3-885e-e816d77570ed None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:38.384792 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1d48ec77-ef1d-42c3-885e-e816d77570ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:38.392553 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48ec77-ef1d-42c3-885e-e816d77570ed None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:38.397530 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4d059-5e5b-4533-90d2-85c9af7a2eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:38.398471 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4d059-5e5b-4533-90d2-85c9af7a2eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:38.398830 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4d059-5e5b-4533-90d2-85c9af7a2eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:38.399178 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4d059-5e5b-4533-90d2-85c9af7a2eff admin admin] PATH_INFO: `/v3/projects/367ca3a05f5f40a28cb931542557d390` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:38.400496 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4d059-5e5b-4533-90d2-85c9af7a2eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=367ca3a05f5f40a28cb931542557d390)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:38.402529 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4d059-5e5b-4533-90d2-85c9af7a2eff admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:38.538884 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a4d4d059-5e5b-4533-90d2-85c9af7a2eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '367ca3a05f5f40a28cb931542557d390', 'request_id': 'req-a4d4d059-5e5b-4533-90d2-85c9af7a2eff'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:38.540770 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:38.620808 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a4d4d059-5e5b-4533-90d2-85c9af7a2eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '367ca3a05f5f40a28cb931542557d390', 'request_id': 'req-a4d4d059-5e5b-4533-90d2-85c9af7a2eff'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:38.627454 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a4d4d059-5e5b-4533-90d2-85c9af7a2eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '367ca3a05f5f40a28cb931542557d390', 'request_id': 'req-a4d4d059-5e5b-4533-90d2-85c9af7a2eff'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:38.637757 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a4d4d059-5e5b-4533-90d2-85c9af7a2eff admin admin] The token cache is being invalidate because project 367ca3a05f5f40a28cb931542557d390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:09:38.638047 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a4d4d059-5e5b-4533-90d2-85c9af7a2eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:38.638693 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a4d4d059-5e5b-4533-90d2-85c9af7a2eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:38.640379 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1345/2735] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:09:38 2022] DELETE /identity/v3/projects/367ca3a05f5f40a28cb931542557d390 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:38.645309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb7733-e06b-4409-a599-4ffc7ff02bf2 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:38.645843 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb7733-e06b-4409-a599-4ffc7ff02bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:38.645951 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb7733-e06b-4409-a599-4ffc7ff02bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:38.665035 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-61fb7733-e06b-4409-a599-4ffc7ff02bf2 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:38.666405 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-61fb7733-e06b-4409-a599-4ffc7ff02bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:38.686467 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:38.756750 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1391/2736] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:38.762014 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ed830-1fcb-48ef-bf09-6edeaa219e1f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:38.762014 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ed830-1fcb-48ef-bf09-6edeaa219e1f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:38.762014 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ed830-1fcb-48ef-bf09-6edeaa219e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:38.781464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-1f6ed830-1fcb-48ef-bf09-6edeaa219e1f None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:38.782809 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1f6ed830-1fcb-48ef-bf09-6edeaa219e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:38.795284 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1346/2737] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:38.799538 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb7733-e06b-4409-a599-4ffc7ff02bf2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:38.811334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb7733-e06b-4409-a599-4ffc7ff02bf2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:38.820623 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021ea75-f12f-4549-b765-a3ae460fce94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:38.821557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021ea75-f12f-4549-b765-a3ae460fce94 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:38.821897 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021ea75-f12f-4549-b765-a3ae460fce94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:38.822275 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021ea75-f12f-4549-b765-a3ae460fce94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:38.823636 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021ea75-f12f-4549-b765-a3ae460fce94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:09:38.824732 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021ea75-f12f-4549-b765-a3ae460fce94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:38.826020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021ea75-f12f-4549-b765-a3ae460fce94 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:38.843309 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1392/2738] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:09:38.847860 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ed830-1fcb-48ef-bf09-6edeaa219e1f None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:38.858675 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ed830-1fcb-48ef-bf09-6edeaa219e1f None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:38.864877 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286318c-29ee-426c-95d8-53b8da0df6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:38.865621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286318c-29ee-426c-95d8-53b8da0df6bb admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:38.865976 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286318c-29ee-426c-95d8-53b8da0df6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:38.866607 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286318c-29ee-426c-95d8-53b8da0df6bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:38.867093 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286318c-29ee-426c-95d8-53b8da0df6bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:38.869129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286318c-29ee-426c-95d8-53b8da0df6bb admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:38.999051 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1347/2739] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:09:38 2022] POST /identity/v3/projects => generated 371 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:09:39.003293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021ea75-f12f-4549-b765-a3ae460fce94 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:39.013358 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021ea75-f12f-4549-b765-a3ae460fce94 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:39.074968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937ae85-398b-4c4f-8c53-73d01a9adbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:39.075656 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937ae85-398b-4c4f-8c53-73d01a9adbd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:39.076086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937ae85-398b-4c4f-8c53-73d01a9adbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:39.076372 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937ae85-398b-4c4f-8c53-73d01a9adbd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:39.077111 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937ae85-398b-4c4f-8c53-73d01a9adbd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:39.079068 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937ae85-398b-4c4f-8c53-73d01a9adbd6 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:39.157919 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1393/2740] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:09:39 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:09:39.162064 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286318c-29ee-426c-95d8-53b8da0df6bb admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:39.172800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286318c-29ee-426c-95d8-53b8da0df6bb admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:39.178290 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabcee8-ccea-42cc-9445-b0a141542c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:39.178970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabcee8-ccea-42cc-9445-b0a141542c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:39.179256 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabcee8-ccea-42cc-9445-b0a141542c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:39.179533 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabcee8-ccea-42cc-9445-b0a141542c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:39.180298 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabcee8-ccea-42cc-9445-b0a141542c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:39.181945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabcee8-ccea-42cc-9445-b0a141542c16 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:39.198168 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1348/2741] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:39.199487 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937ae85-398b-4c4f-8c53-73d01a9adbd6 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:39.209469 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937ae85-398b-4c4f-8c53-73d01a9adbd6 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:39.214401 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881af287-f399-46fe-8824-685d65fe98f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:39.215259 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881af287-f399-46fe-8824-685d65fe98f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:39.215361 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881af287-f399-46fe-8824-685d65fe98f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:39.215617 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881af287-f399-46fe-8824-685d65fe98f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:39.216347 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881af287-f399-46fe-8824-685d65fe98f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:39.218007 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881af287-f399-46fe-8824-685d65fe98f2 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:39.227999 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1394/2742] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:09:39.232456 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabcee8-ccea-42cc-9445-b0a141542c16 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:39.243107 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabcee8-ccea-42cc-9445-b0a141542c16 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:39.247997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db30c3e-2d41-473b-b388-b643c912fbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:39.248932 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db30c3e-2d41-473b-b388-b643c912fbf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:39.249222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db30c3e-2d41-473b-b388-b643c912fbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:39.249504 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db30c3e-2d41-473b-b388-b643c912fbf5 admin admin] PATH_INFO: `/v3/projects/645bc5b5ebbf4df08de80b726acad16b/users/1c4658acb64346539d79dbfbdd4b81e7/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:39.266723 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db30c3e-2d41-473b-b388-b643c912fbf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=645bc5b5ebbf4df08de80b726acad16b, user_id=1c4658acb64346539d79dbfbdd4b81e7, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:39.272722 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db30c3e-2d41-473b-b388-b643c912fbf5 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:39.274107 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881af287-f399-46fe-8824-685d65fe98f2 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:39.275885 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-881af287-f399-46fe-8824-685d65fe98f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:39.339395 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1349/2743] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:09:39 2022] PUT /identity/v3/projects/645bc5b5ebbf4df08de80b726acad16b/users/1c4658acb64346539d79dbfbdd4b81e7/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:09:39.349521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881af287-f399-46fe-8824-685d65fe98f2 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:39.383312 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:39.410229 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2185a-8279-4ec4-9f0f-f0b44f6a16d6 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:39.410445 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2185a-8279-4ec4-9f0f-f0b44f6a16d6 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:39.410701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2185a-8279-4ec4-9f0f-f0b44f6a16d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:39.416270 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f2449-2ba5-4c62-933d-7d62020db5cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43b85b5c7b1e4d73b29fb96f4fa6db71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:39.416991 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f2449-2ba5-4c62-933d-7d62020db5cf service placement] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:39.417235 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f2449-2ba5-4c62-933d-7d62020db5cf service placement] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:39.417508 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f2449-2ba5-4c62-933d-7d62020db5cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:39.419938 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-801f2449-2ba5-4c62-933d-7d62020db5cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:39.431908 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f2449-2ba5-4c62-933d-7d62020db5cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:39.433567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f2449-2ba5-4c62-933d-7d62020db5cf service placement] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:39.437709 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-10b2185a-8279-4ec4-9f0f-f0b44f6a16d6 None None] MFA Rules not processed for user `1c4658acb64346539d79dbfbdd4b81e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:39.438896 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-10b2185a-8279-4ec4-9f0f-f0b44f6a16d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:39.443638 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1395/2744] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:09:39.503880 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1350/2745] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:09:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:09:39.524636 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f2449-2ba5-4c62-933d-7d62020db5cf service placement] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:39.524636 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-801f2449-2ba5-4c62-933d-7d62020db5cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:39.573686 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f2449-2ba5-4c62-933d-7d62020db5cf service placement] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:39.577323 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d65b68-a311-4a50-b273-48a8e9476dbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:39.577965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d65b68-a311-4a50-b273-48a8e9476dbd service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:39.578248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d65b68-a311-4a50-b273-48a8e9476dbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:39.578526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d65b68-a311-4a50-b273-48a8e9476dbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:39.586836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d65b68-a311-4a50-b273-48a8e9476dbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:39.588274 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d65b68-a311-4a50-b273-48a8e9476dbd service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:39.597607 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1396/2746] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:39.623203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2185a-8279-4ec4-9f0f-f0b44f6a16d6 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:39.684806 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2185a-8279-4ec4-9f0f-f0b44f6a16d6 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:39.689941 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c70591-70be-4b5b-a459-ae7b9fb8e5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:39.690855 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c70591-70be-4b5b-a459-ae7b9fb8e5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:39.691204 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c70591-70be-4b5b-a459-ae7b9fb8e5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:39.691570 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c70591-70be-4b5b-a459-ae7b9fb8e5be admin admin] PATH_INFO: `/v3/users/1c4658acb64346539d79dbfbdd4b81e7` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:39.692992 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c70591-70be-4b5b-a459-ae7b9fb8e5be admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4658acb64346539d79dbfbdd4b81e7)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:39.695203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c70591-70be-4b5b-a459-ae7b9fb8e5be admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:39.700742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:39.931047 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d6c70591-70be-4b5b-a459-ae7b9fb8e5be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4658acb64346539d79dbfbdd4b81e7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:39.938048 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d6c70591-70be-4b5b-a459-ae7b9fb8e5be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4658acb64346539d79dbfbdd4b81e7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:39.938733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d6c70591-70be-4b5b-a459-ae7b9fb8e5be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4658acb64346539d79dbfbdd4b81e7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:39.939355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d6c70591-70be-4b5b-a459-ae7b9fb8e5be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4658acb64346539d79dbfbdd4b81e7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:39.951738 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d6c70591-70be-4b5b-a459-ae7b9fb8e5be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4658acb64346539d79dbfbdd4b81e7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:40.031921 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1351/2747] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:09:39 2022] DELETE /identity/v3/users/1c4658acb64346539d79dbfbdd4b81e7 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:40.036408 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83e70b-e8a2-4ce3-963a-bb6bd5a7a00c None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:40.036929 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83e70b-e8a2-4ce3-963a-bb6bd5a7a00c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:40.037026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83e70b-e8a2-4ce3-963a-bb6bd5a7a00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:40.054556 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-ff83e70b-e8a2-4ce3-963a-bb6bd5a7a00c None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:40.055804 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ff83e70b-e8a2-4ce3-963a-bb6bd5a7a00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:40.116339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1397/2748] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:40.126228 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c70591-70be-4b5b-a459-ae7b9fb8e5be admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:40.128370 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d6c70591-70be-4b5b-a459-ae7b9fb8e5be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:40.203555 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c70591-70be-4b5b-a459-ae7b9fb8e5be admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:40.207947 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d86aea-b145-43b3-8787-bea11af6ad26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:40.208657 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86aea-b145-43b3-8787-bea11af6ad26 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:40.208955 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86aea-b145-43b3-8787-bea11af6ad26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:40.209247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d86aea-b145-43b3-8787-bea11af6ad26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:40.221728 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d86aea-b145-43b3-8787-bea11af6ad26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:40.223733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d86aea-b145-43b3-8787-bea11af6ad26 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:40.235652 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1352/2749] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:09:40.729730 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83e70b-e8a2-4ce3-963a-bb6bd5a7a00c None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:09:40.731917 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ff83e70b-e8a2-4ce3-963a-bb6bd5a7a00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:40.747419 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83e70b-e8a2-4ce3-963a-bb6bd5a7a00c None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:09:40.754148 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03f485-aa28-4f69-82e9-046562379bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:09:40.755110 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03f485-aa28-4f69-82e9-046562379bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:40.755476 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03f485-aa28-4f69-82e9-046562379bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:40.755809 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03f485-aa28-4f69-82e9-046562379bfc admin admin] PATH_INFO: `/v3/projects/645bc5b5ebbf4df08de80b726acad16b` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:40.757364 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03f485-aa28-4f69-82e9-046562379bfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=645bc5b5ebbf4df08de80b726acad16b)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:09:40.759657 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03f485-aa28-4f69-82e9-046562379bfc admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:09:40.875666 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ea03f485-aa28-4f69-82e9-046562379bfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '645bc5b5ebbf4df08de80b726acad16b', 'request_id': 'req-ea03f485-aa28-4f69-82e9-046562379bfc'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:40.882721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ea03f485-aa28-4f69-82e9-046562379bfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '645bc5b5ebbf4df08de80b726acad16b', 'request_id': 'req-ea03f485-aa28-4f69-82e9-046562379bfc'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:40.884047 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:40.894852 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ea03f485-aa28-4f69-82e9-046562379bfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '645bc5b5ebbf4df08de80b726acad16b', 'request_id': 'req-ea03f485-aa28-4f69-82e9-046562379bfc'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:40.997157 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ea03f485-aa28-4f69-82e9-046562379bfc admin admin] The token cache is being invalidate because project 645bc5b5ebbf4df08de80b726acad16b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:09:40.997384 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ea03f485-aa28-4f69-82e9-046562379bfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:40.998009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ea03f485-aa28-4f69-82e9-046562379bfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:09:40.999675 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1398/2750] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:09:40 2022] DELETE /identity/v3/projects/645bc5b5ebbf4df08de80b726acad16b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:09:41.323242 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf6350-632d-4679-9836-48b8f8a31a20 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:41.323737 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf6350-632d-4679-9836-48b8f8a31a20 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:41.323854 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf6350-632d-4679-9836-48b8f8a31a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:41.340889 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-6cdf6350-632d-4679-9836-48b8f8a31a20 None None] MFA Rules not processed for user `661062780f5c45d180a05e402fc7bc27`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:41.342138 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6cdf6350-632d-4679-9836-48b8f8a31a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:41.398414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1353/2751] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:09:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:09:51.026360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=4,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:51.382411 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff306ae-e69f-4a1b-b657-6bb12940ee5e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:09:51.382705 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff306ae-e69f-4a1b-b657-6bb12940ee5e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:09:51.382975 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff306ae-e69f-4a1b-b657-6bb12940ee5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:09:51.391503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=75,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:09:51.400632 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-4ff306ae-e69f-4a1b-b657-6bb12940ee5e None None] MFA Rules not processed for user `3212553bb4ae401d9d56f311c779f035`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:09:51.404009 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4ff306ae-e69f-4a1b-b657-6bb12940ee5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:09:51.462447 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1399/2752] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:09:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:10:01.454676 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=25 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:10:46.534449 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1858974-6886-412c-83c2-e498474dc801 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:10:46.534963 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1858974-6886-412c-83c2-e498474dc801 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:10:46.535066 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1858974-6886-412c-83c2-e498474dc801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:10:46.552974 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b1858974-6886-412c-83c2-e498474dc801 None None] MFA Rules not processed for user `15ce49dfe7d0401caa1784c35b2ef90e`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:10:46.558930 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b1858974-6886-412c-83c2-e498474dc801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:10:46.609853 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1354/2753] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:10:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:10:56.601694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=25 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:00.098912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff306ae-e69f-4a1b-b657-6bb12940ee5e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:00.100475 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4ff306ae-e69f-4a1b-b657-6bb12940ee5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:00.167961 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff306ae-e69f-4a1b-b657-6bb12940ee5e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:00.172662 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38186d-a705-4fd2-9e97-d7bab0f920b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:00.173544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38186d-a705-4fd2-9e97-d7bab0f920b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:00.173825 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38186d-a705-4fd2-9e97-d7bab0f920b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:00.174103 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38186d-a705-4fd2-9e97-d7bab0f920b7 admin admin] PATH_INFO: `/v3/users/3212553bb4ae401d9d56f311c779f035` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:00.175316 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb38186d-a705-4fd2-9e97-d7bab0f920b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3212553bb4ae401d9d56f311c779f035)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:00.177324 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb38186d-a705-4fd2-9e97-d7bab0f920b7 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:00.202485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1858974-6886-412c-83c2-e498474dc801 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:00.203907 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b1858974-6886-412c-83c2-e498474dc801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:00.261036 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1858974-6886-412c-83c2-e498474dc801 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:00.264694 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e206f-dfc6-43fe-b153-7a7c17f37b14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:00.265349 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e206f-dfc6-43fe-b153-7a7c17f37b14 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:00.265636 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e206f-dfc6-43fe-b153-7a7c17f37b14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:00.265913 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e206f-dfc6-43fe-b153-7a7c17f37b14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:00.267704 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6c0e206f-dfc6-43fe-b153-7a7c17f37b14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:00.338020 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e206f-dfc6-43fe-b153-7a7c17f37b14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:00.339533 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e206f-dfc6-43fe-b153-7a7c17f37b14 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:00.350567 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1355/2754] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:11:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:11:00.370142 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-cb38186d-a705-4fd2-9e97-d7bab0f920b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3212553bb4ae401d9d56f311c779f035'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:11:00.376996 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-cb38186d-a705-4fd2-9e97-d7bab0f920b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3212553bb4ae401d9d56f311c779f035'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:11:00.377770 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-cb38186d-a705-4fd2-9e97-d7bab0f920b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3212553bb4ae401d9d56f311c779f035'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:11:00.378438 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-cb38186d-a705-4fd2-9e97-d7bab0f920b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3212553bb4ae401d9d56f311c779f035'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:11:00.390435 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-cb38186d-a705-4fd2-9e97-d7bab0f920b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3212553bb4ae401d9d56f311c779f035'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:11:00.486887 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1400/2755] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:11:00 2022] DELETE /identity/v3/users/3212553bb4ae401d9d56f311c779f035 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:11:00.758082 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e206f-dfc6-43fe-b153-7a7c17f37b14 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:00.770810 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e206f-dfc6-43fe-b153-7a7c17f37b14 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:00.830968 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3945f-f3d9-40ce-8c15-977695a9ffb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:00.831832 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3945f-f3d9-40ce-8c15-977695a9ffb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:00.832115 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3945f-f3d9-40ce-8c15-977695a9ffb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:00.832394 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3945f-f3d9-40ce-8c15-977695a9ffb5 admin admin] PATH_INFO: `/v3/projects/8461fdd34eef42d089eb3c3d7d607518` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:00.833696 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3945f-f3d9-40ce-8c15-977695a9ffb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8461fdd34eef42d089eb3c3d7d607518)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:00.835606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3945f-f3d9-40ce-8c15-977695a9ffb5 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:00.978543 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:00.984094 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-eed3945f-f3d9-40ce-8c15-977695a9ffb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8461fdd34eef42d089eb3c3d7d607518', 'request_id': 'req-eed3945f-f3d9-40ce-8c15-977695a9ffb5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:11:01.081487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-eed3945f-f3d9-40ce-8c15-977695a9ffb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8461fdd34eef42d089eb3c3d7d607518', 'request_id': 'req-eed3945f-f3d9-40ce-8c15-977695a9ffb5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:11:01.089183 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-eed3945f-f3d9-40ce-8c15-977695a9ffb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8461fdd34eef42d089eb3c3d7d607518', 'request_id': 'req-eed3945f-f3d9-40ce-8c15-977695a9ffb5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:11:01.099746 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-eed3945f-f3d9-40ce-8c15-977695a9ffb5 admin admin] The token cache is being invalidate because project 8461fdd34eef42d089eb3c3d7d607518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:11:01.100041 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-eed3945f-f3d9-40ce-8c15-977695a9ffb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:11:01.100716 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-eed3945f-f3d9-40ce-8c15-977695a9ffb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:11:01.102265 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1356/2756] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:11:00 2022] DELETE /identity/v3/projects/8461fdd34eef42d089eb3c3d7d607518 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:11:01.108270 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9670c-5e89-492b-8b59-369eb79e0d9a None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:01.108788 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9670c-5e89-492b-8b59-369eb79e0d9a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:01.108888 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9670c-5e89-492b-8b59-369eb79e0d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:01.127354 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-23d9670c-5e89-492b-8b59-369eb79e0d9a None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:11:01.128577 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-23d9670c-5e89-492b-8b59-369eb79e0d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:01.189874 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1401/2757] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:11:01.198405 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0572e-a8ba-4595-b5c4-7d3aa59c36b6 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:01.198697 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0572e-a8ba-4595-b5c4-7d3aa59c36b6 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:01.198977 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0572e-a8ba-4595-b5c4-7d3aa59c36b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:01.217701 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d0a0572e-a8ba-4595-b5c4-7d3aa59c36b6 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:11:01.218941 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d0a0572e-a8ba-4595-b5c4-7d3aa59c36b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:01.227021 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1357/2758] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:11:01.231491 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9670c-5e89-492b-8b59-369eb79e0d9a None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:01.241617 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9670c-5e89-492b-8b59-369eb79e0d9a None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:01.246949 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbd8e3-8f03-40f9-8b56-1d7cd2d6b59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:01.247611 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbd8e3-8f03-40f9-8b56-1d7cd2d6b59b admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:01.247900 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbd8e3-8f03-40f9-8b56-1d7cd2d6b59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:01.248181 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbd8e3-8f03-40f9-8b56-1d7cd2d6b59b admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:01.248953 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbd8e3-8f03-40f9-8b56-1d7cd2d6b59b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:11:01.249269 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbd8e3-8f03-40f9-8b56-1d7cd2d6b59b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:01.250924 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbd8e3-8f03-40f9-8b56-1d7cd2d6b59b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:01.263427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1402/2759] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:11:01.267835 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0572e-a8ba-4595-b5c4-7d3aa59c36b6 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:01.277560 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0572e-a8ba-4595-b5c4-7d3aa59c36b6 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:01.282259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1eddc-da68-4022-b4aa-fb2011262f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:01.283007 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1eddc-da68-4022-b4aa-fb2011262f10 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:01.283297 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1eddc-da68-4022-b4aa-fb2011262f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:01.283578 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1eddc-da68-4022-b4aa-fb2011262f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:01.284287 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1eddc-da68-4022-b4aa-fb2011262f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:01.286294 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1eddc-da68-4022-b4aa-fb2011262f10 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:01.381997 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1358/2760] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:11:01 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:11:01.392893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbd8e3-8f03-40f9-8b56-1d7cd2d6b59b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:01.403004 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbd8e3-8f03-40f9-8b56-1d7cd2d6b59b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:01.406640 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:01.460899 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7972635-1e15-4f5e-b3c2-9b677c3b5cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:01.461625 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7972635-1e15-4f5e-b3c2-9b677c3b5cdf admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:01.461911 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7972635-1e15-4f5e-b3c2-9b677c3b5cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:01.462230 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7972635-1e15-4f5e-b3c2-9b677c3b5cdf admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:01.462935 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7972635-1e15-4f5e-b3c2-9b677c3b5cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:01.464916 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7972635-1e15-4f5e-b3c2-9b677c3b5cdf admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:01.596189 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1403/2761] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:11:01 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:11:01.600280 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1eddc-da68-4022-b4aa-fb2011262f10 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:01.619871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1eddc-da68-4022-b4aa-fb2011262f10 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:01.621687 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3897a-b391-4f46-9212-79c552b4f76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:01.622468 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3897a-b391-4f46-9212-79c552b4f76a admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:01.622898 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3897a-b391-4f46-9212-79c552b4f76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:01.623284 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3897a-b391-4f46-9212-79c552b4f76a admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:01.624129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3897a-b391-4f46-9212-79c552b4f76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:01.625890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3897a-b391-4f46-9212-79c552b4f76a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:01.640946 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1359/2762] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:11:01.642416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7972635-1e15-4f5e-b3c2-9b677c3b5cdf admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:01.656026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7972635-1e15-4f5e-b3c2-9b677c3b5cdf admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:01.662293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c494f-0a6b-40a5-8aa3-968f14862b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:01.663128 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c494f-0a6b-40a5-8aa3-968f14862b95 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:01.663539 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c494f-0a6b-40a5-8aa3-968f14862b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:01.663933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c494f-0a6b-40a5-8aa3-968f14862b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:01.664828 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c494f-0a6b-40a5-8aa3-968f14862b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:01.667288 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c494f-0a6b-40a5-8aa3-968f14862b95 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:01.682565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1404/2763] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:11:01.687552 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3897a-b391-4f46-9212-79c552b4f76a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:01.699307 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3897a-b391-4f46-9212-79c552b4f76a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:01.705237 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c33fa-fcc2-42e8-a6d0-c3a97fb4c5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:01.710386 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c33fa-fcc2-42e8-a6d0-c3a97fb4c5af admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:01.710386 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c33fa-fcc2-42e8-a6d0-c3a97fb4c5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:01.710386 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c33fa-fcc2-42e8-a6d0-c3a97fb4c5af admin admin] PATH_INFO: `/v3/projects/4e0f29cb8f344bbf9fd1b7ffb626bbcb/users/dc8472b840794ab8ac0ccd49b2fd1657/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:01.725441 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c33fa-fcc2-42e8-a6d0-c3a97fb4c5af admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e0f29cb8f344bbf9fd1b7ffb626bbcb, user_id=dc8472b840794ab8ac0ccd49b2fd1657, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:01.729116 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c33fa-fcc2-42e8-a6d0-c3a97fb4c5af admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:01.829943 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1360/2764] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:11:01 2022] PUT /identity/v3/projects/4e0f29cb8f344bbf9fd1b7ffb626bbcb/users/dc8472b840794ab8ac0ccd49b2fd1657/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:11:01.832375 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb6fac-e296-45e1-aed6-d57e87720e92 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:01.832708 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb6fac-e296-45e1-aed6-d57e87720e92 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:01.832996 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb6fac-e296-45e1-aed6-d57e87720e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:01.853781 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-afeb6fac-e296-45e1-aed6-d57e87720e92 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:11:01.855053 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-afeb6fac-e296-45e1-aed6-d57e87720e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:01.923969 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1405/2765] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:11:01.933968 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c33fa-fcc2-42e8-a6d0-c3a97fb4c5af admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:01.935733 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-252c33fa-fcc2-42e8-a6d0-c3a97fb4c5af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:02.013822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c33fa-fcc2-42e8-a6d0-c3a97fb4c5af admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:02.018746 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78223dcf-be9f-4023-879e-2ed09355089f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:02.018746 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78223dcf-be9f-4023-879e-2ed09355089f service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:02.019041 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78223dcf-be9f-4023-879e-2ed09355089f service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:02.019329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78223dcf-be9f-4023-879e-2ed09355089f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:02.029649 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78223dcf-be9f-4023-879e-2ed09355089f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:02.031248 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78223dcf-be9f-4023-879e-2ed09355089f service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:02.042922 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1361/2766] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:11:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:11:07.442484 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c199ef-80b5-4ba2-bcbb-bf7c4a95fd49 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:07.443023 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c199ef-80b5-4ba2-bcbb-bf7c4a95fd49 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:07.443023 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c199ef-80b5-4ba2-bcbb-bf7c4a95fd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:07.475115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-57c199ef-80b5-4ba2-bcbb-bf7c4a95fd49 None None] MFA Rules not processed for user `dc8472b840794ab8ac0ccd49b2fd1657`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:11:07.476544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-57c199ef-80b5-4ba2-bcbb-bf7c4a95fd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:07.546861 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1406/2767] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:11:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:11:07.551316 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78223dcf-be9f-4023-879e-2ed09355089f service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:07.561494 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78223dcf-be9f-4023-879e-2ed09355089f service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:07.566242 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001fc66-a648-4775-bf95-aeefcd3debe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:07.566844 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001fc66-a648-4775-bf95-aeefcd3debe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:07.567132 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001fc66-a648-4775-bf95-aeefcd3debe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:07.567416 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001fc66-a648-4775-bf95-aeefcd3debe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:07.568112 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001fc66-a648-4775-bf95-aeefcd3debe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:07.570063 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001fc66-a648-4775-bf95-aeefcd3debe0 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:07.684934 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1362/2768] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:11:07 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:11:07.688553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c199ef-80b5-4ba2-bcbb-bf7c4a95fd49 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:07.700307 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c199ef-80b5-4ba2-bcbb-bf7c4a95fd49 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:07.713438 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:07.784450 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac874adb-a45c-4e9b-a505-86564ce1c69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:07.785220 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac874adb-a45c-4e9b-a505-86564ce1c69a admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:07.785503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac874adb-a45c-4e9b-a505-86564ce1c69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:07.785783 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac874adb-a45c-4e9b-a505-86564ce1c69a admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:07.786488 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac874adb-a45c-4e9b-a505-86564ce1c69a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:07.788469 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac874adb-a45c-4e9b-a505-86564ce1c69a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:07.900746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1407/2769] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:11:07 2022] POST /identity/v3/users => generated 299 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:11:07.903136 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001fc66-a648-4775-bf95-aeefcd3debe0 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:07.913883 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001fc66-a648-4775-bf95-aeefcd3debe0 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:07.918631 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeceb35-c17d-43bf-aebc-1289d63d3d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:07.919297 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeceb35-c17d-43bf-aebc-1289d63d3d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:07.919586 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeceb35-c17d-43bf-aebc-1289d63d3d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:07.919864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeceb35-c17d-43bf-aebc-1289d63d3d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:07.920632 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeceb35-c17d-43bf-aebc-1289d63d3d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:07.922238 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeceb35-c17d-43bf-aebc-1289d63d3d99 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:07.934464 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1363/2770] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:11:07.938850 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac874adb-a45c-4e9b-a505-86564ce1c69a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:07.950119 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac874adb-a45c-4e9b-a505-86564ce1c69a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:07.957957 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbbd61-5c8e-4f3a-863c-7503cfe3f1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:07.960333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbbd61-5c8e-4f3a-863c-7503cfe3f1ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:07.960333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbbd61-5c8e-4f3a-863c-7503cfe3f1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:07.960333 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbbd61-5c8e-4f3a-863c-7503cfe3f1ee admin admin] PATH_INFO: `/v3/projects/950ec3cdd1c947b3a186ed11ecd51b64/users/69538df176d644b3b396f86d220a27af/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:07.975528 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cbbd61-5c8e-4f3a-863c-7503cfe3f1ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=950ec3cdd1c947b3a186ed11ecd51b64, user_id=69538df176d644b3b396f86d220a27af, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:07.978402 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cbbd61-5c8e-4f3a-863c-7503cfe3f1ee admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:08.071304 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1408/2771] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:11:07 2022] PUT /identity/v3/projects/950ec3cdd1c947b3a186ed11ecd51b64/users/69538df176d644b3b396f86d220a27af/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:11:08.079979 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeceb35-c17d-43bf-aebc-1289d63d3d99 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:08.086425 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeceb35-c17d-43bf-aebc-1289d63d3d99 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:08.125243 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:08.148787 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b7b9f-39e9-4c18-a307-009e24e9e322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:08.149904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b7b9f-39e9-4c18-a307-009e24e9e322 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:08.150436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b7b9f-39e9-4c18-a307-009e24e9e322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:08.150722 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b7b9f-39e9-4c18-a307-009e24e9e322 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:08.151932 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b7b9f-39e9-4c18-a307-009e24e9e322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:08.153714 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b7b9f-39e9-4c18-a307-009e24e9e322 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:08.164797 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1364/2772] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:11:08.168955 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbbd61-5c8e-4f3a-863c-7503cfe3f1ee admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:08.180063 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbbd61-5c8e-4f3a-863c-7503cfe3f1ee admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:08.185609 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dbc30-9b55-4c0a-a550-d771a2c8d901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:08.186505 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dbc30-9b55-4c0a-a550-d771a2c8d901 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:08.186789 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dbc30-9b55-4c0a-a550-d771a2c8d901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:08.187064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dbc30-9b55-4c0a-a550-d771a2c8d901 admin admin] PATH_INFO: `/v3/projects/950ec3cdd1c947b3a186ed11ecd51b64/users/69538df176d644b3b396f86d220a27af/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:08.189104 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693dbc30-9b55-4c0a-a550-d771a2c8d901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=950ec3cdd1c947b3a186ed11ecd51b64, user_id=69538df176d644b3b396f86d220a27af, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:08.191820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693dbc30-9b55-4c0a-a550-d771a2c8d901 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:08.203646 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1409/2773] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:11:08 2022] PUT /identity/v3/projects/950ec3cdd1c947b3a186ed11ecd51b64/users/69538df176d644b3b396f86d220a27af/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:11:13.760533 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20391797-f4af-49e7-890c-58d88a730a11 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:13.761124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20391797-f4af-49e7-890c-58d88a730a11 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:13.761124 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20391797-f4af-49e7-890c-58d88a730a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:13.788248 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-20391797-f4af-49e7-890c-58d88a730a11 None None] MFA Rules not processed for user `69538df176d644b3b396f86d220a27af`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:11:13.789441 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-20391797-f4af-49e7-890c-58d88a730a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:13.861400 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1365/2774] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:11:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:11:13.874293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dbc30-9b55-4c0a-a550-d771a2c8d901 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:13.875952 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-693dbc30-9b55-4c0a-a550-d771a2c8d901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:13.938617 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dbc30-9b55-4c0a-a550-d771a2c8d901 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:13.942215 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8e27b-6386-4967-8c0b-2f370a9312b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e7c4b0bd50c474996a21b69bde4e227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:13.942871 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8e27b-6386-4967-8c0b-2f370a9312b6 service glance] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:13.943150 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8e27b-6386-4967-8c0b-2f370a9312b6 service glance] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:13.943422 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8e27b-6386-4967-8c0b-2f370a9312b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:14.000529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8e27b-6386-4967-8c0b-2f370a9312b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:14.002083 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8e27b-6386-4967-8c0b-2f370a9312b6 service glance] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:14.012534 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1410/2775] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:11:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:11:14.254623 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec88059-9955-4766-b0c2-afc2e4aef5f9 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:14.254918 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec88059-9955-4766-b0c2-afc2e4aef5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:14.255199 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec88059-9955-4766-b0c2-afc2e4aef5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:14.273890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-fec88059-9955-4766-b0c2-afc2e4aef5f9 None None] MFA Rules not processed for user `ab47c91ba7854bc09f656607dbb41cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:11:14.275367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-fec88059-9955-4766-b0c2-afc2e4aef5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:14.335050 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1366/2776] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jul 5 13:11:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:11:14.507533 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8e27b-6386-4967-8c0b-2f370a9312b6 service glance] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:14.512027 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3cc8e27b-6386-4967-8c0b-2f370a9312b6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:14.545297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:14.600836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8e27b-6386-4967-8c0b-2f370a9312b6 service glance] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:14.606853 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f1a00-9ed5-4486-854b-ae70acb80cf2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fb7db02f8e945a7af39cb30c3d606f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:14.607528 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f1a00-9ed5-4486-854b-ae70acb80cf2 service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:14.607964 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f1a00-9ed5-4486-854b-ae70acb80cf2 service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:14.608236 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f1a00-9ed5-4486-854b-ae70acb80cf2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:14.618600 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f1a00-9ed5-4486-854b-ae70acb80cf2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:14.620527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f1a00-9ed5-4486-854b-ae70acb80cf2 service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:14.629682 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1411/2777] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jul 5 13:11:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:11:24.328083 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=71 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:24.702144 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddae0b-be1a-49b7-a5e6-0cea83330abd None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:24.702440 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddae0b-be1a-49b7-a5e6-0cea83330abd None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:24.702724 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddae0b-be1a-49b7-a5e6-0cea83330abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:24.720196 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-1bddae0b-be1a-49b7-a5e6-0cea83330abd None None] MFA Rules not processed for user `dc8472b840794ab8ac0ccd49b2fd1657`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:11:24.725558 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1bddae0b-be1a-49b7-a5e6-0cea83330abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:24.728888 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1367/2778] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:11:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:11:24.750544 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=22 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:24.980457 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f1a00-9ed5-4486-854b-ae70acb80cf2 service swift] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:25.034402 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f1a00-9ed5-4486-854b-ae70acb80cf2 service swift] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:25.037987 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b1fec-5c82-4762-b5b2-7f1fa60166df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:25.038630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b1fec-5c82-4762-b5b2-7f1fa60166df service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:25.038913 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b1fec-5c82-4762-b5b2-7f1fa60166df service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:25.039195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b1fec-5c82-4762-b5b2-7f1fa60166df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:25.041560 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b18b1fec-5c82-4762-b5b2-7f1fa60166df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:25.051313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b1fec-5c82-4762-b5b2-7f1fa60166df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:25.052795 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b1fec-5c82-4762-b5b2-7f1fa60166df service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:25.061688 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1412/2779] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:11:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:11:25.506245 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddae0b-be1a-49b7-a5e6-0cea83330abd None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:25.507758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1bddae0b-be1a-49b7-a5e6-0cea83330abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:25.512457 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b1fec-5c82-4762-b5b2-7f1fa60166df service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:25.521510 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b1fec-5c82-4762-b5b2-7f1fa60166df service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:25.526561 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810196d-19e5-445f-abc0-2a79505f7eb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:25.527203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810196d-19e5-445f-abc0-2a79505f7eb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:25.527487 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810196d-19e5-445f-abc0-2a79505f7eb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:25.527765 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810196d-19e5-445f-abc0-2a79505f7eb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:25.529625 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5810196d-19e5-445f-abc0-2a79505f7eb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:25.581822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddae0b-be1a-49b7-a5e6-0cea83330abd None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:25.587061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae206e41-1662-4ab5-9a99-c7077c32ef09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43b85b5c7b1e4d73b29fb96f4fa6db71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:25.588324 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae206e41-1662-4ab5-9a99-c7077c32ef09 service placement] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:25.588637 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae206e41-1662-4ab5-9a99-c7077c32ef09 service placement] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:25.588924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae206e41-1662-4ab5-9a99-c7077c32ef09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:25.591015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ae206e41-1662-4ab5-9a99-c7077c32ef09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:25.602949 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae206e41-1662-4ab5-9a99-c7077c32ef09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:25.603110 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810196d-19e5-445f-abc0-2a79505f7eb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:25.604540 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae206e41-1662-4ab5-9a99-c7077c32ef09 service placement] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:25.604709 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810196d-19e5-445f-abc0-2a79505f7eb8 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:25.615187 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1368/2780] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:11:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:11:25.616631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1413/2781] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:11:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 13:11:28.585506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deced45b-8514-41f9-99c0-a4996b6fad1c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:28.586014 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deced45b-8514-41f9-99c0-a4996b6fad1c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:28.586138 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deced45b-8514-41f9-99c0-a4996b6fad1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:28.603429 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-deced45b-8514-41f9-99c0-a4996b6fad1c None None] MFA Rules not processed for user `ab47c91ba7854bc09f656607dbb41cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:11:28.605150 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-deced45b-8514-41f9-99c0-a4996b6fad1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:28.612982 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1369/2782] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jul 5 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:11:28.626202 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810196d-19e5-445f-abc0-2a79505f7eb8 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:28.637925 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810196d-19e5-445f-abc0-2a79505f7eb8 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:28.643080 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92246c87-3c60-4e62-abcc-410ae3e05034 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fb7db02f8e945a7af39cb30c3d606f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:28.643819 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92246c87-3c60-4e62-abcc-410ae3e05034 service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:28.644105 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92246c87-3c60-4e62-abcc-410ae3e05034 service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:28.644381 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92246c87-3c60-4e62-abcc-410ae3e05034 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:28.652810 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92246c87-3c60-4e62-abcc-410ae3e05034 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:28.654395 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92246c87-3c60-4e62-abcc-410ae3e05034 service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:28.663550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1414/2783] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jul 5 13:11:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:11:36.429848 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deced45b-8514-41f9-99c0-a4996b6fad1c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:36.429848 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-deced45b-8514-41f9-99c0-a4996b6fad1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:36.429848 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deced45b-8514-41f9-99c0-a4996b6fad1c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:36.432606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70220f-0a9a-4539-806b-58c1b5917516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:36.432606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70220f-0a9a-4539-806b-58c1b5917516 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:36.432606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70220f-0a9a-4539-806b-58c1b5917516 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:36.432606 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70220f-0a9a-4539-806b-58c1b5917516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:36.433640 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-dd70220f-0a9a-4539-806b-58c1b5917516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:36.443426 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70220f-0a9a-4539-806b-58c1b5917516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:36.444911 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70220f-0a9a-4539-806b-58c1b5917516 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:36.467222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1370/2784] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:11:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:11:37.486089 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92246c87-3c60-4e62-abcc-410ae3e05034 service swift] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:37.488444 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-92246c87-3c60-4e62-abcc-410ae3e05034 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:37.510734 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92246c87-3c60-4e62-abcc-410ae3e05034 service swift] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:37.517168 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f0651-3870-4570-ae25-6c2c0d9efd76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:37.517168 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f0651-3870-4570-ae25-6c2c0d9efd76 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:37.517582 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f0651-3870-4570-ae25-6c2c0d9efd76 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:37.517865 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f0651-3870-4570-ae25-6c2c0d9efd76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:37.519695 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b32f0651-3870-4570-ae25-6c2c0d9efd76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:11:37.533381 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f0651-3870-4570-ae25-6c2c0d9efd76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:37.535092 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f0651-3870-4570-ae25-6c2c0d9efd76 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:37.552243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1415/2785] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:11:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:11:46.450405 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=44 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:47.542916 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=72 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:11:58.353092 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70220f-0a9a-4539-806b-58c1b5917516 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:11:58.373365 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70220f-0a9a-4539-806b-58c1b5917516 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:11:58.377590 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ea686-4ce1-4228-80dd-afdc87b8b94c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:11:58.378234 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ea686-4ce1-4228-80dd-afdc87b8b94c service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:11:58.378518 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ea686-4ce1-4228-80dd-afdc87b8b94c service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:11:58.378791 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ea686-4ce1-4228-80dd-afdc87b8b94c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:11:58.392004 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ea686-4ce1-4228-80dd-afdc87b8b94c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:11:58.392004 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ea686-4ce1-4228-80dd-afdc87b8b94c service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:11:58.401781 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1371/2786] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:11:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:12:01.351006 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f0651-3870-4570-ae25-6c2c0d9efd76 service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:01.353195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b32f0651-3870-4570-ae25-6c2c0d9efd76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:01.417124 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f0651-3870-4570-ae25-6c2c0d9efd76 service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:01.421252 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050d86b-d121-44a0-a69a-2bc13d6cfb50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:01.421939 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050d86b-d121-44a0-a69a-2bc13d6cfb50 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:01.422221 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050d86b-d121-44a0-a69a-2bc13d6cfb50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:01.422492 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050d86b-d121-44a0-a69a-2bc13d6cfb50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:01.424290 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5050d86b-d121-44a0-a69a-2bc13d6cfb50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:01.487195 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050d86b-d121-44a0-a69a-2bc13d6cfb50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:01.488895 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050d86b-d121-44a0-a69a-2bc13d6cfb50 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:01.500325 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1416/2787] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:12:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:12:02.381350 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ea686-4ce1-4228-80dd-afdc87b8b94c service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:02.391371 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ea686-4ce1-4228-80dd-afdc87b8b94c service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:02.395263 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaa451-4c5b-44e7-af55-ad596afecde4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:02.396059 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaa451-4c5b-44e7-af55-ad596afecde4 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:02.396438 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaa451-4c5b-44e7-af55-ad596afecde4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:02.396845 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaa451-4c5b-44e7-af55-ad596afecde4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:02.398813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4deaa451-4c5b-44e7-af55-ad596afecde4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:02.461213 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deaa451-4c5b-44e7-af55-ad596afecde4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:02.462737 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deaa451-4c5b-44e7-af55-ad596afecde4 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:02.473010 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1372/2788] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:12:10.692282 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050d86b-d121-44a0-a69a-2bc13d6cfb50 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:10.693942 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5050d86b-d121-44a0-a69a-2bc13d6cfb50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:10.709636 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050d86b-d121-44a0-a69a-2bc13d6cfb50 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:10.715652 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165b6c1-2d6c-431d-b407-ac543a239e30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43b85b5c7b1e4d73b29fb96f4fa6db71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:10.716394 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165b6c1-2d6c-431d-b407-ac543a239e30 service placement] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:10.716782 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165b6c1-2d6c-431d-b407-ac543a239e30 service placement] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:10.717313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165b6c1-2d6c-431d-b407-ac543a239e30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:10.719302 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6165b6c1-2d6c-431d-b407-ac543a239e30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:10.732032 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165b6c1-2d6c-431d-b407-ac543a239e30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:10.733782 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165b6c1-2d6c-431d-b407-ac543a239e30 service placement] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:10.744110 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1417/2789] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:12:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:12:10.848790 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaa451-4c5b-44e7-af55-ad596afecde4 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:10.850232 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4deaa451-4c5b-44e7-af55-ad596afecde4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:10.863777 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaa451-4c5b-44e7-af55-ad596afecde4 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:10.868658 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848387b-d257-4de0-bd15-8e58f97d5ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:10.873041 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848387b-d257-4de0-bd15-8e58f97d5ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:10.873041 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848387b-d257-4de0-bd15-8e58f97d5ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:10.873041 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848387b-d257-4de0-bd15-8e58f97d5ac3 admin admin] PATH_INFO: `/v3/users/661062780f5c45d180a05e402fc7bc27` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:10.873041 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848387b-d257-4de0-bd15-8e58f97d5ac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=661062780f5c45d180a05e402fc7bc27)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:10.873833 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848387b-d257-4de0-bd15-8e58f97d5ac3 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:11.061540 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8848387b-d257-4de0-bd15-8e58f97d5ac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '661062780f5c45d180a05e402fc7bc27'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:11.070411 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8848387b-d257-4de0-bd15-8e58f97d5ac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '661062780f5c45d180a05e402fc7bc27'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:11.071112 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8848387b-d257-4de0-bd15-8e58f97d5ac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '661062780f5c45d180a05e402fc7bc27'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:11.071741 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8848387b-d257-4de0-bd15-8e58f97d5ac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '661062780f5c45d180a05e402fc7bc27'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:11.084123 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8848387b-d257-4de0-bd15-8e58f97d5ac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '661062780f5c45d180a05e402fc7bc27'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:11.189116 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1373/2790] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:12:10 2022] DELETE /identity/v3/users/661062780f5c45d180a05e402fc7bc27 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:11.424814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165b6c1-2d6c-431d-b407-ac543a239e30 service placement] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:11.435934 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165b6c1-2d6c-431d-b407-ac543a239e30 service placement] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:11.490814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba3e9e-ae1d-435b-97ec-c1ddcbadb5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:11.491665 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba3e9e-ae1d-435b-97ec-c1ddcbadb5e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:11.491945 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba3e9e-ae1d-435b-97ec-c1ddcbadb5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:11.492219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba3e9e-ae1d-435b-97ec-c1ddcbadb5e8 admin admin] PATH_INFO: `/v3/projects/277fa3c89dff47b88894b781ff69fb70` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:11.493407 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba3e9e-ae1d-435b-97ec-c1ddcbadb5e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=277fa3c89dff47b88894b781ff69fb70)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:11.495313 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba3e9e-ae1d-435b-97ec-c1ddcbadb5e8 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:11.609741 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:11.613331 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ccba3e9e-ae1d-435b-97ec-c1ddcbadb5e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '277fa3c89dff47b88894b781ff69fb70', 'request_id': 'req-ccba3e9e-ae1d-435b-97ec-c1ddcbadb5e8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:11.618686 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ccba3e9e-ae1d-435b-97ec-c1ddcbadb5e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '277fa3c89dff47b88894b781ff69fb70', 'request_id': 'req-ccba3e9e-ae1d-435b-97ec-c1ddcbadb5e8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:11.624672 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ccba3e9e-ae1d-435b-97ec-c1ddcbadb5e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '277fa3c89dff47b88894b781ff69fb70', 'request_id': 'req-ccba3e9e-ae1d-435b-97ec-c1ddcbadb5e8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:11.747844 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ccba3e9e-ae1d-435b-97ec-c1ddcbadb5e8 admin admin] The token cache is being invalidate because project 277fa3c89dff47b88894b781ff69fb70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:12:11.748495 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ccba3e9e-ae1d-435b-97ec-c1ddcbadb5e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:11.748835 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ccba3e9e-ae1d-435b-97ec-c1ddcbadb5e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:11.750416 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1418/2791] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:12:11 2022] DELETE /identity/v3/projects/277fa3c89dff47b88894b781ff69fb70 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:11.754613 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848387b-d257-4de0-bd15-8e58f97d5ac3 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:11.756207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8848387b-d257-4de0-bd15-8e58f97d5ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:11.769388 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848387b-d257-4de0-bd15-8e58f97d5ac3 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:11.816876 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:11.825556 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c275b-8b37-4497-a2ed-4b37762e5266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:11.828142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c275b-8b37-4497-a2ed-4b37762e5266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:11.828142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c275b-8b37-4497-a2ed-4b37762e5266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:11.828142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c275b-8b37-4497-a2ed-4b37762e5266 admin admin] PATH_INFO: `/v3/users/9fec0c5afb3248d68f39cdd51c1656be` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:11.828142 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c275b-8b37-4497-a2ed-4b37762e5266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fec0c5afb3248d68f39cdd51c1656be)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:11.830088 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c275b-8b37-4497-a2ed-4b37762e5266 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:12.036595 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-761c275b-8b37-4497-a2ed-4b37762e5266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fec0c5afb3248d68f39cdd51c1656be'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:12.043428 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-761c275b-8b37-4497-a2ed-4b37762e5266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fec0c5afb3248d68f39cdd51c1656be'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:12.044097 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-761c275b-8b37-4497-a2ed-4b37762e5266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fec0c5afb3248d68f39cdd51c1656be'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:12.044756 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-761c275b-8b37-4497-a2ed-4b37762e5266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fec0c5afb3248d68f39cdd51c1656be'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:12.056781 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-761c275b-8b37-4497-a2ed-4b37762e5266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fec0c5afb3248d68f39cdd51c1656be'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:12.166037 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1374/2792] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:12:11 2022] DELETE /identity/v3/users/9fec0c5afb3248d68f39cdd51c1656be => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:12.473396 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba3e9e-ae1d-435b-97ec-c1ddcbadb5e8 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:12.479631 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ccba3e9e-ae1d-435b-97ec-c1ddcbadb5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:12.488660 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba3e9e-ae1d-435b-97ec-c1ddcbadb5e8 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:12.545472 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b384e-ee9b-4b56-b44c-f5cd5900ecf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:12.546335 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b384e-ee9b-4b56-b44c-f5cd5900ecf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:12.546621 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b384e-ee9b-4b56-b44c-f5cd5900ecf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:12.546900 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b384e-ee9b-4b56-b44c-f5cd5900ecf0 admin admin] PATH_INFO: `/v3/projects/738ac669e62342d6a9e5b11db0046cf0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:12.548090 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b384e-ee9b-4b56-b44c-f5cd5900ecf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=738ac669e62342d6a9e5b11db0046cf0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:12.550065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b384e-ee9b-4b56-b44c-f5cd5900ecf0 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:12.665984 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-944b384e-ee9b-4b56-b44c-f5cd5900ecf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '738ac669e62342d6a9e5b11db0046cf0', 'request_id': 'req-944b384e-ee9b-4b56-b44c-f5cd5900ecf0'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:12.672078 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-944b384e-ee9b-4b56-b44c-f5cd5900ecf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '738ac669e62342d6a9e5b11db0046cf0', 'request_id': 'req-944b384e-ee9b-4b56-b44c-f5cd5900ecf0'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:12.678369 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-944b384e-ee9b-4b56-b44c-f5cd5900ecf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '738ac669e62342d6a9e5b11db0046cf0', 'request_id': 'req-944b384e-ee9b-4b56-b44c-f5cd5900ecf0'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:12.746013 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-944b384e-ee9b-4b56-b44c-f5cd5900ecf0 admin admin] The token cache is being invalidate because project 738ac669e62342d6a9e5b11db0046cf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:12:12.746933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-944b384e-ee9b-4b56-b44c-f5cd5900ecf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:12.747563 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-944b384e-ee9b-4b56-b44c-f5cd5900ecf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:12.749182 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1419/2793] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:12:12 2022] DELETE /identity/v3/projects/738ac669e62342d6a9e5b11db0046cf0 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:20.646959 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c275b-8b37-4497-a2ed-4b37762e5266 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:20.648510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-761c275b-8b37-4497-a2ed-4b37762e5266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:20.705841 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c275b-8b37-4497-a2ed-4b37762e5266 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:20.753946 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f58ce-26ce-4440-9158-b60a804d0dd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:20.754591 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f58ce-26ce-4440-9158-b60a804d0dd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:20.754873 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f58ce-26ce-4440-9158-b60a804d0dd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:20.755251 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f58ce-26ce-4440-9158-b60a804d0dd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:20.757275 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-fa1f58ce-26ce-4440-9158-b60a804d0dd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:20.799960 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:20.819988 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f58ce-26ce-4440-9158-b60a804d0dd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:20.821512 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f58ce-26ce-4440-9158-b60a804d0dd4 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:20.831279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1375/2794] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:12:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:12:22.743090 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=59,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:24.218690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b384e-ee9b-4b56-b44c-f5cd5900ecf0 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:24.220462 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-944b384e-ee9b-4b56-b44c-f5cd5900ecf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:24.234822 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b384e-ee9b-4b56-b44c-f5cd5900ecf0 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:24.239557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cb91f-43ca-40ba-a571-ffcff6f8e998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:24.240427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cb91f-43ca-40ba-a571-ffcff6f8e998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:24.240739 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cb91f-43ca-40ba-a571-ffcff6f8e998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:24.241038 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cb91f-43ca-40ba-a571-ffcff6f8e998 admin admin] PATH_INFO: `/v3/users/15ce49dfe7d0401caa1784c35b2ef90e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:24.242216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cb91f-43ca-40ba-a571-ffcff6f8e998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ce49dfe7d0401caa1784c35b2ef90e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:24.244157 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cb91f-43ca-40ba-a571-ffcff6f8e998 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:24.423128 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0e9cb91f-43ca-40ba-a571-ffcff6f8e998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ce49dfe7d0401caa1784c35b2ef90e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:24.430537 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0e9cb91f-43ca-40ba-a571-ffcff6f8e998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ce49dfe7d0401caa1784c35b2ef90e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:24.431232 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0e9cb91f-43ca-40ba-a571-ffcff6f8e998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ce49dfe7d0401caa1784c35b2ef90e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:24.431860 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0e9cb91f-43ca-40ba-a571-ffcff6f8e998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ce49dfe7d0401caa1784c35b2ef90e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:24.445115 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0e9cb91f-43ca-40ba-a571-ffcff6f8e998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ce49dfe7d0401caa1784c35b2ef90e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:24.532053 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1420/2795] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:12:24 2022] DELETE /identity/v3/users/15ce49dfe7d0401caa1784c35b2ef90e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:24.782375 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f58ce-26ce-4440-9158-b60a804d0dd4 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:24.793274 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f58ce-26ce-4440-9158-b60a804d0dd4 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:24.850614 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a833f2-e377-401d-ba24-6b1a986fcad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:24.851470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a833f2-e377-401d-ba24-6b1a986fcad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:24.851748 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a833f2-e377-401d-ba24-6b1a986fcad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:24.852016 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a833f2-e377-401d-ba24-6b1a986fcad4 admin admin] PATH_INFO: `/v3/projects/a9e9afdc843646768800da2ede466298` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:24.853204 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a833f2-e377-401d-ba24-6b1a986fcad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e9afdc843646768800da2ede466298)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:24.855128 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a833f2-e377-401d-ba24-6b1a986fcad4 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:24.935197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c1a833f2-e377-401d-ba24-6b1a986fcad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e9afdc843646768800da2ede466298', 'request_id': 'req-c1a833f2-e377-401d-ba24-6b1a986fcad4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:24.988264 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c1a833f2-e377-401d-ba24-6b1a986fcad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e9afdc843646768800da2ede466298', 'request_id': 'req-c1a833f2-e377-401d-ba24-6b1a986fcad4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:24.994666 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c1a833f2-e377-401d-ba24-6b1a986fcad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e9afdc843646768800da2ede466298', 'request_id': 'req-c1a833f2-e377-401d-ba24-6b1a986fcad4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:25.005208 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c1a833f2-e377-401d-ba24-6b1a986fcad4 admin admin] The token cache is being invalidate because project a9e9afdc843646768800da2ede466298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:12:25.005500 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c1a833f2-e377-401d-ba24-6b1a986fcad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:25.006248 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c1a833f2-e377-401d-ba24-6b1a986fcad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:25.007676 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1376/2796] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:12:24 2022] DELETE /identity/v3/projects/a9e9afdc843646768800da2ede466298 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:25.012843 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a76cbc-9936-4c53-ad5e-5a6a57907ec1 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:25.013146 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a76cbc-9936-4c53-ad5e-5a6a57907ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:25.013429 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a76cbc-9936-4c53-ad5e-5a6a57907ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:25.033109 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-d8a76cbc-9936-4c53-ad5e-5a6a57907ec1 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:12:25.034320 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d8a76cbc-9936-4c53-ad5e-5a6a57907ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:25.093821 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1421/2797] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:12:25.101457 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00319c-2a20-4c08-99f0-d42822049065 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:25.101750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00319c-2a20-4c08-99f0-d42822049065 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:25.102029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00319c-2a20-4c08-99f0-d42822049065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:25.120842 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-0d00319c-2a20-4c08-99f0-d42822049065 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:12:25.122042 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0d00319c-2a20-4c08-99f0-d42822049065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:25.129896 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1377/2798] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:12:25.134008 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a76cbc-9936-4c53-ad5e-5a6a57907ec1 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:25.143596 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a76cbc-9936-4c53-ad5e-5a6a57907ec1 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:25.148116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d74e3-9c7c-4cf0-a081-24e89bccc6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:25.148788 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d74e3-9c7c-4cf0-a081-24e89bccc6fe admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:25.149070 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d74e3-9c7c-4cf0-a081-24e89bccc6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:25.149344 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d74e3-9c7c-4cf0-a081-24e89bccc6fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:25.150065 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d74e3-9c7c-4cf0-a081-24e89bccc6fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:12:25.150371 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d74e3-9c7c-4cf0-a081-24e89bccc6fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:25.152480 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d74e3-9c7c-4cf0-a081-24e89bccc6fe admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:25.163732 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1422/2799] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:12:25.168612 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00319c-2a20-4c08-99f0-d42822049065 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:25.177684 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00319c-2a20-4c08-99f0-d42822049065 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:25.182291 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00965ff1-cff4-4ae9-9ed7-39bf538634d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:25.182934 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00965ff1-cff4-4ae9-9ed7-39bf538634d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:25.183246 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00965ff1-cff4-4ae9-9ed7-39bf538634d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:25.183527 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00965ff1-cff4-4ae9-9ed7-39bf538634d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:25.184217 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00965ff1-cff4-4ae9-9ed7-39bf538634d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:25.186199 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00965ff1-cff4-4ae9-9ed7-39bf538634d2 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:25.275280 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1378/2800] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:12:25 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:12:25.279837 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d74e3-9c7c-4cf0-a081-24e89bccc6fe admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:25.289811 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d74e3-9c7c-4cf0-a081-24e89bccc6fe admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:25.351203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a95520-1a48-4258-85cd-221a3e76a5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:25.351870 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a95520-1a48-4258-85cd-221a3e76a5cc admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:25.352151 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a95520-1a48-4258-85cd-221a3e76a5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:25.352429 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a95520-1a48-4258-85cd-221a3e76a5cc admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:25.353156 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a95520-1a48-4258-85cd-221a3e76a5cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:25.355698 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a95520-1a48-4258-85cd-221a3e76a5cc admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:25.362411 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:25.455342 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1423/2801] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:12:25 2022] POST /identity/v3/users => generated 284 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:12:25.459373 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00965ff1-cff4-4ae9-9ed7-39bf538634d2 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:25.470478 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00965ff1-cff4-4ae9-9ed7-39bf538634d2 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:25.475227 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1472023-c0c7-476e-9898-c9864c1b7bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:25.475901 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1472023-c0c7-476e-9898-c9864c1b7bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:25.476170 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1472023-c0c7-476e-9898-c9864c1b7bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:25.476452 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1472023-c0c7-476e-9898-c9864c1b7bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:25.477214 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1472023-c0c7-476e-9898-c9864c1b7bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:25.478932 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1472023-c0c7-476e-9898-c9864c1b7bd8 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:25.489506 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1379/2802] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:12:25.493229 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a95520-1a48-4258-85cd-221a3e76a5cc admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:25.503163 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a95520-1a48-4258-85cd-221a3e76a5cc admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:25.508041 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d10f6-0daf-4c46-b1e3-e32ccedf3a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:25.508730 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d10f6-0daf-4c46-b1e3-e32ccedf3a04 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:25.509013 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d10f6-0daf-4c46-b1e3-e32ccedf3a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:25.509288 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d10f6-0daf-4c46-b1e3-e32ccedf3a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:25.510010 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d10f6-0daf-4c46-b1e3-e32ccedf3a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:25.512145 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d10f6-0daf-4c46-b1e3-e32ccedf3a04 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:25.523234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1424/2803] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:12:25.532470 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1472023-c0c7-476e-9898-c9864c1b7bd8 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:25.542203 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1472023-c0c7-476e-9898-c9864c1b7bd8 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:25.546776 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042aa9bf-431d-49dd-9c31-cc85b3bc9374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:25.547654 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042aa9bf-431d-49dd-9c31-cc85b3bc9374 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:25.547934 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042aa9bf-431d-49dd-9c31-cc85b3bc9374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:25.548207 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042aa9bf-431d-49dd-9c31-cc85b3bc9374 admin admin] PATH_INFO: `/v3/projects/5097a1a94b4c472b87d3eccb314c66ae/users/1b9f47c29b23425f8d2e7b14cf85343c/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:25.563766 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042aa9bf-431d-49dd-9c31-cc85b3bc9374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5097a1a94b4c472b87d3eccb314c66ae, user_id=1b9f47c29b23425f8d2e7b14cf85343c, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:25.566433 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042aa9bf-431d-49dd-9c31-cc85b3bc9374 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:25.627688 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1380/2804] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:12:25 2022] PUT /identity/v3/projects/5097a1a94b4c472b87d3eccb314c66ae/users/1b9f47c29b23425f8d2e7b14cf85343c/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:25.638044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98cdd6-60d3-4b03-a4fc-47963c495895 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:25.638334 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98cdd6-60d3-4b03-a4fc-47963c495895 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:25.638702 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98cdd6-60d3-4b03-a4fc-47963c495895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:25.665221 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-1e98cdd6-60d3-4b03-a4fc-47963c495895 None None] MFA Rules not processed for user `1b9f47c29b23425f8d2e7b14cf85343c`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:12:25.666438 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1e98cdd6-60d3-4b03-a4fc-47963c495895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:25.728932 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1425/2805] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:12:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:12:25.739853 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042aa9bf-431d-49dd-9c31-cc85b3bc9374 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:25.741605 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-042aa9bf-431d-49dd-9c31-cc85b3bc9374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:25.748685 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:25.797421 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042aa9bf-431d-49dd-9c31-cc85b3bc9374 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:25.801109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4d330-8745-44f0-88e0-a4ae6febe35f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:25.801993 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4d330-8745-44f0-88e0-a4ae6febe35f service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:25.802287 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4d330-8745-44f0-88e0-a4ae6febe35f service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:25.802563 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4d330-8745-44f0-88e0-a4ae6febe35f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:25.811286 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4d330-8745-44f0-88e0-a4ae6febe35f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:25.812871 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4d330-8745-44f0-88e0-a4ae6febe35f service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:25.821727 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1381/2806] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:12:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:12:35.554127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98cdd6-60d3-4b03-a4fc-47963c495895 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:35.615246 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98cdd6-60d3-4b03-a4fc-47963c495895 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:35.619633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6528dff-dc4f-4e5d-b233-763d4f69f768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:35.620504 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6528dff-dc4f-4e5d-b233-763d4f69f768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:35.621327 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6528dff-dc4f-4e5d-b233-763d4f69f768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:35.621602 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6528dff-dc4f-4e5d-b233-763d4f69f768 admin admin] PATH_INFO: `/v3/users/1b9f47c29b23425f8d2e7b14cf85343c` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:35.622771 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6528dff-dc4f-4e5d-b233-763d4f69f768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9f47c29b23425f8d2e7b14cf85343c)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:35.624723 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6528dff-dc4f-4e5d-b233-763d4f69f768 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:35.805203 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d6528dff-dc4f-4e5d-b233-763d4f69f768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9f47c29b23425f8d2e7b14cf85343c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:35.812828 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d6528dff-dc4f-4e5d-b233-763d4f69f768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9f47c29b23425f8d2e7b14cf85343c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:35.813503 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d6528dff-dc4f-4e5d-b233-763d4f69f768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9f47c29b23425f8d2e7b14cf85343c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:35.814122 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d6528dff-dc4f-4e5d-b233-763d4f69f768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9f47c29b23425f8d2e7b14cf85343c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:35.825091 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:35.827525 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d6528dff-dc4f-4e5d-b233-763d4f69f768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9f47c29b23425f8d2e7b14cf85343c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:35.851196 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=24 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:35.891163 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1426/2807] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:12:35 2022] DELETE /identity/v3/users/1b9f47c29b23425f8d2e7b14cf85343c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:35.895496 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcb81c-f7d2-480d-a868-43392cd6cf2a None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:35.895785 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcb81c-f7d2-480d-a868-43392cd6cf2a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:35.896064 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcb81c-f7d2-480d-a868-43392cd6cf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:35.912826 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-10dcb81c-f7d2-480d-a868-43392cd6cf2a None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:12:35.914052 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-10dcb81c-f7d2-480d-a868-43392cd6cf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:35.972858 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1382/2808] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:12:35.983381 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6528dff-dc4f-4e5d-b233-763d4f69f768 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:35.984880 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d6528dff-dc4f-4e5d-b233-763d4f69f768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:36.041532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6528dff-dc4f-4e5d-b233-763d4f69f768 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:36.045653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7319a-3965-4fc7-a2ad-4ace3f1bf7fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:36.046295 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7319a-3965-4fc7-a2ad-4ace3f1bf7fc service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:36.046574 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7319a-3965-4fc7-a2ad-4ace3f1bf7fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:36.046851 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7319a-3965-4fc7-a2ad-4ace3f1bf7fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:36.055966 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7319a-3965-4fc7-a2ad-4ace3f1bf7fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:36.057429 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7319a-3965-4fc7-a2ad-4ace3f1bf7fc service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:36.066977 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1427/2809] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:12:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:12:36.444038 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcb81c-f7d2-480d-a868-43392cd6cf2a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:36.445562 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-10dcb81c-f7d2-480d-a868-43392cd6cf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:36.463061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcb81c-f7d2-480d-a868-43392cd6cf2a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:36.467170 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b3afb-8994-43dd-8eda-92b6debf7a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:36.468028 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b3afb-8994-43dd-8eda-92b6debf7a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:36.468309 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b3afb-8994-43dd-8eda-92b6debf7a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:36.468599 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b3afb-8994-43dd-8eda-92b6debf7a49 admin admin] PATH_INFO: `/v3/projects/5097a1a94b4c472b87d3eccb314c66ae` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:36.469800 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b3afb-8994-43dd-8eda-92b6debf7a49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5097a1a94b4c472b87d3eccb314c66ae)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:36.471717 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b3afb-8994-43dd-8eda-92b6debf7a49 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:36.592367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d65b3afb-8994-43dd-8eda-92b6debf7a49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5097a1a94b4c472b87d3eccb314c66ae', 'request_id': 'req-d65b3afb-8994-43dd-8eda-92b6debf7a49'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:36.648736 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d65b3afb-8994-43dd-8eda-92b6debf7a49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5097a1a94b4c472b87d3eccb314c66ae', 'request_id': 'req-d65b3afb-8994-43dd-8eda-92b6debf7a49'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:36.655708 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d65b3afb-8994-43dd-8eda-92b6debf7a49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5097a1a94b4c472b87d3eccb314c66ae', 'request_id': 'req-d65b3afb-8994-43dd-8eda-92b6debf7a49'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:36.666324 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d65b3afb-8994-43dd-8eda-92b6debf7a49 admin admin] The token cache is being invalidate because project 5097a1a94b4c472b87d3eccb314c66ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:12:36.666619 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d65b3afb-8994-43dd-8eda-92b6debf7a49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:36.667228 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d65b3afb-8994-43dd-8eda-92b6debf7a49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:36.669307 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1383/2810] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:12:36 2022] DELETE /identity/v3/projects/5097a1a94b4c472b87d3eccb314c66ae => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:36.674965 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1847682-c8b4-42bf-9af2-1537623a7d75 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:36.675430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1847682-c8b4-42bf-9af2-1537623a7d75 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:36.675541 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1847682-c8b4-42bf-9af2-1537623a7d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:36.694235 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-f1847682-c8b4-42bf-9af2-1537623a7d75 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:12:36.695411 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f1847682-c8b4-42bf-9af2-1537623a7d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:36.756535 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1428/2811] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:12:36.765720 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cc826-3dc4-4aa8-92bf-611799ddb7c3 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:36.766016 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cc826-3dc4-4aa8-92bf-611799ddb7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:36.766299 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cc826-3dc4-4aa8-92bf-611799ddb7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:36.784763 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-a12cc826-3dc4-4aa8-92bf-611799ddb7c3 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:12:36.785989 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a12cc826-3dc4-4aa8-92bf-611799ddb7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:36.795663 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1384/2812] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:12:36.799874 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1847682-c8b4-42bf-9af2-1537623a7d75 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:36.810836 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1847682-c8b4-42bf-9af2-1537623a7d75 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:36.815564 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb03180-07e8-4216-b2b4-ca94ac7ec7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:36.816219 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb03180-07e8-4216-b2b4-ca94ac7ec7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:36.816500 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb03180-07e8-4216-b2b4-ca94ac7ec7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:36.818962 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb03180-07e8-4216-b2b4-ca94ac7ec7b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:36.818962 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb03180-07e8-4216-b2b4-ca94ac7ec7b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:12:36.818962 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb03180-07e8-4216-b2b4-ca94ac7ec7b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:36.819603 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb03180-07e8-4216-b2b4-ca94ac7ec7b9 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:36.832261 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1429/2813] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:12:36.836544 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cc826-3dc4-4aa8-92bf-611799ddb7c3 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:36.845866 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cc826-3dc4-4aa8-92bf-611799ddb7c3 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:36.850668 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a256a56-7f93-4422-a676-c31bbf278e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:36.851336 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a256a56-7f93-4422-a676-c31bbf278e78 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:36.851902 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a256a56-7f93-4422-a676-c31bbf278e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:36.851902 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a256a56-7f93-4422-a676-c31bbf278e78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:36.852615 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a256a56-7f93-4422-a676-c31bbf278e78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:36.854595 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a256a56-7f93-4422-a676-c31bbf278e78 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:36.936153 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1385/2814] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:12:36 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:12:36.940261 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb03180-07e8-4216-b2b4-ca94ac7ec7b9 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:36.950320 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb03180-07e8-4216-b2b4-ca94ac7ec7b9 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:37.005691 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa49ce-b54c-466f-8624-6279837b6e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:37.006359 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa49ce-b54c-466f-8624-6279837b6e65 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:37.006643 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa49ce-b54c-466f-8624-6279837b6e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:37.006919 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa49ce-b54c-466f-8624-6279837b6e65 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:37.007602 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa49ce-b54c-466f-8624-6279837b6e65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:37.009570 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa49ce-b54c-466f-8624-6279837b6e65 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:37.097624 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1430/2815] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:12:36 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:12:37.101638 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a256a56-7f93-4422-a676-c31bbf278e78 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:37.112803 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a256a56-7f93-4422-a676-c31bbf278e78 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:37.117402 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b31fac-ac12-44ad-9395-779bd88dd062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:37.118028 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b31fac-ac12-44ad-9395-779bd88dd062 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:37.118309 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b31fac-ac12-44ad-9395-779bd88dd062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:37.118581 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b31fac-ac12-44ad-9395-779bd88dd062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:37.119292 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b31fac-ac12-44ad-9395-779bd88dd062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:37.120909 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b31fac-ac12-44ad-9395-779bd88dd062 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:37.131080 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1386/2816] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:12:37.134889 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa49ce-b54c-466f-8624-6279837b6e65 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:37.144912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa49ce-b54c-466f-8624-6279837b6e65 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:37.149522 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce181f-5234-4bb7-90be-c315e6ff30cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:37.150178 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce181f-5234-4bb7-90be-c315e6ff30cc admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:37.150493 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce181f-5234-4bb7-90be-c315e6ff30cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:37.150774 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce181f-5234-4bb7-90be-c315e6ff30cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:37.151494 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce181f-5234-4bb7-90be-c315e6ff30cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:37.153656 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce181f-5234-4bb7-90be-c315e6ff30cc admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:37.154890 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:37.165925 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1431/2817] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:12:37.170334 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b31fac-ac12-44ad-9395-779bd88dd062 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:37.180121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b31fac-ac12-44ad-9395-779bd88dd062 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:37.184660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece4cb7-46b3-46b1-bfb6-913edee78b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:37.185519 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece4cb7-46b3-46b1-bfb6-913edee78b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:37.185797 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece4cb7-46b3-46b1-bfb6-913edee78b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:37.186069 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece4cb7-46b3-46b1-bfb6-913edee78b61 admin admin] PATH_INFO: `/v3/projects/1a7bde2dfd1b41bbaad98e8cb325c8c2/users/1333b2fbce214f738b760bc40104299f/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:37.200285 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece4cb7-46b3-46b1-bfb6-913edee78b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a7bde2dfd1b41bbaad98e8cb325c8c2, user_id=1333b2fbce214f738b760bc40104299f, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:37.203076 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece4cb7-46b3-46b1-bfb6-913edee78b61 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:37.290711 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1387/2818] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:12:37 2022] PUT /identity/v3/projects/1a7bde2dfd1b41bbaad98e8cb325c8c2/users/1333b2fbce214f738b760bc40104299f/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:37.301762 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59020e4e-90fb-45bf-83b1-25eceeb5e7b2 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:37.302059 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59020e4e-90fb-45bf-83b1-25eceeb5e7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:37.306822 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59020e4e-90fb-45bf-83b1-25eceeb5e7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:37.450005 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-59020e4e-90fb-45bf-83b1-25eceeb5e7b2 None None] MFA Rules not processed for user `1333b2fbce214f738b760bc40104299f`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:12:37.451230 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-59020e4e-90fb-45bf-83b1-25eceeb5e7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:37.512921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1432/2819] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:12:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:12:37.517455 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece4cb7-46b3-46b1-bfb6-913edee78b61 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:37.538471 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:37.578639 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece4cb7-46b3-46b1-bfb6-913edee78b61 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:37.583222 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa051b-8228-4661-872f-cc69b9519d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:37.588792 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa051b-8228-4661-872f-cc69b9519d77 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:37.588792 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa051b-8228-4661-872f-cc69b9519d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:37.588792 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa051b-8228-4661-872f-cc69b9519d77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:37.588792 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa051b-8228-4661-872f-cc69b9519d77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:37.588792 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa051b-8228-4661-872f-cc69b9519d77 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:37.705247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1388/2820] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:12:37 2022] POST /identity/v3/projects => generated 379 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:12:37.709211 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59020e4e-90fb-45bf-83b1-25eceeb5e7b2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:37.720037 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59020e4e-90fb-45bf-83b1-25eceeb5e7b2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:37.777673 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1dc42-12d0-41f9-b932-371f59db39be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:37.778362 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1dc42-12d0-41f9-b932-371f59db39be admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:37.778645 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1dc42-12d0-41f9-b932-371f59db39be admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:37.778921 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1dc42-12d0-41f9-b932-371f59db39be admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:37.779606 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1dc42-12d0-41f9-b932-371f59db39be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:37.781602 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1dc42-12d0-41f9-b932-371f59db39be admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:37.856754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1433/2821] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:12:37 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:12:37.860898 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa051b-8228-4661-872f-cc69b9519d77 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:37.871563 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa051b-8228-4661-872f-cc69b9519d77 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:37.876774 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef2466-f373-4db2-b535-3ed17d4d28e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:37.877518 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef2466-f373-4db2-b535-3ed17d4d28e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:37.877808 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef2466-f373-4db2-b535-3ed17d4d28e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:37.878121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef2466-f373-4db2-b535-3ed17d4d28e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:37.878848 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef2466-f373-4db2-b535-3ed17d4d28e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:37.880453 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef2466-f373-4db2-b535-3ed17d4d28e4 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:37.891789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1389/2822] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:12:37.895727 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1dc42-12d0-41f9-b932-371f59db39be admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:37.905532 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1dc42-12d0-41f9-b932-371f59db39be admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:37.910055 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce8537-7099-4aa6-b864-103530f5b383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:37.910707 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce8537-7099-4aa6-b864-103530f5b383 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:37.910986 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce8537-7099-4aa6-b864-103530f5b383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:37.911258 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce8537-7099-4aa6-b864-103530f5b383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:37.911973 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce8537-7099-4aa6-b864-103530f5b383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:37.913585 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce8537-7099-4aa6-b864-103530f5b383 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:37.923226 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1434/2823] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:12:37.927030 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef2466-f373-4db2-b535-3ed17d4d28e4 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:37.937321 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef2466-f373-4db2-b535-3ed17d4d28e4 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:37.941953 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b32bb-eb08-48fd-9b67-940f5aa7ca7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:37.942822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b32bb-eb08-48fd-9b67-940f5aa7ca7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:37.943111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b32bb-eb08-48fd-9b67-940f5aa7ca7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:37.943388 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b32bb-eb08-48fd-9b67-940f5aa7ca7b admin admin] PATH_INFO: `/v3/projects/4062c0b7c08844228623719d21976be1/users/8b7497a4628c4aaeb33c0c462920df52/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:37.958304 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b32bb-eb08-48fd-9b67-940f5aa7ca7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4062c0b7c08844228623719d21976be1, user_id=8b7497a4628c4aaeb33c0c462920df52, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:37.960985 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b32bb-eb08-48fd-9b67-940f5aa7ca7b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:38.074163 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1390/2824] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:12:37 2022] PUT /identity/v3/projects/4062c0b7c08844228623719d21976be1/users/8b7497a4628c4aaeb33c0c462920df52/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:38.084401 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27463f41-7d12-45bd-9170-43fc9de3919f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:38.084721 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27463f41-7d12-45bd-9170-43fc9de3919f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:38.085023 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27463f41-7d12-45bd-9170-43fc9de3919f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:38.111893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-27463f41-7d12-45bd-9170-43fc9de3919f None None] MFA Rules not processed for user `8b7497a4628c4aaeb33c0c462920df52`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:12:38.113194 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-27463f41-7d12-45bd-9170-43fc9de3919f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:38.166610 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:38.176812 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1435/2825] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:12:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:12:38.181325 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b32bb-eb08-48fd-9b67-940f5aa7ca7b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:38.242647 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b32bb-eb08-48fd-9b67-940f5aa7ca7b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:38.247872 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d209fd-ac06-4523-abac-4e626bc92b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:38.248523 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d209fd-ac06-4523-abac-4e626bc92b56 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:38.248852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d209fd-ac06-4523-abac-4e626bc92b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:38.249133 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d209fd-ac06-4523-abac-4e626bc92b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:38.249829 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d209fd-ac06-4523-abac-4e626bc92b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:38.251782 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d209fd-ac06-4523-abac-4e626bc92b56 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:38.331729 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1391/2826] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:12:38 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:12:38.335870 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27463f41-7d12-45bd-9170-43fc9de3919f None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:38.346701 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27463f41-7d12-45bd-9170-43fc9de3919f None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:38.401481 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19189659-8cf5-4c18-a11d-08d602175a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:38.402145 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19189659-8cf5-4c18-a11d-08d602175a13 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:38.402426 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19189659-8cf5-4c18-a11d-08d602175a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:38.402700 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19189659-8cf5-4c18-a11d-08d602175a13 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:38.403924 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19189659-8cf5-4c18-a11d-08d602175a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:38.405856 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19189659-8cf5-4c18-a11d-08d602175a13 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:38.528143 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1436/2827] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:12:38 2022] POST /identity/v3/users => generated 295 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:12:38.532560 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d209fd-ac06-4523-abac-4e626bc92b56 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:38.542750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d209fd-ac06-4523-abac-4e626bc92b56 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:38.547924 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da97d3b-062a-44aa-805f-543c04f9b51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:38.548572 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da97d3b-062a-44aa-805f-543c04f9b51b admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:38.548887 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da97d3b-062a-44aa-805f-543c04f9b51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:38.549165 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da97d3b-062a-44aa-805f-543c04f9b51b admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:38.549887 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da97d3b-062a-44aa-805f-543c04f9b51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:38.551475 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da97d3b-062a-44aa-805f-543c04f9b51b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:38.562172 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1392/2828] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:12:38.565848 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19189659-8cf5-4c18-a11d-08d602175a13 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:38.575630 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19189659-8cf5-4c18-a11d-08d602175a13 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:38.580118 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626c770-31f4-45aa-957c-0a0c25c2fd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:38.581017 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626c770-31f4-45aa-957c-0a0c25c2fd2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:38.581300 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626c770-31f4-45aa-957c-0a0c25c2fd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:38.581575 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626c770-31f4-45aa-957c-0a0c25c2fd2c admin admin] PATH_INFO: `/v3/projects/223c73d554ac4b73bad6766ac5659e0e/users/8c2d56ac3b9243fb9be0540909445e86/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:38.596405 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626c770-31f4-45aa-957c-0a0c25c2fd2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=223c73d554ac4b73bad6766ac5659e0e, user_id=8c2d56ac3b9243fb9be0540909445e86, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:38.599025 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626c770-31f4-45aa-957c-0a0c25c2fd2c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:38.808719 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1437/2829] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:12:38 2022] PUT /identity/v3/projects/223c73d554ac4b73bad6766ac5659e0e/users/8c2d56ac3b9243fb9be0540909445e86/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:38.812600 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da97d3b-062a-44aa-805f-543c04f9b51b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:38.823314 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da97d3b-062a-44aa-805f-543c04f9b51b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:38.867082 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:38.881247 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76af79-2d8b-491a-9f4a-40ccaad3bf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:38.881914 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76af79-2d8b-491a-9f4a-40ccaad3bf79 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:38.882197 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76af79-2d8b-491a-9f4a-40ccaad3bf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:38.882468 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76af79-2d8b-491a-9f4a-40ccaad3bf79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:38.883186 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76af79-2d8b-491a-9f4a-40ccaad3bf79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:38.884805 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76af79-2d8b-491a-9f4a-40ccaad3bf79 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:38.895465 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1393/2830] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 13:12:38.899297 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626c770-31f4-45aa-957c-0a0c25c2fd2c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:38.911228 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626c770-31f4-45aa-957c-0a0c25c2fd2c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:38.915912 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e35374-1d22-454d-a01c-500a3f392ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:38.916957 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e35374-1d22-454d-a01c-500a3f392ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:38.917262 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e35374-1d22-454d-a01c-500a3f392ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:38.917541 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e35374-1d22-454d-a01c-500a3f392ccc admin admin] PATH_INFO: `/v3/projects/223c73d554ac4b73bad6766ac5659e0e/users/8c2d56ac3b9243fb9be0540909445e86/roles/868c7a356c674ded875dd079f5a9f5e0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:38.919651 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e35374-1d22-454d-a01c-500a3f392ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=223c73d554ac4b73bad6766ac5659e0e, user_id=8c2d56ac3b9243fb9be0540909445e86, role_id=868c7a356c674ded875dd079f5a9f5e0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:38.922381 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e35374-1d22-454d-a01c-500a3f392ccc admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:38.933369 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1438/2831] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:12:38 2022] PUT /identity/v3/projects/223c73d554ac4b73bad6766ac5659e0e/users/8c2d56ac3b9243fb9be0540909445e86/roles/868c7a356c674ded875dd079f5a9f5e0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:12:38.943383 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2b6f8-e24f-46f4-b6a7-c640b529211d None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:38.943671 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2b6f8-e24f-46f4-b6a7-c640b529211d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:38.943948 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2b6f8-e24f-46f4-b6a7-c640b529211d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:38.972824 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-1cb2b6f8-e24f-46f4-b6a7-c640b529211d None None] MFA Rules not processed for user `8c2d56ac3b9243fb9be0540909445e86`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:12:38.974149 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1cb2b6f8-e24f-46f4-b6a7-c640b529211d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:39.040170 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1394/2832] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:12:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:12:39.051415 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e35374-1d22-454d-a01c-500a3f392ccc admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:39.053391 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-64e35374-1d22-454d-a01c-500a3f392ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:39.110521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e35374-1d22-454d-a01c-500a3f392ccc admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:39.114096 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a93f4-a510-4e3a-af95-1461910b7b38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:39.114739 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a93f4-a510-4e3a-af95-1461910b7b38 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:39.115024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a93f4-a510-4e3a-af95-1461910b7b38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:39.115302 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a93f4-a510-4e3a-af95-1461910b7b38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:39.124186 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a93f4-a510-4e3a-af95-1461910b7b38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:39.125606 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a93f4-a510-4e3a-af95-1461910b7b38 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:39.135023 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1439/2833] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:12:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:12:39.223104 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2b6f8-e24f-46f4-b6a7-c640b529211d None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:39.224499 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1cb2b6f8-e24f-46f4-b6a7-c640b529211d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:39.236563 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2b6f8-e24f-46f4-b6a7-c640b529211d None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:39.240085 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb51d0-7c1d-4fb5-9c82-6210e261a62b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:39.240749 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb51d0-7c1d-4fb5-9c82-6210e261a62b service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:39.241029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb51d0-7c1d-4fb5-9c82-6210e261a62b service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:39.241304 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb51d0-7c1d-4fb5-9c82-6210e261a62b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:39.297012 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb51d0-7c1d-4fb5-9c82-6210e261a62b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:39.298452 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb51d0-7c1d-4fb5-9c82-6210e261a62b service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:39.307254 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1395/2834] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:12:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:12:43.166020 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a93f4-a510-4e3a-af95-1461910b7b38 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:43.218249 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:43.233257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a93f4-a510-4e3a-af95-1461910b7b38 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:43.237904 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540da3ba-e896-4c66-8e59-a878d7c9adfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:43.238779 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540da3ba-e896-4c66-8e59-a878d7c9adfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:43.239068 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540da3ba-e896-4c66-8e59-a878d7c9adfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:43.239329 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540da3ba-e896-4c66-8e59-a878d7c9adfb admin admin] PATH_INFO: `/v3/users/1333b2fbce214f738b760bc40104299f` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:43.240511 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540da3ba-e896-4c66-8e59-a878d7c9adfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1333b2fbce214f738b760bc40104299f)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:43.242521 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540da3ba-e896-4c66-8e59-a878d7c9adfb admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:43.482069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-540da3ba-e896-4c66-8e59-a878d7c9adfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1333b2fbce214f738b760bc40104299f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:43.488835 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-540da3ba-e896-4c66-8e59-a878d7c9adfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1333b2fbce214f738b760bc40104299f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:43.489553 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-540da3ba-e896-4c66-8e59-a878d7c9adfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1333b2fbce214f738b760bc40104299f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:43.490430 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-540da3ba-e896-4c66-8e59-a878d7c9adfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1333b2fbce214f738b760bc40104299f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:43.502587 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-540da3ba-e896-4c66-8e59-a878d7c9adfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1333b2fbce214f738b760bc40104299f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:43.614567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1440/2835] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:12:43 2022] DELETE /identity/v3/users/1333b2fbce214f738b760bc40104299f => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:43.619157 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673a61a-01ad-4b9d-a620-296824f6b762 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:43.619660 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673a61a-01ad-4b9d-a620-296824f6b762 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:43.619784 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673a61a-01ad-4b9d-a620-296824f6b762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:43.636615 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e673a61a-01ad-4b9d-a620-296824f6b762 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:12:43.638383 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e673a61a-01ad-4b9d-a620-296824f6b762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:43.698249 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1396/2836] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:12:43.708522 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540da3ba-e896-4c66-8e59-a878d7c9adfb admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:43.710143 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-540da3ba-e896-4c66-8e59-a878d7c9adfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:43.770338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540da3ba-e896-4c66-8e59-a878d7c9adfb admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:43.773826 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dfc94-adda-4adc-b50d-b35182dbd015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:43.774468 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dfc94-adda-4adc-b50d-b35182dbd015 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:43.774749 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dfc94-adda-4adc-b50d-b35182dbd015 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:43.775024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dfc94-adda-4adc-b50d-b35182dbd015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:43.783879 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dfc94-adda-4adc-b50d-b35182dbd015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:43.785339 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dfc94-adda-4adc-b50d-b35182dbd015 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:43.794633 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1441/2837] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:12:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:12:44.212419 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673a61a-01ad-4b9d-a620-296824f6b762 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:44.213913 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e673a61a-01ad-4b9d-a620-296824f6b762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:44.222607 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:44.226130 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673a61a-01ad-4b9d-a620-296824f6b762 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:44.230713 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae03e5-6fa6-4f53-8e86-1477cf06cf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:44.232340 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae03e5-6fa6-4f53-8e86-1477cf06cf6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:44.232652 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae03e5-6fa6-4f53-8e86-1477cf06cf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:44.232928 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae03e5-6fa6-4f53-8e86-1477cf06cf6f admin admin] PATH_INFO: `/v3/projects/1a7bde2dfd1b41bbaad98e8cb325c8c2` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:44.234109 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae03e5-6fa6-4f53-8e86-1477cf06cf6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a7bde2dfd1b41bbaad98e8cb325c8c2)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:44.236026 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae03e5-6fa6-4f53-8e86-1477cf06cf6f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:44.359767 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-04ae03e5-6fa6-4f53-8e86-1477cf06cf6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a7bde2dfd1b41bbaad98e8cb325c8c2', 'request_id': 'req-04ae03e5-6fa6-4f53-8e86-1477cf06cf6f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:44.413768 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-04ae03e5-6fa6-4f53-8e86-1477cf06cf6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a7bde2dfd1b41bbaad98e8cb325c8c2', 'request_id': 'req-04ae03e5-6fa6-4f53-8e86-1477cf06cf6f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:44.421241 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-04ae03e5-6fa6-4f53-8e86-1477cf06cf6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a7bde2dfd1b41bbaad98e8cb325c8c2', 'request_id': 'req-04ae03e5-6fa6-4f53-8e86-1477cf06cf6f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:44.432015 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-04ae03e5-6fa6-4f53-8e86-1477cf06cf6f admin admin] The token cache is being invalidate because project 1a7bde2dfd1b41bbaad98e8cb325c8c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:12:44.432307 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-04ae03e5-6fa6-4f53-8e86-1477cf06cf6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:44.432971 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-04ae03e5-6fa6-4f53-8e86-1477cf06cf6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:44.434560 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1397/2838] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:12:44 2022] DELETE /identity/v3/projects/1a7bde2dfd1b41bbaad98e8cb325c8c2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:44.438627 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dfc94-adda-4adc-b50d-b35182dbd015 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:44.448142 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dfc94-adda-4adc-b50d-b35182dbd015 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:44.502829 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67a3d8-522e-4a28-b05d-8fed54006560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:44.503692 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67a3d8-522e-4a28-b05d-8fed54006560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:44.503974 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67a3d8-522e-4a28-b05d-8fed54006560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:44.504251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67a3d8-522e-4a28-b05d-8fed54006560 admin admin] PATH_INFO: `/v3/users/8b7497a4628c4aaeb33c0c462920df52` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:44.505457 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67a3d8-522e-4a28-b05d-8fed54006560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b7497a4628c4aaeb33c0c462920df52)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:44.507387 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67a3d8-522e-4a28-b05d-8fed54006560 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:44.519248 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:44.695327 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-db67a3d8-522e-4a28-b05d-8fed54006560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b7497a4628c4aaeb33c0c462920df52'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:44.702087 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-db67a3d8-522e-4a28-b05d-8fed54006560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b7497a4628c4aaeb33c0c462920df52'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:44.702746 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-db67a3d8-522e-4a28-b05d-8fed54006560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b7497a4628c4aaeb33c0c462920df52'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:44.703351 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-db67a3d8-522e-4a28-b05d-8fed54006560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b7497a4628c4aaeb33c0c462920df52'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:44.716234 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-db67a3d8-522e-4a28-b05d-8fed54006560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b7497a4628c4aaeb33c0c462920df52'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:44.846063 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1442/2839] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:12:44 2022] DELETE /identity/v3/users/8b7497a4628c4aaeb33c0c462920df52 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:45.250540 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae03e5-6fa6-4f53-8e86-1477cf06cf6f admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:45.252044 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-04ae03e5-6fa6-4f53-8e86-1477cf06cf6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:45.266369 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae03e5-6fa6-4f53-8e86-1477cf06cf6f admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:45.323336 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb49707-60b5-4d61-a579-11e5bb3df263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:45.324204 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb49707-60b5-4d61-a579-11e5bb3df263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:45.324488 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb49707-60b5-4d61-a579-11e5bb3df263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:45.324826 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb49707-60b5-4d61-a579-11e5bb3df263 admin admin] PATH_INFO: `/v3/projects/4062c0b7c08844228623719d21976be1` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:45.326649 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb49707-60b5-4d61-a579-11e5bb3df263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4062c0b7c08844228623719d21976be1)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:45.328569 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb49707-60b5-4d61-a579-11e5bb3df263 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:45.432498 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8fb49707-60b5-4d61-a579-11e5bb3df263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4062c0b7c08844228623719d21976be1', 'request_id': 'req-8fb49707-60b5-4d61-a579-11e5bb3df263'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:45.507250 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8fb49707-60b5-4d61-a579-11e5bb3df263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4062c0b7c08844228623719d21976be1', 'request_id': 'req-8fb49707-60b5-4d61-a579-11e5bb3df263'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:45.513718 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8fb49707-60b5-4d61-a579-11e5bb3df263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4062c0b7c08844228623719d21976be1', 'request_id': 'req-8fb49707-60b5-4d61-a579-11e5bb3df263'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:45.524129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8fb49707-60b5-4d61-a579-11e5bb3df263 admin admin] The token cache is being invalidate because project 4062c0b7c08844228623719d21976be1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:12:45.524423 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8fb49707-60b5-4d61-a579-11e5bb3df263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:45.525101 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8fb49707-60b5-4d61-a579-11e5bb3df263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:45.526641 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1398/2840] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:12:45 2022] DELETE /identity/v3/projects/4062c0b7c08844228623719d21976be1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:45.531129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67a3d8-522e-4a28-b05d-8fed54006560 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:45.532567 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-db67a3d8-522e-4a28-b05d-8fed54006560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:45.545654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67a3d8-522e-4a28-b05d-8fed54006560 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:45.600357 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24541120-fdf1-4281-85c6-219b8a3f9b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:45.601261 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24541120-fdf1-4281-85c6-219b8a3f9b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:45.601547 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24541120-fdf1-4281-85c6-219b8a3f9b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:45.601824 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24541120-fdf1-4281-85c6-219b8a3f9b49 admin admin] PATH_INFO: `/v3/users/8c2d56ac3b9243fb9be0540909445e86` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:45.603004 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24541120-fdf1-4281-85c6-219b8a3f9b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c2d56ac3b9243fb9be0540909445e86)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:45.604993 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24541120-fdf1-4281-85c6-219b8a3f9b49 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:45.749166 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-24541120-fdf1-4281-85c6-219b8a3f9b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c2d56ac3b9243fb9be0540909445e86'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:45.756170 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-24541120-fdf1-4281-85c6-219b8a3f9b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c2d56ac3b9243fb9be0540909445e86'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:45.756922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-24541120-fdf1-4281-85c6-219b8a3f9b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c2d56ac3b9243fb9be0540909445e86'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:45.757543 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-24541120-fdf1-4281-85c6-219b8a3f9b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c2d56ac3b9243fb9be0540909445e86'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:45.769894 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-24541120-fdf1-4281-85c6-219b8a3f9b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c2d56ac3b9243fb9be0540909445e86'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:45.873238 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1443/2841] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:12:45 2022] DELETE /identity/v3/users/8c2d56ac3b9243fb9be0540909445e86 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:46.298004 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb49707-60b5-4d61-a579-11e5bb3df263 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:46.300436 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8fb49707-60b5-4d61-a579-11e5bb3df263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:46.315122 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb49707-60b5-4d61-a579-11e5bb3df263 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:46.329554 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:46.371549 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370b285-5f07-464d-ba0e-ae36cccc679e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:46.372999 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370b285-5f07-464d-ba0e-ae36cccc679e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:46.373284 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370b285-5f07-464d-ba0e-ae36cccc679e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:46.373559 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370b285-5f07-464d-ba0e-ae36cccc679e admin admin] PATH_INFO: `/v3/projects/223c73d554ac4b73bad6766ac5659e0e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:46.374742 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370b285-5f07-464d-ba0e-ae36cccc679e admin admin] RBAC: Authorizing `identity:delete_project(project_id=223c73d554ac4b73bad6766ac5659e0e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:46.376722 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370b285-5f07-464d-ba0e-ae36cccc679e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:46.470459 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5370b285-5f07-464d-ba0e-ae36cccc679e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '223c73d554ac4b73bad6766ac5659e0e', 'request_id': 'req-5370b285-5f07-464d-ba0e-ae36cccc679e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:46.550890 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5370b285-5f07-464d-ba0e-ae36cccc679e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '223c73d554ac4b73bad6766ac5659e0e', 'request_id': 'req-5370b285-5f07-464d-ba0e-ae36cccc679e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:46.557097 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5370b285-5f07-464d-ba0e-ae36cccc679e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '223c73d554ac4b73bad6766ac5659e0e', 'request_id': 'req-5370b285-5f07-464d-ba0e-ae36cccc679e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:46.568005 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5370b285-5f07-464d-ba0e-ae36cccc679e admin admin] The token cache is being invalidate because project 223c73d554ac4b73bad6766ac5659e0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:12:46.568336 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5370b285-5f07-464d-ba0e-ae36cccc679e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:46.568963 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5370b285-5f07-464d-ba0e-ae36cccc679e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:46.570892 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1399/2842] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:12:46 2022] DELETE /identity/v3/projects/223c73d554ac4b73bad6766ac5659e0e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:46.576820 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf39ec-6097-40cf-a286-db767994c7e8 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:46.584839 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf39ec-6097-40cf-a286-db767994c7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:46.584839 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf39ec-6097-40cf-a286-db767994c7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:46.595230 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-7aaf39ec-6097-40cf-a286-db767994c7e8 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:12:46.596443 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7aaf39ec-6097-40cf-a286-db767994c7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:46.600808 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:46.656107 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1444/2843] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:12:46.664381 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d7e66-9d76-436c-87b4-4066d1bf45ed None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:46.664703 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d7e66-9d76-436c-87b4-4066d1bf45ed None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:46.665030 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d7e66-9d76-436c-87b4-4066d1bf45ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:46.683605 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-324d7e66-9d76-436c-87b4-4066d1bf45ed None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:12:46.684847 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-324d7e66-9d76-436c-87b4-4066d1bf45ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:46.692659 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1400/2844] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:12:46.696858 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf39ec-6097-40cf-a286-db767994c7e8 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:46.707330 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf39ec-6097-40cf-a286-db767994c7e8 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:46.712040 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe261cd3-0496-48f2-836f-c5f9c7fdda26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:46.712729 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe261cd3-0496-48f2-836f-c5f9c7fdda26 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:46.713014 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe261cd3-0496-48f2-836f-c5f9c7fdda26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:46.713290 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe261cd3-0496-48f2-836f-c5f9c7fdda26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:46.714018 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe261cd3-0496-48f2-836f-c5f9c7fdda26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:12:46.714327 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe261cd3-0496-48f2-836f-c5f9c7fdda26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:46.716512 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe261cd3-0496-48f2-836f-c5f9c7fdda26 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:46.728302 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1445/2845] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 13:12:46.733752 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d7e66-9d76-436c-87b4-4066d1bf45ed None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:46.743252 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d7e66-9d76-436c-87b4-4066d1bf45ed None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:46.748511 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce66f70-8fbb-4fcb-a09b-eda2b57f4381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:46.749186 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce66f70-8fbb-4fcb-a09b-eda2b57f4381 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:46.749469 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce66f70-8fbb-4fcb-a09b-eda2b57f4381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:46.749745 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce66f70-8fbb-4fcb-a09b-eda2b57f4381 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:46.750437 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce66f70-8fbb-4fcb-a09b-eda2b57f4381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:46.752393 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce66f70-8fbb-4fcb-a09b-eda2b57f4381 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:46.854043 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1401/2846] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:12:46 2022] POST /identity/v3/projects => generated 361 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:12:46.858227 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe261cd3-0496-48f2-836f-c5f9c7fdda26 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:46.868473 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe261cd3-0496-48f2-836f-c5f9c7fdda26 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:46.924243 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8412f-5556-4177-8f46-e8f683b16b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:46.925212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8412f-5556-4177-8f46-e8f683b16b29 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:46.925212 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8412f-5556-4177-8f46-e8f683b16b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:46.926069 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8412f-5556-4177-8f46-e8f683b16b29 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:46.926193 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8412f-5556-4177-8f46-e8f683b16b29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:46.928106 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8412f-5556-4177-8f46-e8f683b16b29 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:47.033683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1446/2847] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:12:46 2022] POST /identity/v3/users => generated 281 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:12:47.037863 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce66f70-8fbb-4fcb-a09b-eda2b57f4381 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:47.048945 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce66f70-8fbb-4fcb-a09b-eda2b57f4381 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:47.053682 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b6d87-5134-4001-afdf-7f6cd569feee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:47.054338 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b6d87-5134-4001-afdf-7f6cd569feee admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:47.054621 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b6d87-5134-4001-afdf-7f6cd569feee admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:47.054895 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b6d87-5134-4001-afdf-7f6cd569feee admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:47.055656 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b6d87-5134-4001-afdf-7f6cd569feee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:47.057293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b6d87-5134-4001-afdf-7f6cd569feee admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:47.068975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1402/2848] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:12:47.072862 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8412f-5556-4177-8f46-e8f683b16b29 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:47.082788 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8412f-5556-4177-8f46-e8f683b16b29 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:47.087391 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c803b-1ad9-4750-a0cd-cb9a65dc752e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:47.088048 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c803b-1ad9-4750-a0cd-cb9a65dc752e admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:47.088338 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c803b-1ad9-4750-a0cd-cb9a65dc752e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:47.088641 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c803b-1ad9-4750-a0cd-cb9a65dc752e admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:47.089371 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c803b-1ad9-4750-a0cd-cb9a65dc752e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:47.090968 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c803b-1ad9-4750-a0cd-cb9a65dc752e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:47.100753 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1447/2849] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:12:47.104820 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b6d87-5134-4001-afdf-7f6cd569feee admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:47.115643 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b6d87-5134-4001-afdf-7f6cd569feee admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:47.120406 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59195b-0d2b-4275-b4e5-a6e3741bf64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:47.121355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59195b-0d2b-4275-b4e5-a6e3741bf64b admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:47.121679 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59195b-0d2b-4275-b4e5-a6e3741bf64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:47.123208 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59195b-0d2b-4275-b4e5-a6e3741bf64b admin admin] PATH_INFO: `/v3/projects/7ebeb3dbd733475f8b09ffb298734f15/users/df5f5fd271464ff580ef2c1c3b536fb6/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:47.138837 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59195b-0d2b-4275-b4e5-a6e3741bf64b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ebeb3dbd733475f8b09ffb298734f15, user_id=df5f5fd271464ff580ef2c1c3b536fb6, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:47.141583 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59195b-0d2b-4275-b4e5-a6e3741bf64b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:47.215985 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1403/2850] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:12:47 2022] PUT /identity/v3/projects/7ebeb3dbd733475f8b09ffb298734f15/users/df5f5fd271464ff580ef2c1c3b536fb6/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:12:47.278634 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ffdc2-43f1-4b59-ae9d-e88ce08d7603 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:47.278922 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ffdc2-43f1-4b59-ae9d-e88ce08d7603 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:47.279200 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ffdc2-43f1-4b59-ae9d-e88ce08d7603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:47.305086 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-bb5ffdc2-43f1-4b59-ae9d-e88ce08d7603 None None] MFA Rules not processed for user `df5f5fd271464ff580ef2c1c3b536fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:12:47.306293 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-bb5ffdc2-43f1-4b59-ae9d-e88ce08d7603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:47.367764 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1448/2851] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:12:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:12:47.404131 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59195b-0d2b-4275-b4e5-a6e3741bf64b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:47.408426 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-bb59195b-0d2b-4275-b4e5-a6e3741bf64b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:47.455554 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:47.466591 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59195b-0d2b-4275-b4e5-a6e3741bf64b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:47.470414 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d24f5b-7c78-456d-88d7-7679bc1d51d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:47.471058 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d24f5b-7c78-456d-88d7-7679bc1d51d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:47.471344 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d24f5b-7c78-456d-88d7-7679bc1d51d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:47.471623 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d24f5b-7c78-456d-88d7-7679bc1d51d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:47.479987 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d24f5b-7c78-456d-88d7-7679bc1d51d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:47.482411 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d24f5b-7c78-456d-88d7-7679bc1d51d7 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:47.491631 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1404/2852] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:12:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:12:47.505783 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ffdc2-43f1-4b59-ae9d-e88ce08d7603 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:47.511033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:47.566907 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ffdc2-43f1-4b59-ae9d-e88ce08d7603 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:47.571477 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1b00e-36ab-48ca-bbd9-c9482dcdbf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:47.572337 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1b00e-36ab-48ca-bbd9-c9482dcdbf14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:47.572652 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1b00e-36ab-48ca-bbd9-c9482dcdbf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:47.572933 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1b00e-36ab-48ca-bbd9-c9482dcdbf14 admin admin] PATH_INFO: `/v3/users/df5f5fd271464ff580ef2c1c3b536fb6` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:47.574129 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1b00e-36ab-48ca-bbd9-c9482dcdbf14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df5f5fd271464ff580ef2c1c3b536fb6)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:47.576063 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1b00e-36ab-48ca-bbd9-c9482dcdbf14 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:47.769044 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-28a1b00e-36ab-48ca-bbd9-c9482dcdbf14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df5f5fd271464ff580ef2c1c3b536fb6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:47.775834 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-28a1b00e-36ab-48ca-bbd9-c9482dcdbf14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df5f5fd271464ff580ef2c1c3b536fb6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:47.776489 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-28a1b00e-36ab-48ca-bbd9-c9482dcdbf14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df5f5fd271464ff580ef2c1c3b536fb6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:47.777116 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-28a1b00e-36ab-48ca-bbd9-c9482dcdbf14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df5f5fd271464ff580ef2c1c3b536fb6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:47.789088 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-28a1b00e-36ab-48ca-bbd9-c9482dcdbf14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df5f5fd271464ff580ef2c1c3b536fb6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:47.896121 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1449/2853] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:12:47 2022] DELETE /identity/v3/users/df5f5fd271464ff580ef2c1c3b536fb6 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:47.900727 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0f23c-db55-4347-80bd-2b21368cc6c2 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:47.901025 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0f23c-db55-4347-80bd-2b21368cc6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:47.901308 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0f23c-db55-4347-80bd-2b21368cc6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:47.918868 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-6ca0f23c-db55-4347-80bd-2b21368cc6c2 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:12:47.920072 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6ca0f23c-db55-4347-80bd-2b21368cc6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:47.978540 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1405/2854] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:12:47.988565 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1b00e-36ab-48ca-bbd9-c9482dcdbf14 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:47.990019 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-28a1b00e-36ab-48ca-bbd9-c9482dcdbf14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:48.048089 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1b00e-36ab-48ca-bbd9-c9482dcdbf14 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:48.051769 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b28c95-869b-4570-ae9f-3cb80da9ba66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:48.052444 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b28c95-869b-4570-ae9f-3cb80da9ba66 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:48.052756 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b28c95-869b-4570-ae9f-3cb80da9ba66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:48.053050 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b28c95-869b-4570-ae9f-3cb80da9ba66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:48.062211 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b28c95-869b-4570-ae9f-3cb80da9ba66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:48.063654 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b28c95-869b-4570-ae9f-3cb80da9ba66 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:48.073321 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1450/2855] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:12:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:12:48.461561 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0f23c-db55-4347-80bd-2b21368cc6c2 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:48.463070 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6ca0f23c-db55-4347-80bd-2b21368cc6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:48.475893 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0f23c-db55-4347-80bd-2b21368cc6c2 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:48.480534 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c235c6-e1e4-42f9-ab83-844fd1beba48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:48.481444 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c235c6-e1e4-42f9-ab83-844fd1beba48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:48.481731 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c235c6-e1e4-42f9-ab83-844fd1beba48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:48.482278 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c235c6-e1e4-42f9-ab83-844fd1beba48 admin admin] PATH_INFO: `/v3/projects/7ebeb3dbd733475f8b09ffb298734f15` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:48.483504 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c235c6-e1e4-42f9-ab83-844fd1beba48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ebeb3dbd733475f8b09ffb298734f15)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:48.485474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c235c6-e1e4-42f9-ab83-844fd1beba48 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:48.602111 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-99c235c6-e1e4-42f9-ab83-844fd1beba48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ebeb3dbd733475f8b09ffb298734f15', 'request_id': 'req-99c235c6-e1e4-42f9-ab83-844fd1beba48'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:48.668121 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-99c235c6-e1e4-42f9-ab83-844fd1beba48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ebeb3dbd733475f8b09ffb298734f15', 'request_id': 'req-99c235c6-e1e4-42f9-ab83-844fd1beba48'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:48.675277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-99c235c6-e1e4-42f9-ab83-844fd1beba48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ebeb3dbd733475f8b09ffb298734f15', 'request_id': 'req-99c235c6-e1e4-42f9-ab83-844fd1beba48'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:48.686487 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-99c235c6-e1e4-42f9-ab83-844fd1beba48 admin admin] The token cache is being invalidate because project 7ebeb3dbd733475f8b09ffb298734f15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:12:48.686781 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-99c235c6-e1e4-42f9-ab83-844fd1beba48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:48.687453 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-99c235c6-e1e4-42f9-ab83-844fd1beba48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:48.689035 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1406/2856] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:12:48 2022] DELETE /identity/v3/projects/7ebeb3dbd733475f8b09ffb298734f15 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:48.694052 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73accdf-a128-4f94-b85a-9be420615ce1 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:48.694343 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73accdf-a128-4f94-b85a-9be420615ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:48.694624 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73accdf-a128-4f94-b85a-9be420615ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:48.712026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a73accdf-a128-4f94-b85a-9be420615ce1 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:12:48.713257 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a73accdf-a128-4f94-b85a-9be420615ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:48.733526 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:48.773557 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1451/2857] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:12:48.781490 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca268d3-72fc-4684-b977-c9b7992a8090 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:48.781789 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca268d3-72fc-4684-b977-c9b7992a8090 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:48.782078 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca268d3-72fc-4684-b977-c9b7992a8090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:48.800830 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-9ca268d3-72fc-4684-b977-c9b7992a8090 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:12:48.802052 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9ca268d3-72fc-4684-b977-c9b7992a8090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:48.810643 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1407/2858] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:12:48.814754 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73accdf-a128-4f94-b85a-9be420615ce1 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:48.824984 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73accdf-a128-4f94-b85a-9be420615ce1 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:48.829648 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06475984-60fc-49ca-92bf-91c76dd84888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:48.831021 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06475984-60fc-49ca-92bf-91c76dd84888 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:48.831021 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06475984-60fc-49ca-92bf-91c76dd84888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:48.831021 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06475984-60fc-49ca-92bf-91c76dd84888 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:48.831580 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06475984-60fc-49ca-92bf-91c76dd84888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:12:48.831884 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06475984-60fc-49ca-92bf-91c76dd84888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:48.833506 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06475984-60fc-49ca-92bf-91c76dd84888 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:48.844715 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1452/2859] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 13:12:48.848990 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca268d3-72fc-4684-b977-c9b7992a8090 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:48.859040 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca268d3-72fc-4684-b977-c9b7992a8090 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:48.863567 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c22be-50be-4691-afac-0b9842d04d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:48.864204 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c22be-50be-4691-afac-0b9842d04d0d admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:48.864485 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c22be-50be-4691-afac-0b9842d04d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:48.864813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c22be-50be-4691-afac-0b9842d04d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:48.865510 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c22be-50be-4691-afac-0b9842d04d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:48.867394 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c22be-50be-4691-afac-0b9842d04d0d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:49.001427 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1408/2860] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:12:48 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 13:12:49.005294 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06475984-60fc-49ca-92bf-91c76dd84888 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:49.015136 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06475984-60fc-49ca-92bf-91c76dd84888 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:49.070605 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918a810-950c-4ca0-a403-36eafb37c361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:49.071277 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918a810-950c-4ca0-a403-36eafb37c361 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:49.071559 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918a810-950c-4ca0-a403-36eafb37c361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:49.071833 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918a810-950c-4ca0-a403-36eafb37c361 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:49.072525 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918a810-950c-4ca0-a403-36eafb37c361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:49.074462 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918a810-950c-4ca0-a403-36eafb37c361 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:49.205214 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1453/2861] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:12:49 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:12:49.209158 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c22be-50be-4691-afac-0b9842d04d0d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:49.219853 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c22be-50be-4691-afac-0b9842d04d0d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:49.224315 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4a07a-7c25-454a-94ed-b5540c64c6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:49.225005 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4a07a-7c25-454a-94ed-b5540c64c6ea admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:49.225285 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4a07a-7c25-454a-94ed-b5540c64c6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:49.225558 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4a07a-7c25-454a-94ed-b5540c64c6ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:49.226272 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4a07a-7c25-454a-94ed-b5540c64c6ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:49.227855 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4a07a-7c25-454a-94ed-b5540c64c6ea admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:49.238852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1409/2862] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:12:49.242572 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918a810-950c-4ca0-a403-36eafb37c361 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:49.252636 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918a810-950c-4ca0-a403-36eafb37c361 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:49.257455 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164de10a-a839-418c-977f-739dde712111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:49.258143 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164de10a-a839-418c-977f-739dde712111 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:49.258427 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164de10a-a839-418c-977f-739dde712111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:49.258706 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164de10a-a839-418c-977f-739dde712111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:49.259457 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164de10a-a839-418c-977f-739dde712111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:49.261127 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164de10a-a839-418c-977f-739dde712111 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:49.271991 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1454/2863] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:12:49.275958 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4a07a-7c25-454a-94ed-b5540c64c6ea admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:49.286348 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4a07a-7c25-454a-94ed-b5540c64c6ea admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:49.290853 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d3429-a4e8-4e6f-9d5a-79462438be02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:49.291719 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d3429-a4e8-4e6f-9d5a-79462438be02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:49.292004 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d3429-a4e8-4e6f-9d5a-79462438be02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:49.292283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d3429-a4e8-4e6f-9d5a-79462438be02 admin admin] PATH_INFO: `/v3/projects/3a0e927c182044a69679b82e1eec1af8/users/f7853caec2cb4291981ff9a72632aff8/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:49.307097 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d3429-a4e8-4e6f-9d5a-79462438be02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0e927c182044a69679b82e1eec1af8, user_id=f7853caec2cb4291981ff9a72632aff8, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:49.309788 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d3429-a4e8-4e6f-9d5a-79462438be02 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:49.370221 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1410/2864] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:12:49 2022] PUT /identity/v3/projects/3a0e927c182044a69679b82e1eec1af8/users/f7853caec2cb4291981ff9a72632aff8/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 13:12:49.380398 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac3a2c-933b-4bea-9bcb-2a27cb45da18 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:49.380864 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac3a2c-933b-4bea-9bcb-2a27cb45da18 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:49.381036 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac3a2c-933b-4bea-9bcb-2a27cb45da18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:49.407841 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-82ac3a2c-933b-4bea-9bcb-2a27cb45da18 None None] MFA Rules not processed for user `f7853caec2cb4291981ff9a72632aff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:12:49.409110 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-82ac3a2c-933b-4bea-9bcb-2a27cb45da18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:49.477318 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1455/2865] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:12:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 13:12:49.488521 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d3429-a4e8-4e6f-9d5a-79462438be02 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:49.490298 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-732d3429-a4e8-4e6f-9d5a-79462438be02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:49.500397 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:49.548433 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d3429-a4e8-4e6f-9d5a-79462438be02 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:49.552074 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaffe65-42e3-4c74-960e-dd6dad38c31d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb924cdb5aa48ba9dfcc7be7e912991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:49.552758 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaffe65-42e3-4c74-960e-dd6dad38c31d service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:49.553052 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaffe65-42e3-4c74-960e-dd6dad38c31d service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:49.553321 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaffe65-42e3-4c74-960e-dd6dad38c31d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:49.561538 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaffe65-42e3-4c74-960e-dd6dad38c31d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:49.562964 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaffe65-42e3-4c74-960e-dd6dad38c31d service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:49.572082 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1411/2866] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:12:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:12:53.629674 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac3a2c-933b-4bea-9bcb-2a27cb45da18 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:53.654650 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:53.691196 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac3a2c-933b-4bea-9bcb-2a27cb45da18 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:53.695789 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7373ae-126b-4fc4-8778-215dce0517f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:53.696683 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7373ae-126b-4fc4-8778-215dce0517f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:53.696970 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7373ae-126b-4fc4-8778-215dce0517f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:53.697251 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7373ae-126b-4fc4-8778-215dce0517f5 admin admin] PATH_INFO: `/v3/users/f7853caec2cb4291981ff9a72632aff8` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:53.698502 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7373ae-126b-4fc4-8778-215dce0517f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7853caec2cb4291981ff9a72632aff8)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:53.701421 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7373ae-126b-4fc4-8778-215dce0517f5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:53.872963 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8d7373ae-126b-4fc4-8778-215dce0517f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7853caec2cb4291981ff9a72632aff8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:53.879801 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8d7373ae-126b-4fc4-8778-215dce0517f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7853caec2cb4291981ff9a72632aff8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:53.880456 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8d7373ae-126b-4fc4-8778-215dce0517f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7853caec2cb4291981ff9a72632aff8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:53.881089 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8d7373ae-126b-4fc4-8778-215dce0517f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7853caec2cb4291981ff9a72632aff8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:53.892814 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8d7373ae-126b-4fc4-8778-215dce0517f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7853caec2cb4291981ff9a72632aff8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:53.961373 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1456/2867] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:12:53 2022] DELETE /identity/v3/users/f7853caec2cb4291981ff9a72632aff8 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:53.965864 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f9a27-437d-4984-8bea-794c801fca20 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:53.966383 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f9a27-437d-4984-8bea-794c801fca20 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:53.966491 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f9a27-437d-4984-8bea-794c801fca20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:53.984188 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-376f9a27-437d-4984-8bea-794c801fca20 None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:12:53.985427 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-376f9a27-437d-4984-8bea-794c801fca20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:54.044318 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1412/2868] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:12:54.053934 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7373ae-126b-4fc4-8778-215dce0517f5 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:54.055360 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8d7373ae-126b-4fc4-8778-215dce0517f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:54.112376 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7373ae-126b-4fc4-8778-215dce0517f5 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:54.115988 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee85467-9ea8-48cb-a807-a763ef67a234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:54.116661 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee85467-9ea8-48cb-a807-a763ef67a234 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:54.116949 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee85467-9ea8-48cb-a807-a763ef67a234 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:54.117227 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee85467-9ea8-48cb-a807-a763ef67a234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:54.126848 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee85467-9ea8-48cb-a807-a763ef67a234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:54.128228 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee85467-9ea8-48cb-a807-a763ef67a234 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:54.137762 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1457/2869] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:12:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:12:54.526106 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f9a27-437d-4984-8bea-794c801fca20 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:54.528161 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-376f9a27-437d-4984-8bea-794c801fca20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:54.540577 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f9a27-437d-4984-8bea-794c801fca20 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:54.545940 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e71523-a07f-478d-81ba-a375e5c7f366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:54.546816 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e71523-a07f-478d-81ba-a375e5c7f366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:54.547104 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e71523-a07f-478d-81ba-a375e5c7f366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:54.547384 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e71523-a07f-478d-81ba-a375e5c7f366 admin admin] PATH_INFO: `/v3/projects/3a0e927c182044a69679b82e1eec1af8` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:54.548576 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e71523-a07f-478d-81ba-a375e5c7f366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0e927c182044a69679b82e1eec1af8)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:54.550566 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e71523-a07f-478d-81ba-a375e5c7f366 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:54.670259 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-83e71523-a07f-478d-81ba-a375e5c7f366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0e927c182044a69679b82e1eec1af8', 'request_id': 'req-83e71523-a07f-478d-81ba-a375e5c7f366'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:54.765053 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-83e71523-a07f-478d-81ba-a375e5c7f366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0e927c182044a69679b82e1eec1af8', 'request_id': 'req-83e71523-a07f-478d-81ba-a375e5c7f366'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:54.771830 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-83e71523-a07f-478d-81ba-a375e5c7f366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0e927c182044a69679b82e1eec1af8', 'request_id': 'req-83e71523-a07f-478d-81ba-a375e5c7f366'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:54.782822 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-83e71523-a07f-478d-81ba-a375e5c7f366 admin admin] The token cache is being invalidate because project 3a0e927c182044a69679b82e1eec1af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:12:54.783112 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-83e71523-a07f-478d-81ba-a375e5c7f366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:54.783750 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-83e71523-a07f-478d-81ba-a375e5c7f366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:12:54.785345 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1413/2870] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:12:54 2022] DELETE /identity/v3/projects/3a0e927c182044a69679b82e1eec1af8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:54.790452 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa345d-4b16-421b-a077-35276b20ae3e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:54.790915 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa345d-4b16-421b-a077-35276b20ae3e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:54.791032 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa345d-4b16-421b-a077-35276b20ae3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:54.808626 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-14fa345d-4b16-421b-a077-35276b20ae3e None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:12:54.809984 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-14fa345d-4b16-421b-a077-35276b20ae3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:54.849727 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:54.867916 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1458/2871] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:12:54.876981 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650947aa-6b44-47bd-bd83-996e5c70c5dd None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:54.877329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650947aa-6b44-47bd-bd83-996e5c70c5dd None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:54.877620 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650947aa-6b44-47bd-bd83-996e5c70c5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:54.896329 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-650947aa-6b44-47bd-bd83-996e5c70c5dd None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:12:54.897564 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-650947aa-6b44-47bd-bd83-996e5c70c5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:54.906067 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1414/2872] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:12:54.910250 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa345d-4b16-421b-a077-35276b20ae3e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:54.919669 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa345d-4b16-421b-a077-35276b20ae3e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:54.924417 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca5e1f-a31c-44a1-9624-f252a8f01d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:54.925161 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca5e1f-a31c-44a1-9624-f252a8f01d4d admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:54.925863 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca5e1f-a31c-44a1-9624-f252a8f01d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:54.926138 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca5e1f-a31c-44a1-9624-f252a8f01d4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:54.926866 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca5e1f-a31c-44a1-9624-f252a8f01d4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 13:12:54.927188 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca5e1f-a31c-44a1-9624-f252a8f01d4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:54.928829 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca5e1f-a31c-44a1-9624-f252a8f01d4d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:54.940636 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1459/2873] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jul 5 13:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 13:12:54.944749 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650947aa-6b44-47bd-bd83-996e5c70c5dd None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:54.954453 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650947aa-6b44-47bd-bd83-996e5c70c5dd None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:54.958992 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a0c0f-5c17-4712-b55b-8424f18e3c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:54.959629 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a0c0f-5c17-4712-b55b-8424f18e3c4b admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:54.959914 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a0c0f-5c17-4712-b55b-8424f18e3c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:54.960196 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a0c0f-5c17-4712-b55b-8424f18e3c4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:54.960907 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a0c0f-5c17-4712-b55b-8424f18e3c4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:54.962829 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a0c0f-5c17-4712-b55b-8424f18e3c4b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:55.040313 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1415/2874] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jul 5 13:12:54 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:12:55.044529 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca5e1f-a31c-44a1-9624-f252a8f01d4d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:55.054509 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca5e1f-a31c-44a1-9624-f252a8f01d4d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:55.111612 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca909d2b-5642-4221-b84e-4eb2ebf4a1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:55.112311 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca909d2b-5642-4221-b84e-4eb2ebf4a1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:55.112615 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca909d2b-5642-4221-b84e-4eb2ebf4a1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:55.112902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca909d2b-5642-4221-b84e-4eb2ebf4a1e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:55.113599 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca909d2b-5642-4221-b84e-4eb2ebf4a1e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:55.115512 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca909d2b-5642-4221-b84e-4eb2ebf4a1e5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:55.216033 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1460/2875] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jul 5 13:12:55 2022] POST /identity/v3/users => generated 284 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 13:12:55.220391 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a0c0f-5c17-4712-b55b-8424f18e3c4b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:55.227120 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:12:55.230963 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a0c0f-5c17-4712-b55b-8424f18e3c4b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:55.235830 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6bf3d-4306-4356-8df6-080ad90b5b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:55.236482 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6bf3d-4306-4356-8df6-080ad90b5b12 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:55.236796 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6bf3d-4306-4356-8df6-080ad90b5b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:55.237073 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6bf3d-4306-4356-8df6-080ad90b5b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:55.237795 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6bf3d-4306-4356-8df6-080ad90b5b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:55.239385 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6bf3d-4306-4356-8df6-080ad90b5b12 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:55.250250 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1416/2876] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:12:55.254150 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca909d2b-5642-4221-b84e-4eb2ebf4a1e5 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:55.264905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca909d2b-5642-4221-b84e-4eb2ebf4a1e5 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:55.269670 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d70fc6-9721-466b-b61c-b16d3e209fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:55.270330 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d70fc6-9721-466b-b61c-b16d3e209fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:55.270617 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d70fc6-9721-466b-b61c-b16d3e209fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:55.270896 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d70fc6-9721-466b-b61c-b16d3e209fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:55.271618 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d70fc6-9721-466b-b61c-b16d3e209fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:55.273303 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d70fc6-9721-466b-b61c-b16d3e209fc5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:55.283276 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1461/2877] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jul 5 13:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 13:12:55.287513 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6bf3d-4306-4356-8df6-080ad90b5b12 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:55.298645 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6bf3d-4306-4356-8df6-080ad90b5b12 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:55.303279 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ce1ad-0b7e-49be-ba5d-f2681f730186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:55.304193 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ce1ad-0b7e-49be-ba5d-f2681f730186 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:55.304463 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ce1ad-0b7e-49be-ba5d-f2681f730186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:55.304852 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ce1ad-0b7e-49be-ba5d-f2681f730186 admin admin] PATH_INFO: `/v3/projects/7197948a6a054334ac7d7927a49c5d20/users/acf9f1c26f2d493d87d324f2c81dc4e4/roles/66d9c5a190d544b3b3588bbdadf2cf39` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:55.322534 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ce1ad-0b7e-49be-ba5d-f2681f730186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7197948a6a054334ac7d7927a49c5d20, user_id=acf9f1c26f2d493d87d324f2c81dc4e4, role_id=66d9c5a190d544b3b3588bbdadf2cf39)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:55.325215 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ce1ad-0b7e-49be-ba5d-f2681f730186 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:55.384310 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1417/2878] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jul 5 13:12:55 2022] PUT /identity/v3/projects/7197948a6a054334ac7d7927a49c5d20/users/acf9f1c26f2d493d87d324f2c81dc4e4/roles/66d9c5a190d544b3b3588bbdadf2cf39 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:12:55.394643 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02940adb-b816-43e9-aba2-cebc5d9a4ccc None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:55.394937 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02940adb-b816-43e9-aba2-cebc5d9a4ccc None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:55.395237 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02940adb-b816-43e9-aba2-cebc5d9a4ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:55.421644 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-02940adb-b816-43e9-aba2-cebc5d9a4ccc None None] MFA Rules not processed for user `acf9f1c26f2d493d87d324f2c81dc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:12:55.423536 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-02940adb-b816-43e9-aba2-cebc5d9a4ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:55.487687 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1462/2879] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:12:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:12:55.500217 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ce1ad-0b7e-49be-ba5d-f2681f730186 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:12:55.501996 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e95ce1ad-0b7e-49be-ba5d-f2681f730186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:12:55.557519 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ce1ad-0b7e-49be-ba5d-f2681f730186 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:12:55.562025 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e0a76-ec1b-4b55-aa9d-43a74ebae052 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e7c4b0bd50c474996a21b69bde4e227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:12:55.562662 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e0a76-ec1b-4b55-aa9d-43a74ebae052 service glance] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:12:55.562971 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e0a76-ec1b-4b55-aa9d-43a74ebae052 service glance] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:12:55.563263 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e0a76-ec1b-4b55-aa9d-43a74ebae052 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:12:55.571503 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e0a76-ec1b-4b55-aa9d-43a74ebae052 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:12:55.572962 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e0a76-ec1b-4b55-aa9d-43a74ebae052 service glance] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:12:55.581681 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1418/2880] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:12:55 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:13:05.484840 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:13:05.577748 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:13:24.550397 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02940adb-b816-43e9-aba2-cebc5d9a4ccc None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:13:24.553756 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-02940adb-b816-43e9-aba2-cebc5d9a4ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:13:24.673948 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02940adb-b816-43e9-aba2-cebc5d9a4ccc None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:13:24.681639 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbdbe6-2c70-44c5-a11d-64c131e00830 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf37a42279a466b85906b23751f9c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:13:24.686166 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbdbe6-2c70-44c5-a11d-64c131e00830 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:13:24.686166 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbdbe6-2c70-44c5-a11d-64c131e00830 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:13:24.686166 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbdbe6-2c70-44c5-a11d-64c131e00830 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:13:24.686166 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-41dbdbe6-2c70-44c5-a11d-64c131e00830 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:13:24.702786 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbdbe6-2c70-44c5-a11d-64c131e00830 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:13:24.704728 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbdbe6-2c70-44c5-a11d-64c131e00830 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:13:24.722089 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1463/2881] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:13:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:13:28.495910 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e0a76-ec1b-4b55-aa9d-43a74ebae052 service glance] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:13:28.577440 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e0a76-ec1b-4b55-aa9d-43a74ebae052 service glance] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:13:28.582651 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b60e2-5054-4737-95d9-bf78b03d640b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:13:28.583532 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b60e2-5054-4737-95d9-bf78b03d640b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:13:28.583819 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b60e2-5054-4737-95d9-bf78b03d640b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:13:28.584099 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b60e2-5054-4737-95d9-bf78b03d640b admin admin] PATH_INFO: `/v3/users/acf9f1c26f2d493d87d324f2c81dc4e4` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:13:28.585355 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b60e2-5054-4737-95d9-bf78b03d640b admin admin] RBAC: Authorizing `identity:delete_user(user_id=acf9f1c26f2d493d87d324f2c81dc4e4)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:13:28.587283 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b60e2-5054-4737-95d9-bf78b03d640b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:13:28.769421 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-df0b60e2-5054-4737-95d9-bf78b03d640b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acf9f1c26f2d493d87d324f2c81dc4e4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:28.776540 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-df0b60e2-5054-4737-95d9-bf78b03d640b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acf9f1c26f2d493d87d324f2c81dc4e4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:28.777260 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-df0b60e2-5054-4737-95d9-bf78b03d640b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acf9f1c26f2d493d87d324f2c81dc4e4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:28.777904 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-df0b60e2-5054-4737-95d9-bf78b03d640b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acf9f1c26f2d493d87d324f2c81dc4e4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:28.790753 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-df0b60e2-5054-4737-95d9-bf78b03d640b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acf9f1c26f2d493d87d324f2c81dc4e4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:28.863869 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1419/2882] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:13:28 2022] DELETE /identity/v3/users/acf9f1c26f2d493d87d324f2c81dc4e4 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:13:28.868401 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb475b-3bca-4cd4-9160-f13b0250b8bf None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:13:28.868905 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb475b-3bca-4cd4-9160-f13b0250b8bf None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:13:28.869008 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb475b-3bca-4cd4-9160-f13b0250b8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:13:28.897551 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-12fb475b-3bca-4cd4-9160-f13b0250b8bf None None] MFA Rules not processed for user `1dacaea933b24b6082a79a2c673ec9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:13:28.898760 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-12fb475b-3bca-4cd4-9160-f13b0250b8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:13:28.958314 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1464/2883] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jul 5 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:13:28.967975 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b60e2-5054-4737-95d9-bf78b03d640b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:13:28.969482 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-df0b60e2-5054-4737-95d9-bf78b03d640b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:13:29.034417 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:13:29.052098 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b60e2-5054-4737-95d9-bf78b03d640b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:13:29.055126 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e12f9-f332-465f-982d-2b5247517160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07ab8f60c4ff4969a277b33dca05e685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:13:29.055782 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e12f9-f332-465f-982d-2b5247517160 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:13:29.056065 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e12f9-f332-465f-982d-2b5247517160 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:13:29.056374 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e12f9-f332-465f-982d-2b5247517160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:13:29.066787 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e12f9-f332-465f-982d-2b5247517160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:13:29.068251 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e12f9-f332-465f-982d-2b5247517160 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:13:29.078367 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1420/2884] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:13:29.519808 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb475b-3bca-4cd4-9160-f13b0250b8bf None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:13:29.521271 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-12fb475b-3bca-4cd4-9160-f13b0250b8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:13:29.534587 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb475b-3bca-4cd4-9160-f13b0250b8bf None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:13:29.540240 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630c5fa-780f-4f94-8290-27446bc2b765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:13:29.541583 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630c5fa-780f-4f94-8290-27446bc2b765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:13:29.542068 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630c5fa-780f-4f94-8290-27446bc2b765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:13:29.542550 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630c5fa-780f-4f94-8290-27446bc2b765 admin admin] PATH_INFO: `/v3/projects/7197948a6a054334ac7d7927a49c5d20` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:13:29.544740 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630c5fa-780f-4f94-8290-27446bc2b765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7197948a6a054334ac7d7927a49c5d20)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:13:29.548476 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630c5fa-780f-4f94-8290-27446bc2b765 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:13:29.684858 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0630c5fa-780f-4f94-8290-27446bc2b765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7197948a6a054334ac7d7927a49c5d20', 'request_id': 'req-0630c5fa-780f-4f94-8290-27446bc2b765'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:29.690316 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0630c5fa-780f-4f94-8290-27446bc2b765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7197948a6a054334ac7d7927a49c5d20', 'request_id': 'req-0630c5fa-780f-4f94-8290-27446bc2b765'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:29.696392 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0630c5fa-780f-4f94-8290-27446bc2b765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7197948a6a054334ac7d7927a49c5d20', 'request_id': 'req-0630c5fa-780f-4f94-8290-27446bc2b765'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:29.822821 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:13:29.826611 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0630c5fa-780f-4f94-8290-27446bc2b765 admin admin] The token cache is being invalidate because project 7197948a6a054334ac7d7927a49c5d20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:13:29.826902 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0630c5fa-780f-4f94-8290-27446bc2b765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:29.827518 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0630c5fa-780f-4f94-8290-27446bc2b765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:29.829161 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1465/2885] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:13:29 2022] DELETE /identity/v3/projects/7197948a6a054334ac7d7927a49c5d20 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:13:32.634450 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107d939-5fa5-467d-878b-0b427be0874c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:13:32.634957 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107d939-5fa5-467d-878b-0b427be0874c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:13:32.635090 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107d939-5fa5-467d-878b-0b427be0874c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:13:32.653437 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b107d939-5fa5-467d-878b-0b427be0874c None None] MFA Rules not processed for user `ab47c91ba7854bc09f656607dbb41cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 13:13:32.654699 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b107d939-5fa5-467d-878b-0b427be0874c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:13:32.710689 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1421/2886] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jul 5 13:13:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 13:13:32.751605 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630c5fa-780f-4f94-8290-27446bc2b765 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:13:32.753064 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0630c5fa-780f-4f94-8290-27446bc2b765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:13:32.821100 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630c5fa-780f-4f94-8290-27446bc2b765 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:13:32.826003 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c5cb0-10b8-4941-b9d4-0ee1dd4a9bb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fb7db02f8e945a7af39cb30c3d606f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:13:32.826653 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c5cb0-10b8-4941-b9d4-0ee1dd4a9bb2 service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:13:32.826963 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c5cb0-10b8-4941-b9d4-0ee1dd4a9bb2 service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:13:32.827238 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c5cb0-10b8-4941-b9d4-0ee1dd4a9bb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:13:32.835277 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c5cb0-10b8-4941-b9d4-0ee1dd4a9bb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:13:32.836895 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c5cb0-10b8-4941-b9d4-0ee1dd4a9bb2 service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:13:32.845016 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1466/2887] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jul 5 13:13:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 13:13:37.190194 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107d939-5fa5-467d-878b-0b427be0874c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:13:37.191642 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b107d939-5fa5-467d-878b-0b427be0874c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:13:37.262949 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107d939-5fa5-467d-878b-0b427be0874c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:13:37.268277 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e414c-e047-44a7-beb0-7c1c90df066d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43b85b5c7b1e4d73b29fb96f4fa6db71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:13:37.268970 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e414c-e047-44a7-beb0-7c1c90df066d service placement] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:13:37.269284 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e414c-e047-44a7-beb0-7c1c90df066d service placement] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:13:37.272278 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e414c-e047-44a7-beb0-7c1c90df066d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:13:37.272278 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-082e414c-e047-44a7-beb0-7c1c90df066d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:13:37.282950 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e414c-e047-44a7-beb0-7c1c90df066d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:13:37.284569 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e414c-e047-44a7-beb0-7c1c90df066d service placement] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:13:37.295309 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1422/2888] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:13:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:13:41.015980 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c5cb0-10b8-4941-b9d4-0ee1dd4a9bb2 service swift] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:13:41.017542 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4e1c5cb0-10b8-4941-b9d4-0ee1dd4a9bb2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:13:41.114341 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c5cb0-10b8-4941-b9d4-0ee1dd4a9bb2 service swift] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:13:41.118924 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e63ef-b205-4414-9143-0abb2027a6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:13:41.119824 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e63ef-b205-4414-9143-0abb2027a6b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:13:41.120159 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e63ef-b205-4414-9143-0abb2027a6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:13:41.120438 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e63ef-b205-4414-9143-0abb2027a6b2 admin admin] PATH_INFO: `/v3/users/dc8472b840794ab8ac0ccd49b2fd1657` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:13:41.121671 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e63ef-b205-4414-9143-0abb2027a6b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc8472b840794ab8ac0ccd49b2fd1657)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:13:41.123593 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e63ef-b205-4414-9143-0abb2027a6b2 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:13:41.302628 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-787e63ef-b205-4414-9143-0abb2027a6b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc8472b840794ab8ac0ccd49b2fd1657'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:41.309369 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-787e63ef-b205-4414-9143-0abb2027a6b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc8472b840794ab8ac0ccd49b2fd1657'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:41.310021 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-787e63ef-b205-4414-9143-0abb2027a6b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc8472b840794ab8ac0ccd49b2fd1657'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:41.310619 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-787e63ef-b205-4414-9143-0abb2027a6b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc8472b840794ab8ac0ccd49b2fd1657'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:41.315706 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:13:41.322924 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-787e63ef-b205-4414-9143-0abb2027a6b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc8472b840794ab8ac0ccd49b2fd1657'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:41.397217 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1467/2889] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:13:41 2022] DELETE /identity/v3/users/dc8472b840794ab8ac0ccd49b2fd1657 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:13:41.637498 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e414c-e047-44a7-beb0-7c1c90df066d service placement] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:13:41.651129 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e414c-e047-44a7-beb0-7c1c90df066d service placement] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:13:41.717061 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a69cf-fcec-416b-a152-66c39058414d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:13:41.717918 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a69cf-fcec-416b-a152-66c39058414d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:13:41.718199 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a69cf-fcec-416b-a152-66c39058414d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:13:41.718474 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a69cf-fcec-416b-a152-66c39058414d admin admin] PATH_INFO: `/v3/projects/4e0f29cb8f344bbf9fd1b7ffb626bbcb` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:13:41.719692 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a69cf-fcec-416b-a152-66c39058414d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e0f29cb8f344bbf9fd1b7ffb626bbcb)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:13:41.721769 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a69cf-fcec-416b-a152-66c39058414d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:13:41.743602 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:13:41.883702 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c32a69cf-fcec-416b-a152-66c39058414d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'request_id': 'req-c32a69cf-fcec-416b-a152-66c39058414d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:41.969231 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c32a69cf-fcec-416b-a152-66c39058414d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'request_id': 'req-c32a69cf-fcec-416b-a152-66c39058414d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:41.976321 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c32a69cf-fcec-416b-a152-66c39058414d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e0f29cb8f344bbf9fd1b7ffb626bbcb', 'request_id': 'req-c32a69cf-fcec-416b-a152-66c39058414d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:41.986928 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c32a69cf-fcec-416b-a152-66c39058414d admin admin] The token cache is being invalidate because project 4e0f29cb8f344bbf9fd1b7ffb626bbcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:13:41.987210 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c32a69cf-fcec-416b-a152-66c39058414d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:41.987914 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c32a69cf-fcec-416b-a152-66c39058414d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:41.989520 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1423/2890] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:13:41 2022] DELETE /identity/v3/projects/4e0f29cb8f344bbf9fd1b7ffb626bbcb => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:13:41.993527 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e63ef-b205-4414-9143-0abb2027a6b2 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:13:41.994957 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-787e63ef-b205-4414-9143-0abb2027a6b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:13:42.008024 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e63ef-b205-4414-9143-0abb2027a6b2 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:13:42.064559 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db163a-c3b3-40d2-842f-2fa5fb9ac2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:13:42.065469 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db163a-c3b3-40d2-842f-2fa5fb9ac2cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:13:42.065753 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db163a-c3b3-40d2-842f-2fa5fb9ac2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:13:42.066026 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db163a-c3b3-40d2-842f-2fa5fb9ac2cc admin admin] PATH_INFO: `/v3/users/69538df176d644b3b396f86d220a27af` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:13:42.067216 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db163a-c3b3-40d2-842f-2fa5fb9ac2cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=69538df176d644b3b396f86d220a27af)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:13:42.069636 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db163a-c3b3-40d2-842f-2fa5fb9ac2cc admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:13:42.337350 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-21db163a-c3b3-40d2-842f-2fa5fb9ac2cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69538df176d644b3b396f86d220a27af'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:42.344336 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-21db163a-c3b3-40d2-842f-2fa5fb9ac2cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69538df176d644b3b396f86d220a27af'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:42.345046 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-21db163a-c3b3-40d2-842f-2fa5fb9ac2cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69538df176d644b3b396f86d220a27af'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:42.345690 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-21db163a-c3b3-40d2-842f-2fa5fb9ac2cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69538df176d644b3b396f86d220a27af'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:42.357809 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-21db163a-c3b3-40d2-842f-2fa5fb9ac2cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69538df176d644b3b396f86d220a27af'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:42.426172 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1468/2891] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jul 5 13:13:41 2022] DELETE /identity/v3/users/69538df176d644b3b396f86d220a27af => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:13:42.665813 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a69cf-fcec-416b-a152-66c39058414d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:13:42.667387 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c32a69cf-fcec-416b-a152-66c39058414d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:13:42.684029 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a69cf-fcec-416b-a152-66c39058414d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:13:42.750138 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e067c8-e159-4ead-9ab3-de3876153f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dacaea933b24b6082a79a2c673ec9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b34caad9134a4665ac2d8976c95be2ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:13:42.751008 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e067c8-e159-4ead-9ab3-de3876153f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:13:42.751293 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e067c8-e159-4ead-9ab3-de3876153f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:13:42.751569 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e067c8-e159-4ead-9ab3-de3876153f99 admin admin] PATH_INFO: `/v3/projects/950ec3cdd1c947b3a186ed11ecd51b64` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:13:42.752919 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e067c8-e159-4ead-9ab3-de3876153f99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=950ec3cdd1c947b3a186ed11ecd51b64)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:13:42.754823 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e067c8-e159-4ead-9ab3-de3876153f99 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:13:42.868319 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b2e067c8-e159-4ead-9ab3-de3876153f99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '950ec3cdd1c947b3a186ed11ecd51b64', 'request_id': 'req-b2e067c8-e159-4ead-9ab3-de3876153f99'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:42.929392 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b2e067c8-e159-4ead-9ab3-de3876153f99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '950ec3cdd1c947b3a186ed11ecd51b64', 'request_id': 'req-b2e067c8-e159-4ead-9ab3-de3876153f99'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:42.936043 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b2e067c8-e159-4ead-9ab3-de3876153f99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '950ec3cdd1c947b3a186ed11ecd51b64', 'request_id': 'req-b2e067c8-e159-4ead-9ab3-de3876153f99'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:42.947671 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b2e067c8-e159-4ead-9ab3-de3876153f99 admin admin] The token cache is being invalidate because project 950ec3cdd1c947b3a186ed11ecd51b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 13:13:42.947969 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b2e067c8-e159-4ead-9ab3-de3876153f99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:42.948628 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b2e067c8-e159-4ead-9ab3-de3876153f99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 13:13:42.950186 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1424/2892] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jul 5 13:13:42 2022] DELETE /identity/v3/projects/950ec3cdd1c947b3a186ed11ecd51b64 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 13:13:52.422404 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=59,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:13:52.945496 dv-cinder-797608-48-iscsi devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=67,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 13:15:06.855930 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db163a-c3b3-40d2-842f-2fa5fb9ac2cc admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 13:15:06.857599 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-21db163a-c3b3-40d2-842f-2fa5fb9ac2cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:15:06.947616 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db163a-c3b3-40d2-842f-2fa5fb9ac2cc admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 13:15:07.007644 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6ae7b-314b-4de6-a0e3-c4cea88c2a18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43b85b5c7b1e4d73b29fb96f4fa6db71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4190347294b48c096d7aa9d3a479d12', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 13:15:07.008314 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6ae7b-314b-4de6-a0e3-c4cea88c2a18 service placement] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 13:15:07.008604 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6ae7b-314b-4de6-a0e3-c4cea88c2a18 service placement] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 13:15:07.008893 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6ae7b-314b-4de6-a0e3-c4cea88c2a18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 13:15:07.010667 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4dd6ae7b-314b-4de6-a0e3-c4cea88c2a18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 13:15:07.022179 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6ae7b-314b-4de6-a0e3-c4cea88c2a18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 13:15:07.023752 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6ae7b-314b-4de6-a0e3-c4cea88c2a18 service placement] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 13:15:07.033458 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1469/2893] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jul 5 13:15:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 13:15:17.029390 dv-cinder-797608-48-iscsi devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=67 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}